Yes.
You can do this on the "API Keys and Whitelist" page, accessed on the top right corner of the Hydrogen admin portal. In the example shown below, a comma is used between each IP4 you wish to whitelist.
The authentication of the IP4s is automatically done by Hydrogen when the "Submit" button is pressed!