Can I reconfigure application to use FQDNs of servers instead of IPs?

I've noticed that if I go in to my Application Services > Applications > [My App] > Reconfigure > I am not able to add the servers next to "Pool: Members" by FQDN. It seems it will only accept IP add...