RDS Farm not Balancing

Here's my setup:   1 server hosting RDS Gateway & Web Access roles 1 connection broker 2 RDS Sessions hosts in a farm (All are Windows Server 2008 R2) I have the Session Hosts load balanced...