LB Algorithm : Least Connections

Hi Guys, Need a quick tip.   I have like 4 VIP's set up with least connections trying to load balance VDI servers, and the users were able to access the first time and the subsequent requests fail...