VIP for LDAP requests not working

I have a VIP which is configured with just tcp profile, is listening on port 636 and have got a pool whose pool member (only 1 pool member) is also listening on port 636. ltm virtual LDAP-VIP { destination a.b.c.d:636 ip-protocol tcp pool LDAP-POOL profiles {tcp {} } source-address-translation {pool SNAT-POOL type snat}} ltm pool LDAP-POOL {load-balancing-mode least-connections-members members { ldapserver:636 { address e.f.g.h session monitor-enabled state up } } monitor ldap-monitor }

 

This setup works fine for all the ldap request, but when I am trying to do a ldaps://ldapsearch to the VIP from the same ldap-server (e.f.g.h), I get "ldap_sasl_bind(SIMPLE): Can't contact LDAP server (-1) " What can be the issue?