Lync Edge Servers Default Gateway - HELP

So I should have a route set up on our F5 so that allows our edge servers internet access? I just havent seen any documentation on lync set up behind BipIP where it mentions this and believe me I have scoured the internet. Right now there is just one default gateway route listed under routes on the BigIP. It is just very odd that remotely the full lync client connects fine no issues at all with our current setup. Doing traces I see it connects to F5 VIPs and never tries to directly talk to the av service on the edge servers like the attendee does. everything goes through the VIPs. Then I can uninstall the full lync client install the attendee and the audio/sharing will not connect. Then doing traces I can see it is trying to talk directly to the edge servers like I mentioned, instead of just the VIPs like the full client does. Very frustrating.