http profile on layer 4 server intermittently breaks connections

Has anyone seen this?   I have a performance layer 4 virtual server (that for some reason had an http profile attached) that is load balancing microsoft ADFS servers. Since it's passthrough the b...