Slow first outbound connection. Fast subsequent connections.

The problem is that the first outbound connection from a server to a host is very slow. The second and subsequent connections are very fast. We are testing wget 100m test files over http from vario...