Https is taking 4 seconds on first request while http is lightening fast.

Please help me out   I have one http VS and one https VS (client side profile attached) and I am using the same pool for both.   In client side profile I configured client certificate ignored....