Smart Card Certificate Box Close Page Still Loads

Trying to configure Smart Card Authentication and when I go to the URL of the site I am testing I get the select certificate box like I am supposed to but when I close out of the certificate box without selecting a cert it still allows me to access the website. Anybody have any ideas?