Forum Discussion

Parveez_70209's avatar
Parveez_70209
Icon for Nimbostratus rankNimbostratus
Oct 03, 2013

How to hide URL( Virtual-Servers) which are exposed over Internet from search engines using robots.txt?

Hi,   Kindly guide into this, we wanted to hide our Virtual-server which is exposed into internet from search engines using robots.txt?   I was also going through the below link in which Kevin ...
Kevin_Stewart's avatar
Kevin_Stewart
Icon for Employee rankEmployee
Oct 04, 2013

In the first example, the robots.txt content is included in the iRule and includes ALL robots.