Forum Discussion
JamesS_40157
Dec 16, 2011Nimbostratus
Thanks for the response Mike.
My concerns are that they would be blocked by the "web scraping" portion of the ASM. I understand the web scraping logic sends javascript and cookie requests, looking to see if the client is moving the mouse, pressing the keyboard etc etc. I would have thought that even good bots would not be able to respond correctly to these queries? And even if they can, i'd imagine it would only be the big players (google, yahoo, bing etc) that would bother implementing such a thing. Smaller engines may not do this...?