http://blog.webhosting.uk.com/web-hosting/bad-bot-are-nasty-spiders/ Web hosting UK blog is full of valuable information regarding web hosting, web development, marketing and SEO. Fri, 23 Jul 2010 16:17:18 +0000 http://wordpress.org/?v=2.9.2 hourly 1 http://blog.webhosting.uk.com/web-hosting/bad-bot-are-nasty-spiders/comment-page-1/#comment-105125 chris Wed, 07 Nov 2007 11:45:24 +0000 http://blog.webhosting.uk.com/web-hosting/bad-bot-are-nasty-spiders/#comment-105125 Yeah Paul thanks for the reply but what I'm trying to ask here is how are the good bots and the bad bots distinguishable by keeping a close watch? How can one make out that difference as I'm sure they don't visit the site along with a tag. Yeah Paul thanks for the reply but what I’m trying to ask here is how are the good bots and the bad bots distinguishable by keeping a close watch? How can one make out that difference as I’m sure they don’t visit the site along with a tag.

]]> http://blog.webhosting.uk.com/web-hosting/bad-bot-are-nasty-spiders/comment-page-1/#comment-105037 Paul Tue, 06 Nov 2007 14:09:56 +0000 http://blog.webhosting.uk.com/web-hosting/bad-bot-are-nasty-spiders/#comment-105037 Chris, generally the intruders bots ignore robot.txt and revisit the website more often and follow links through cgi scripts, if you can keep close watch you can distinguish it which is bad and which are good. Chris, generally the intruders bots ignore robot.txt and revisit the website more often and follow links through cgi scripts, if you can keep close watch you can distinguish it which is bad and which are good.

]]> http://blog.webhosting.uk.com/web-hosting/bad-bot-are-nasty-spiders/comment-page-1/#comment-105022 chris Tue, 06 Nov 2007 12:01:07 +0000 http://blog.webhosting.uk.com/web-hosting/bad-bot-are-nasty-spiders/#comment-105022 All good about that article and for the information on bad bots as well but the most important thing of how does one make out that which bots are good and which are the intruders is the big question here. Any solution on this? All good about that article and for the information on bad bots as well but the most important thing of how does one make out that which bots are good and which are the intruders is the big question here. Any solution on this?

]]>