The ultimate trap for a googlebot

Written by European network dynamics principal author

Google and other search engines bots are an extremely difficult to trap and catch specie. They continuously crawl around websites and it would be of extreme interest to catch one inside a website for studying purposes only.
The authors of this study propose a high technology method based on a quantic trap for catching and some digital tele-bait for attracting these bots.

Introduction

According to previous studies concerning the indexing speed of googlebots and the fact that these entities did also scans on the textual contents of published articles , not only on <a href='URL'> tags, the authors of this study have chosen the use of a digital tele-bait for attracting the bot and a quantic trap for the catching,

Materials and methods

The Digital tele-bait :

Digital tele-bait stands for bait placed distantly. According to previous study, a highly optimized for SEO forum is regularly scanned bu all kinds of bots, especially googlebot. We have placed inside webrankinfo forum a textual reference to a nonexisting article inside European Network Dynamics, a non existing article with an attractive title... -http://www.netdynamics.eu/analytics/catching-a-googlebot.html this URL was written strictly in text, with no <A href='URL> html tags. This article was forum posted at 08:56 Western European time.

The Quantic trap :

The reference to the non existing article mentionned above stands for the quantic trap, if empty, therefore the bot could not escape from it, therefore immediately turning it into a type 404 error.

Results

The googlebot finally felt inside the trap at 10:22:23, central european time, see log evidence below, its approach lasted around 1:26 h , quite prudently, but a bit blind, the bot did not search for evidence of existance of the article or not before examining the trap area, be catched and transformed into a type 404 error.
		crawl-66-249-65-231.googlebot.com www.netdynamics.eu - [16/Dec/2007:10:22:43 +0100] 
	"GET /analytics/catching-a-googlebot.html HTTP/1.1" 404 4304 "-" "Mediapartners-Google"
	

Note.

The authors of this study wish to thank Webrankinfo.com for their collaboration.
The trapped Googlebot had been liquid nitrogen frozen for future studies.
It will not be freed again, even if begged for.

Note also that some rescue operation for the first trapped googlebot had been organized by a second one very shortly after this article had been submitted : see below

crawl-66-249-65-231.googlebot.com www.netdynamics.eu - [16/Dec/2007:21:50:42 +0100] 
"GET /analytics/the-ultimate-trap-for-a-googlebot-2.html HTTP/1.1" 200 9113 "-" "Mediapartners-Google"

Next >

[ Back ]