I am a deep Googlebot. My job is to discovery new and updated pages on the net. I travel the web through links. But, I am too old to go through what you young whippersnappers put me through. Having your sessions and starting arguments… And your Java graffiti is hideous. I can’t even look at it!
Allow me to crawl your site without session ids and trackback arguments. Tracking users with such techniques creates access barriers making it difficult for me to go to your web page. These links make it hard for me to differentiate between your urls. Therefore, I will think all your pages are duplicates and eliminate them from my index.
Even though you new age web designers are moving too fast for me, I’m still hip enough to know how to text. So, send me a robot. text file to prevent me from crawling pages that don’t add value to my users and that you don’t want me to see. And make sure your text messages are up to date.
You can always use the robot.txt analysis tool in the Google Webmasters tools to see how your robot text file is functioning.
Last but not least; make sure your web server supports the IF-MODIFIED-SINCE-HTTP Header. This will let me know if anything has been changed since the last time I been to your site. So save me some time.
Webmasters, please help me out by reading the Webmaster Guidelines by Google. You can find it by “Googling” “webmaster guidelines”. We’re number 1 or you can find the link at Jameseo.com.
Stay tuned for my cousin, he will let you SEO’s and webmasters know how not to get grey barred, grey bar…
This video is by link building expert, James Harrison.