The Waraas.Com Logo - Click To Go To The Waraas.Com Homepage

Experiment: Googlebot Tracker 4200

Thumbnail image for Experiment: Googlebot Tracker 4200

Below you will see all of the Googlebot (Google web crawler) visits to my entire website (Waraas.Com). I built this tool out of boredom, and because I want to see the crawler data.

G o o g l e b o t

A Googlebot is the web crawling bot (sometimes also called a "spider") used by Google. It's a crucial part of Google's indexing algorithm, helping to discover new and updated URL's to be added to the Google search engine.

This tool tracks ALL of the website visits, including the bad URLs (404s), sitemaps, feeds, images, etc. The data will be open and free to the public.

Overtime, I will compile the data and share the results so we can all better understand how the Googlebot's work.

Updates:

4/10/24 - Because of some fake Googlebot traffic. I have updated the Googlebot Tracker to track the hostname and if the bot is on a public or private IP address. Because of those two changes, I have updated the Googlebot Tracker version from 4000 to 4200. The tracker is now called The Googlebot Tracker 4200 :)

Googlebot Sessions On Waraas.Com:

Refresh (F5) this page to see any new data.

Visit Time: April 12th, 2024
Page URL: https://waraas.com/terms
Referrer URL: No URL
Hostname: crawl-66-249-70-2.googlebot.com
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.2
HTTP Status: 200
Robots.txt Access: No
Visit Time: April 11th, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: crawl-66-249-70-2.googlebot.com
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.2
HTTP Status: 200
Robots.txt Access: No
Visit Time: April 9th, 2024
Page URL: https://waraas.com/
Referrer URL: https://www.bluehatseo.com/
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 125.123.143.123
HTTP Status: 200
Robots.txt Access: No
Visit Time: April 5th, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.4
HTTP Status: 200
Robots.txt Access: No
Visit Time: April 5th, 2024
Page URL: https://waraas.com/
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.3
HTTP Status: 200
Robots.txt Access: No
Visit Time: April 2nd, 2024
Page URL: https://waraas.com/privacy-policy/
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.4
HTTP Status: 200
Robots.txt Access: No
Visit Time: April 2nd, 2024
Page URL: https://waraas.com/terms
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.4
HTTP Status: 200
Robots.txt Access: No
Visit Time: April 1st, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.2
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 31st, 2024
Page URL: https://waraas.com/wp-includes/images/smilies/icon_cool.gif
Referrer URL: No URL
Hostname: No hostname
User Agent: Googlebot-Image/1.0
IP Address: 66.249.70.3
HTTP Status: 404
Robots.txt Access: No
Visit Time: March 31st, 2024
Page URL: https://waraas.com/
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.2
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 31st, 2024
Page URL: https://waraas.com/
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.2
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 31st, 2024
Page URL: https://waraas.com/
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.4
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 30th, 2024
Page URL: https://waraas.com/
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.2
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 28th, 2024
Page URL: https://waraas.com/contact-jon
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66.249.70.2
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 27th, 2024
Page URL: https://waraas.com/privacy-policy
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 27th, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 26th, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 24th, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 24th, 2024
Page URL: https://waraas.com/wp-includes/images/smilies/icon_cool.gif
Referrer URL: No URL
Hostname: No hostname
User Agent: Googlebot-Image/1.0
IP Address: 66
HTTP Status: 404
Robots.txt Access: No
Visit Time: March 23rd, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 23rd, 2024
Page URL: https://waraas.com/blog/how-to-add-yotpo-to-wordpress-theme-files
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 23rd, 2024
Page URL: https://waraas.com/terms
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 23rd, 2024
Page URL: https://waraas.com/favicon.ico
Referrer URL: No URL
Hostname: No hostname
User Agent: Googlebot-Image/1.0
IP Address: 66
HTTP Status: 404
Robots.txt Access: No
Visit Time: March 23rd, 2024
Page URL: https://waraas.com/
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6261.94 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
Visit Time: March 22nd, 2024
Page URL: https://waraas.com/sitemap.xml
Referrer URL: No URL
Hostname: No hostname
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
IP Address: 66
HTTP Status: 200
Robots.txt Access: No
This totally free tool will ping your website to Google, Bing & others to give it a little extra boost.
(Results will be emailed after completion.)

Ever since building my first website in 2002, I've been hooked on web development. I now manage my own network of eCommerce/content websites full-time. I'm also building a cabin inside a old ghost town. This is my personal blog, where I discuss web development, SEO, eCommerce, cabin building, and other personal musings.

Recent Comments:

Brett : Very cool to get the back story and will be neat to watch the progress. Hoping eventually to so do something the similar on the west coast of Canada somewhere. Amazing that in 2006 I first found your site for it's myspace page information and how to build PHP site header/footers for resale. How times change hah. Anyways, keep up the great posts, looking forward to the updates.

Posted on: April 11, 2024

Feedburner Image