Skip links
googlebot ip address

Googlebot and Bingbot crawler IP Addresses Given By Google and Microsoft

Table of Contents

One of the biggest problems a website can get is when it is attacked by bots. These bot attacks can slow down the website for other website users.

Bots can be designed for various purposes. Each bot can be assigned a task to be carried upon. These tasks can include scraping, indexing, tracking, etc.

Learn more about bots and crawlers in our terminology post here: Common SEO Terms For Beginners In Digital Marketing

These bots can be designed to also harm websites. To find security loopholes on your website and try to gain important information from it.

This is the reason many WordPress security plugins and malware scanners have IP lists inside them to blacklist or whitelist a set of IP addresses. So that the right bots are allowed on the website. And bots that have negative intentions for your website are blocked.

But how would you know which is the right bot or faking it?

When itself gives you the list of IP addresses its bot's use it will be easier for programmers and companies to secure themselves from other bots that try to hack WordPress websites.

List From Google

Google has recently disclosed its addresses list here: https://developers.google.com/search/apis/ipranges/googlebot.json

This is to be sure that your website is scanned by a real Googlebot and not a fake one.

The list provided by Google includes IP addresses of all kinds of robots of Google from different surfaces of Google like Google Shopping, Google Maps, Google Adwords, etc.

ALSO READ  How to fix "The Repository 'http://apt.***.com/focal focal Release' does not have a Release file."

To differentiate a real Googlebot from a fake Googlebot, one of the ways is by doing a reverse DNS method on the IP address of the bot.

When you do reverse DNS on an IP address and it matches with any of the IP addresses from the list given by Google itself in JSON format, then you are safe. But if it does not match, you can go ahead and ban that bot IP address.

Most of the WordPress plugins already use this list coded inside their programs.

Bingbot IP Addresses List From Microsoft

Following the footsteps of Google, Microsoft also recently released a similar list of Bingbot's IP addresses. So that you just not unblock the Googlebots but also Bingbots.

The Bingbots IP addresses have also been made online in JSON format here: https://www.bing.com/toolbox/bingbot.json

All these Bingbot IP addresses are in IPV4 format. I guess Bingbots are still to be upgraded to get IPV6 addresses for themselves.

This list of Googlebot spiders and Bingbot robots IP addresses should always stay unblocked for your website. So that these crawlers can crawl your website and index them in their search engines.

Server administrators use a lot of Firewall rules to protect websites hosted on their servers.

One of the firewall rules is to blacklist or whitelist IP addresses in the server itself. This way even if a script or plugin in the misses tracking the IP address of the bots, the server OS will not allow it to get any files hosted on it following the firewall rules created by the server administrators.

ALSO READ  HTTP 5xx Errors And Their Effects To SEO Of Your Website

When you have a list like this given by the official sources of Google and Microsoft itself. The task to protect your websites from malicious spiders, bots, and crawlers becomes easy.

Final Words

A good website is easily accessible to everyone. That includes search engine bots like Googlebot and Bingbot too.

When your website is easily accessible, it will be indexed on the search engines and then ranked based on the SEO of the website.

But if you block the wrong IP addresses to your website, it might lead to de-indexing of the website and drop too. So to prevent you not to doing that the Google and Microsoft have released their robots IP addresses that you can safely approve to crawl your website.

Keep your website safe and secure by using the right WordPress plugins and whitelisting the right Googlebot and Bingbot IP addresses.

Share This Article:
Facebook
Twitter
LinkedIn
Pinterest
WhatsApp
Email
Reddit
Related Articles:
Google Analytics
Adding A New Website To Google Analytics

Google Analytics can be applied to a new website in two ways. The first is to create a brand new Google Analytics account, and the second is to add a new property to an existing account. If you’re like me and add websites to Google Analytics on a regular basis,

Read More »
ultimate-guide-link-building
Backlinks
Ultimate Guide To Link Building for SEO

The term “Backlinking”, “Link Building” and many other similar words have been around for a while now in the digital marketing world, however, its popularity seems to be growing every day as more people begin using it to promote their business or blog. It really doesn’t matter what niche you’re

Read More »
Subscribe to our newsletter
[newsletter_signup_form id=1]
Chat With Our SEO community members On discord

Leave a Reply to Kiesha Cancel reply

This site uses User Verification plugin to reduce spam. See how your comment data is processed.

This site uses Akismet to reduce spam. Learn how your comment data is processed.

  1. Thanks for the Google bots IP addresses. I had always had issues with the right IP addresses. With the official Google information, things get much easier.

  2. Easiest resource to find Googlebot and Bingebot IP addresses. Hope they keep this list updated and in the same place for a while. Else I need to change its address in my script every time they change its URL.

Explore
Drag