How to fetch your Website as Google

Wanted to know how Google and search engine would crawl through your website and how it will fetch data? Usually we develop a website or web developers do that for you and it looks good for human eyes, but will this website be crawled by GoogleBot or BingBot or any other Search Spider Robots is the question.

Also check: How important is Sitemap for a website

Once your website is crawled it will be indexed, but if you see that your website or your posts are not indexed for few days then it's high time you perform this simple test just to know what is wrong. Note that as soon as you write a new post and publish it and even if you submit it for indexing, it will take some time for Google or Bing or any search engine to index your page. So, it's better to wait for 24 to 48 hours and then check again if your post is indexed or not.

Also check: How to find broken links in your website

There is a way to do fetch as Google or Bing and then Submit it for indexing if you have any issues. You generally don't have to do anything as Google will automatically do that for you as soon as you publish a new post, but if there is any crawl error that you see in Google Webmasters or if you have changed your URL permanent link then it's better to fix that and get your post indexed again.

Also check: How to remove URL from Search Engine results

Follow the below steps to your post as Google:

• Before you start you need to have a Google Webmaster account created and your site registered in Webmaster.


• Login to Google Webmaster Tools.


• Go to Health and click on 'Fetch as Google'.


• If you have already registered then your domain name will appear. Fill the entire URL and click on 'fetch'.


• You will find one of the 3 under status - Success, Failed, Not Found.

Success - is when Google can find your url. Once your url is crawled successfully, you have an option to submit to Google to index this url. Click on Submit to index, Google will take some time to index.

Failed - is when Google cannot find or connect to your URL. Google will refresh your page multiple times and finally give this status.

Not Found - is when the url is not found anymore. I got this message when I changed the permanent link of url.

Also check: How to handle reappearing of fixed crawl errors

[caption id="attachment_519" align="aligncenter" width="643"] Image: Google Analytics[/caption]

Example: I had a permanent link as "http://howtotechguru.com/Apps/perform-website-resolution-test/467"

and I changed/updated this permanent link by removing the category part - Apps (as shown below) to

http://howtotechguru.com/perform-website-resolution-test/467.

You can do the same in Bing, follow the below steps:

• Before you start you need to have a Bing Webmaster account created and your site registered in Webmaster.


• Login to Bing Webmaster Tools.


• Go to Diagnostics & Tools and click on 'Fetch as Bing'.


• Fill the entire URL and click on 'fetch' as shown.

[caption id="attachment_520" align="aligncenter" width="676"] Image: Bing Webmasters[/caption]

If you like this post then don’t forget to share it with your friends and follow us on Social Media or subscribe to our blog via email and be the first to get latest updates.