Knowing how Google sees your web site can help you to better optimize your web pages for higher Google ranking results. So what happens each time Google visits your website?
Googlebot: is the name given to Google’s web crawling user agent (also known as web spiders that access your website)
Google Crawl Process Simplified
- Googlebot sends an HTTP request to fetch a URL (by the laws governing the internet copyright issues Googlebot must first request robots.txt file) to see what it can crawl and what it is not allowed to crawl.
- Once it knows what it can crawl, then it sends another HTTP request. This time it will fetch the URL and send the contents to its storeserver. Each time there is a new URL found, Google will associate that URL with a new associated ID number called a docID
- Each crawl process is timestamped for more efficient crawling process and also to save on resources due to vastness of internet
- Google then will parse the web document contents and every word is converted into a wordID. Basically, at this stage your webpage has a document id, and every word has a word id with timestamp attached to the process of crawling (accessing) your website
Links are treated with due respect because without Hyperlinks, Google wouldn’t exists, neither would the World Wide Web “The Internet”.
How Does Google See Each Website
Press CTRL+U on your keyboard (using Chrome) (for Internet Explorer press right click “view source”) to see the HTML source code that makes up this web page. That’s what Google understands Hypertext Markup Language (HTML). That means: what we see in the design view of a web page doesn’t really mean much to search engines.
Although Google actually is extremely advanced and has algorithms for determining the quality of websites and encourages website owners to optimize it so that Google can better understand your content.
However, you can download a text based browser as this will be the next best thing as far as How Google Sees your site. Below are sample screenshots of Lynx Browser. First image shows the default Google’s Search Home Page
Images below shows a sample website home page as rendered in text based browser. Notice how that website’s home page would look different if you were to visit the home page. Meaning, what people see and what Google sees are two completely different views.
Google is advanced not because its searched the most, nor is it popular because it can bring relevant information for search terms searched. But rather, it has the ability to analyze the quality of web sites from a viewpoint of a real person by using complex algorithms.
Google Sees All
For example: some rather not so intelligent webmasters use CSS to hide keyword stuffed text thinking that it will help his or her web site to rank higher in Google.
That is why Google algorithms always evolve to provide quality and more relevant search results.
Video Lesson That Explains Important Parts of an HTML Document (part of Complete SEO Training Course)
Now that you’ve gained new knowledge about how search engines crawl and interpret web pages, now is a good time to learn how to rank in Google through latest how to blog posts by RankYa