--> How Does Google Understand Webpages Today? | Experience Lab - Online business creation and development guide for bloggers and startups

How Does Google Understand Webpages Today?

Back in 1998 when Google first started, it was little more than a text-based search algorithm that matched query string with websites it kn...



How Google has evolved

Back in 1998 when Google first started, it was little more than a text-based search algorithm that matched query string with websites it knew about, and returned the best possible match based on the frequency of keywords. Webpages back then were just as simple, with normal text content and little styling. Webmasters didn't have to worry about a thing - they built textual content that showed up in search results if relevant. Now though, a lot has changed. Technologies like JavaScript and CSS have completely taken over, and website developers now need to take care of a lot more things.


How Google understands a webpage



Since websites were a collection of simple text-based webpages back in Google's infancy, Google could easily index a webpage and parse it for search queries. It only looked at the raw textual content that was returned by an HTTP response body, and didn't really interpret what a typical browser running JavaScript would see.





Now, however, the web is full of rich websites that make heavy use of JavaScript and CSS. Most of these are dynamic websites, and their content is rendered by JavaScript, not ordinarily visible to a text crawler.





In order to solve this problem, Google started executing JavaScript to understand the content on a page. Doing is for a web that is so large is a difficult task. But Google has gradually been improving how they do this, and in the past few months, their indexing system has been rendering a substantial number of webpages more like an average user's browser with JavaScript turned on. There are, however, many problems still being faced.


How can webmasters help?



Rendering so much content isn't a walk in the park, and the fact that there is so much variety in development techniques makes it even harder. So naturally, things don't always go perfectly, which may negatively impact search results for your site. Webmasters can follow these guidelines to ensure that the content on their sit is accessed easily.





Note: We discussed some of these techniques in our recent post about helping Google recognize the mobile version of a webpage. Go check it out if you have a separate mobile site, and see if you're doing everything correctly.


  • If resources like JavaScript or CSS in separate files are blocked (say, with robots.txt) Google won’t be able to see your site like an average user. It is recommended that you allow Googlebot to retrieve JavaScript and CSS so that your content can be indexed better. This is especially important for mobile websites, where external resources like CSS and JavaScript help search algorithms understand that the pages are optimized for mobile.

  • If your web server is unable to handle the volume of crawl requests for resources, it may have a negative impact on Google's capability to render your pages. If you’d like to ensure that your pages can be rendered by Google, make sure your servers are able to handle crawl requests for resources.

  • It's always a good idea to have your site degrade gracefully. This will help users enjoy your content even if their browser doesn't have compatible JavaScript implementations. It will also help visitors with JavaScript disabled or off, as well as search engines that can't execute JavaScript yet.

  • Sometimes the JavaScript may be too complex or arcane for Google to execute, in which case the page(s) can't be rendered fully and accurately.

  • Some JavaScript removes content from the page rather than adding, which prevents Google from indexing the content.



Make sure you rectify any of these problems on your site as soon as possible!





Found these tips helpful? Do remember to give us a shout-out in the comments section below. And don't forget to any tips of your own. Peace :)

COMMENTS

Name

Affiliate Marketing,12,Announcement,34,Bing,9,Bitcoin,38,blog,7,Blogger Resources,42,Blogger Templates,4,blogger tricks,156,Blogging ethics,70,Blogging tips,198,Bugs and Errors,34,Business,9,Copyright Violation,9,CSS and HTMLTricks,95,Designs,8,drop down menu,7,eBook,12,Email Marketing,7,Events,30,Facebook,30,Facebook tricks,49,Google,157,Google AdSense,42,Google Analytics,7,Google Plus,51,Google Plus Tricks,38,Guest Posts,112,home,2,How To,77,Internet,1,JSON Feeds,25,Kitchen Recipes,2,Label Based Sitemap Themes,1,Make Money Online,108,Marketing,16,MBT Blogger Templates,7,Menus,1,News,146,Pages,1,Posts,10,presentations,15,Responsive,10,Reviews,7,SEO,307,Settings,6,Shortcode,15,Sitemap Themes,1,Social Media,155,Technology,7,Templates,1,Tips,2,Tools,1,Traffic Tips,80,Video,19,Web Designing,62,web hosting,18,Webmaster Tools,97,Widgets,199,wordpress,26,
ltr
item
Experience Lab - Online business creation and development guide for bloggers and startups: How Does Google Understand Webpages Today?
How Does Google Understand Webpages Today?
https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhufb0N5ZHTMEjWrm_zNn7oFkpXI55OIWFDP5YqCoaTRCzK4W67NxoC_t1c-0FCPuXPyIXs5GOoD4pPR2TYG-R_Hzrr2qLOKhdyoL2utA8VMlDLMdOQxq4FB_uiRWJ9118iZmBegJI37jkz/s1600/google.jpg
https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhufb0N5ZHTMEjWrm_zNn7oFkpXI55OIWFDP5YqCoaTRCzK4W67NxoC_t1c-0FCPuXPyIXs5GOoD4pPR2TYG-R_Hzrr2qLOKhdyoL2utA8VMlDLMdOQxq4FB_uiRWJ9118iZmBegJI37jkz/s72-c/google.jpg
Experience Lab - Online business creation and development guide for bloggers and startups
https://www.experiencelab.info/2014/06/how-does-google-understand-webpages.html
https://www.experiencelab.info/
https://www.experiencelab.info/
https://www.experiencelab.info/2014/06/how-does-google-understand-webpages.html
true
2959477579779989044
UTF-8
Loaded All Posts Not found any posts VIEW ALL Readmore Reply Cancel reply Delete By Home PAGES POSTS View All RECOMMENDED FOR YOU LABEL ARCHIVE SEARCH ALL POSTS Not found any post match with your request Back Home Sunday Monday Tuesday Wednesday Thursday Friday Saturday Sun Mon Tue Wed Thu Fri Sat January February March April May June July August September October November December Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec just now 1 minute ago $$1$$ minutes ago 1 hour ago $$1$$ hours ago Yesterday $$1$$ days ago $$1$$ weeks ago more than 5 weeks ago Followers Follow THIS PREMIUM CONTENT IS LOCKED STEP 1: Share. STEP 2: Click the link you shared to unlock Copy All Code Select All Code All codes were copied to your clipboard Can not copy the codes / texts, please press [CTRL]+[C] (or CMD+C with Mac) to copy