Now, Google has evolved, or so it seems.
— Matt Banner, OnBlastBlog.
Which Google’s Bot Does The Crawling?
— Scott Lazerson, Connector.
The DOM is an essential part of how a webpage is accessed, read, and built by a browser.
— Adam Audette
Nix All Ajax Crawling Schemes
If you’re creating a new website, steer clear of using Google’s 2009 AJAX crawling scheme. If your current website uses this now, consider making a switch.
In 2009, Google recommended using the AJAX Crawling Scheme. They have since changed their tune.
Google reportedly discontinued their support for the AJAX Crawling scheme in 2015. Although Google will still read AJAX sites, they will not support a proposal to crawl these pages.
Progressive enhancement is the preferred method of site building.
Review Your URLs
The exception to this rule is any URLs with “#!” in the URL. URLs with “#!” are still considered acceptable by Google. (See the above crawling scheme, now deprecated)
Use The Search Console Fetch And Render Tool
To see how your pages appear to Google, use the Search Console’s Fetch and Render tool. Although this tool still won’t see any URLs with “#!” or “#” in the URL, it will still give you a good glimpse into what the powerhouse search engine is seeing on your website.
Upload The Correct Sitemap
This might seem like a small tweak but it’s an important one.
When uploading your sitemap, be sure to use the right “lastmod” dates. This sends Google a signal of what’s been changed and updated on your website so their bots know where to crawl and what to render.
One Last Consideration: Google Is Only One Search Engine