Google Can Detect Duplicate Content Before Crawling It Google Can Detect Duplicate Content Before Crawling It
Google’s John Mueller revealed in a Webmaster Central hangout this week that Googlebot is capable of recognizing duplicate content before it has been crawled.
A question was submitted by a site owner wondering if and when Google would consider a French version of a page to be a duplicate of the English version.
Can Google determine when multiple pages have the same content in different languages? If so, how is that handled in search results?
In Mueller’s response he revealed that Google can detect when pages share the same content, without necessarily having to crawl the pages’ content. This is something worth being aware of, especially when it comes…