HUGE Google Search document leak reveals inner workings of ranking algorithm (2024)

A trove of leaked Google documents has given us an unprecedented look inside Google Search and revealed some of the most important elements Google uses to rank content.

What happened. Thousands of documents, which appear to come from Google’s internal Content API Warehouse, were released March 13 on Github by an automated bot called yoshi-code-bot. These documents were shared with Rand Fishkin, SparkToro co-founder, earlier this month.

  • Read on to discover what we’ve learned from Fishkin, as well as Michael King, iPullRank CEO, who also reviewed and analyzed the documents (and plans to provide further analysis for Search Engine Land soon).

Why we care. We have been given a glimpse into how Google’s ranking algorithm may work, which is invaluable for SEOs who can understand what it all means. In 2023, we got an unprecedented look at Yandex Search ranking factors via a leak, which was one of the biggest stories of that year.

This Google document leak? It will likely be one of the biggest stories in the history of SEO and Google Search.

What’s inside. Here’s what we know about the internal documents, thanks to Fishkin and King:

  • Current: The documentation indicates this information is accurate as of March.
  • Ranking features: 2,596 modules are represented in the API documentation with 14,014 attributes.
  • Weighting: The documents did not specify how any of the ranking features are weighted –just that they exist.
  • Twiddlers: These are re-ranking functions that “can adjust the information retrieval score of a document or change the ranking of a document,” according to King.
  • Demotions: Content can be demoted for a variety of reasons, such as:
    • A link doesn’t match the target site.
    • SERP signals indicate user dissatisfaction.
    • Product reviews.
    • Location.
    • Exact match domains.
    • p*rn
  • Change history: Google apparently keeps a copy of every version of every page it has ever indexed. Meaning, Google can “remember” every change ever made to a page. However, Google only uses the last 20 changes of a URL when analyzing links.

Links matter. Shocking, I know. Link diversity and relevance remain key, the documents show. And PageRank is still very much alive within Google’s ranking features. PageRank for a website’s homepage is considered for every document.

  • This doesn’t prove Google spokespeople have lied about links not being a “top 3 ranking factor” or links mattering less for ranking. Two things can be true at once. Again, we don’t know how any of these features are weighted.

Successful clicks matter. This should not be a shocker, but if you want to rank well, you need to keep creating great content and user experiences, based on the documents. Google uses a variety of measurements, includingbadClicks, goodClicks, lastLongestClicks and unsquashedClicks.

Also, longer documents may get truncated, while shorter content gets a score (from 0-512) based on originality. Scores are also given to Your Money Your Life content, like health and news.

What does it all mean? According to King:

  • “[Y]ou need to drive moresuccessfulclicks using a broader set of queries and earn more link diversity if you want to continue to rank. Conceptually, it makes sense because a very strong piece of content will do that. A focus on driving more qualified traffic to a better user experience will send signals to Google that your page deserves to rank.”

Documents and testimony from the U.S. vs. Google antitrust trial confirmed that Google uses clicks in ranking – especially with its Navboost system, “one of the important signals” Google uses for ranking. See more from our coverage:

  • 7 must-see Google Search ranking documents in antitrust trial exhibits
  • How Google Search and ranking works, according to Google’s Pandu Nayak

Brand matters. Fishkin’s big takeaway? Brand matters more than anything else:

  • “If there was one universal piece of advice I had for marketers seeking to broadly improve their organic search rankings and traffic, it would be: ‘Build a notable, popular, well-recognized brand in your space, outside of Google search.'”

Entities matter. Authorship lives. Google stores author information associated with content and tries to determine whether an entity is the author of the document.

SiteAuthority: Google uses something called “siteAuthority”.

  • Google told us something like this existed in 2011, after the Panda update launched, stating publicly that “low qualitycontenton part of a site can impact a site’s ranking as a whole.”
  • However, Google has denied having a website authority score in the years since then.

Chrome data. A module called ChromeInTotal indicates that Google uses data from its Chrome browser for ranking.

Whitelists. A couple of modules indicate Google whitelist certain domains related to elections and COVID – isElectionAuthority and isCovidLocalAuthority. Though we’ve long known Google (and Bing) have “exception lists” when “specific algorithms inadvertently impact websites.”

Small sites. Another feature is smallPersonalSite – for a small personal site or blog. King speculated that Google could boost or demote such sites via a Twiddler. However, that remains an open question. Again, we don’t know for certain how much these features are weighted.

Other interesting findings. According to Google’s internal documents:

  • Freshness matters – Google looks at dates in the byline (bylineDate), URL (syntacticDate) and on-page content (semanticDate).
  • To determine whether a document is or isn’t a core topic of the website, Google vectorizes pages and sites, then compares the page embeddings (siteRadius) to the site embeddings (siteFocusScore).
  • Google stores domain registration information (RegistrationInfo).
  • Page titles still matter. Google has a feature called titlematchScore that is believed to measure how well a page title matches a query.
  • Google measures the average weighted font size of terms in documents (avgTermWeight) and anchor text.

The articles.

Update, May 29. Google provided a statement to Search Engine Land. Read our follow-up: Google responds to leak: Documentation lacks context.

Update, May 30. King has written a follow-up article for Search Engine Land:

  • How SEO moves forward with the Google Content Warehouse API leak
  • Join Mike King and I at SMX Advanced for a late-breaking session exploring the leak and its implications.Learn more here.

Dig deeper. Unpacking Google’s massive search documentation leak

Quick clarification. There is some dispute as to whether these documents were “leaked” or “discovered.” I’ve been told it’s likely the internal documents were accidentally included in a code review and pushed live from Google’s internal code base, where they were then discovered.

The source. Erfan Azimi, CEO and director of SEO for digital marketing agency EA Eagle Digital, posted a video, claiming responsibility for sharing the documents with Fishkin. Azimi is not employed by Google.

Dixon Jones, CEO of Inlinks, made the 14,000 Google Search variables searchable. Jones said this tool will tell you what things Google stores and what they are used for.

HUGE Google Search document leak reveals inner workings of ranking algorithm (2024)

FAQs

HUGE Google Search document leak reveals inner workings of ranking algorithm? ›

Massive Google document leak reveals secrets of search ranking algorithms. Internal Google documents leaked on GitHub reveal secret search engine algorithms, contradicting Google's statements. The 2,500-page 'Google API Content Warehouse' document provides SEO insights shared by Rand Fishkin and analysed by experts.

What is the Google ranking algorithm? ›

PageRank (PR) is an algorithm used by Google Search to rank web pages in their search engine results. It is named after both the term "web page" and co-founder Larry Page. PageRank is a way of measuring the importance of website pages.

What are the 3 key ranking factors that Google uses in their algorithm? ›

Learn more below about the key factors that help determine which results are returned for your query:
  • Meaning.
  • Relevance.
  • Quality.
  • Usability.
  • Context.

How does Google determine the ranking of content? ›

Beyond looking at keywords, our systems also analyze if content is relevant to a query in other ways. We also use aggregated and anonymized interaction data to assess whether search results are relevant to queries. We transform that data into signals that help our machine-learned systems better estimate relevance.

How does Google determine PageRank? ›

PageRank (PR) is a Google algorithm that ranks web pages in search results by evaluating the number and quality of links to a page. It operates on the principle that pages receiving more high-quality links are deemed more important and are thus ranked higher.

What is Google's latest algorithm? ›

On September 14, 2023, Google initiated the rollout of its latest algorithm update, dubbed the “September 2023 Helpful Content Update.” This update introduces an “improved classifier” and is expected to take approximately two weeks to fully implement.

What is the Google algorithm update 2024? ›

The March 2024 Core Update Is Complete. Google recently announced that the March 2024 core update was completed on April 19, but did not actually announce its completion until a week later on April 26. In total, the update took 45 days to complete and caused tremendous volatility across the open web during its rollout.

What is No 1 most important Google ranking factor? ›

Quality Content: The most important SEO factor. Google wants to show users high-quality, informative, and relevant content. Backlinks: Links from other websites to your website. They act like votes of confidence.

What relies on manipulating Google's algorithm to improve ranking? ›

Black SEO relies on manipulating Google's algorithm to improve rankings.

What was the original search algorithm for Google? ›

When Google launched in 1998, it used an algorithm called PageRank. Google founders Larry Page and Sergey Brin created this software. According to Google, PageRank operated "by counting the number and quality of links to a page to determine a rough estimate of how important the website is.

What improves Google ranking? ›

How to Improve Your Google Search Ranking in 10 Steps
  • Improve your website's user experience. ...
  • Write great content optimized for SEO. ...
  • Get more backlinks. ...
  • Improve your page speed. ...
  • Fix broken links. ...
  • Optimize your images. ...
  • Use H1 and H2 header tags. ...
  • Optimize for local search.
Aug 5, 2022

How does Google rank local search results? ›

How Google determines local ranking. Local results are based primarily on relevance, distance, and prominence. A combination of these factors helps us find the best match for your search.

What is the math behind PageRank algorithm? ›

A PageRank results from a mathematical algorithm based on the so called webgraph, created by all World Wide Web pages as nodes and hyperlinks as edges. The rank value indicates an importance of a particular page. A hyperlink to a page counts as a vote of support.

Does Google still use RankBrain? ›

Google RankBrain is definitely still relevant in 2024. In fact, it's arguably more important than ever for anyone concerned with SEO and online visibility. In today's guide, you're going to learn everything you need to know about Google's RankBrain algorithm.

How do you check if a website is ranking on Google? ›

  1. Keyword Rank Checker: For checking rankings for one keyword.
  2. Google Search Console: For checking the keywords your website ranks for (up to 1,000)
  3. Ahrefs Webmaster Tools: For checking rankings all the keywords you rank for.
  4. Ahrefs' Rank Tracker: For tracking rankings for important keywords.
  5. Rank checking tips.
Apr 15, 2024

What is the Google Scholar ranking algorithm? ›

How are documents ranked? Google Scholar aims to rank documents the way researchers do, weighing the full text of each document, where it was published, who it was written by, as well as how often and how recently it has been cited in other scholarly literature.

What is Google rank predictor? ›

Google Page Rank Prediction

This tool attempts to determine a future Google PageRank value of a particular site. In other words, we try to determine the PageRank value of the URL you enter below, as it would be after the next Google PageRank update. The tools does several calculations to come to this figure.

How do you rank #1 on Google? ›

How to Rank Higher on Google in 5 Steps
  1. Step one: Do your (keyword) research. ...
  2. Step two: Build a solid site structure. ...
  3. Step three: Create valuable content. ...
  4. Step four: Create a link network. ...
  5. Step five: Conduct A/B testing. ...
  6. Step six: Improve page load speed. ...
  7. Step seven: Optimize your website for mobile devices.
Jun 16, 2023

Top Articles
Latest Posts
Article information

Author: Fredrick Kertzmann

Last Updated:

Views: 5277

Rating: 4.6 / 5 (66 voted)

Reviews: 89% of readers found this page helpful

Author information

Name: Fredrick Kertzmann

Birthday: 2000-04-29

Address: Apt. 203 613 Huels Gateway, Ralphtown, LA 40204

Phone: +2135150832870

Job: Regional Design Producer

Hobby: Nordic skating, Lacemaking, Mountain biking, Rowing, Gardening, Water sports, role-playing games

Introduction: My name is Fredrick Kertzmann, I am a gleaming, encouraging, inexpensive, thankful, tender, quaint, precious person who loves writing and wants to share my knowledge and understanding with you.