← Insights
How AI engines work

How AI engines choose which brands to name

No AI engine publishes a ranking formula. But the research and the vendors’ own documentation say enough to know what helps, what does not, and which settings can take you out of the answers entirely.

·7 min read·By the ZivRank team

Two inputs: what the model learned, and what it retrieves

An AI answer draws on the model’s training data and, for AI search engines, on pages retrieved live for the question. Your brand has to be present in both.

Training data shapes which brands a model “knows” and how it describes them. Live retrieval decides which pages it reads for a specific question and, in AI search products, which ones it cites. ChatGPT search, Perplexity, Gemini and Google AI Overviews all retrieve pages at answer time. Google describes a “query fan-out” technique, “issuing multiple related searches across subtopics and data sources”, to find supporting pages [5].

What the original GEO research measured

Making a page more quotable and better sourced raised its visibility in generated answers. Classic keyword tactics did not.

The term “Generative Engine Optimization” comes from a 2023 paper by a team including Princeton University researchers, published at KDD 2024 [1]. They tested content changes on a benchmark of 10,000 queries and report that GEO methods “can boost visibility by up to 40%” in generative engine responses.

  • What worked best: adding quotations, adding statistics, and citing sources. The best methods improved on the baseline by 41% and 28% on the paper’s two visibility measures.
  • What did not: “simple methods like Keyword Stuffing traditionally used in SEO don’t perform well.”
  • Who gained most: lower-ranked pages. Citing sources raised visibility by 115.1% for pages ranked fifth in search results, while it lowered visibility for pages already ranked first.

Two caveats: the gains are maximums measured on a research benchmark, not average results in production, and the engines have changed since. The direction holds: precise, quotable, well-sourced content is easier to reuse.

Being talked about matters more than being linked

Brands that are mentioned widely across the web are more visible in AI Overviews than brands that only have many backlinks.

Ahrefs studied tens of thousands of brands and found that branded web mentions had the strongest correlation with brand visibility in AI Overviews (0.664), well ahead of backlinks (0.218) [2]. Ahrefs itself points out that correlation is not causation. For a B2B brand, the practical reading is that third-party descriptions of what you do (reviews, comparisons, industry articles, partner pages) count, not only your own site.

The crawler settings that can remove you from answers

Each engine uses separate crawlers for training and for search. Blocking the wrong one takes you out of the answers.

CrawlerWhat it doesIf you block it
OAI-SearchBot (OpenAI)Surfaces websites in ChatGPT search“Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers”, though they can still appear as navigational links [3]
GPTBot (OpenAI)Collects content for model trainingContent is not used for training; search is unaffected [3]
Google-ExtendedControls use for Gemini training and grounding“Does not impact a site’s inclusion in Google Search” [4]
Googlebot + snippet rulesSearch, including AI Overviews and AI Modenoindex or nosnippet also limit AI features [5]
PerplexityBotSurfaces and links sites in Perplexity resultsNot used for training, per Perplexity [6]

User-triggered fetchers (ChatGPT-User, Perplexity-User) act on behalf of a person and, according to both vendors, may not follow robots.txt [3][6].

What this means for a B2B brand

  • Check your robots.txt and CDN rules for the search crawlers before anything else. It is the cheapest fix there is.
  • Write answer-first. Put the direct answer at the top of each section, with the figure and its source.
  • State facts precisely and consistently (what you sell, for whom, integrations, compliance) on your site and on the third-party sources that describe you.
  • Earn mentions, not only links: comparisons, reviews, partner listings and industry articles that name you.
  • Measure before and after, with the same questions and enough runs to see past the noise.

Our AI technical audit covers the first point; the measurement protocol covers the last.

Frequently asked questions

How do AI engines decide which brands to recommend?
They combine what the model learned during training with pages retrieved live for the question. Brands that are described consistently on several credible sources, and whose pages can be crawled and quoted, are easier for them to name.
Does blocking GPTBot remove my site from ChatGPT?
No. According to OpenAI, GPTBot only governs use for model training. Appearing in ChatGPT search answers depends on OAI-SearchBot: sites that block it are not shown in ChatGPT search answers.
Does blocking Google-Extended remove me from AI Overviews?
No. Google states that Google-Extended does not affect inclusion in Google Search. AI Overviews and AI Mode are controlled by the usual Search directives such as noindex and snippet controls.
Does keyword stuffing work for AI engines?
The original GEO research found it did not: keyword stuffing offered little to no improvement and scored below the unmodified baseline on the paper’s main visibility measure.

Sources

Every figure in this article comes from the sources below, checked on October 11, 2026. Bracketed numbers in the text refer to this list.

  1. [1] Aggarwal, Murahari, Rajpurohit, Kalyan, Narasimhan, Deshpande (arXiv; KDD ’24), GEO: Generative Engine Optimization, v1 November 16, 2023, v3 June 28, 2024.
  2. [2] Ahrefs (Louise Linehan), An Analysis of AI Overview Brand Visibility Factors (75K Brands Studied), May 26, 2025, updated April 27, 2026.
  3. [3] OpenAI, Overview of OpenAI Crawlers, undated, checked October 11, 2026.
  4. [4] Google Search Central, Google’s common crawlers, undated, checked October 11, 2026.
  5. [5] Google Search Central, AI features and your website, last updated December 10, 2025.
  6. [6] Perplexity, Perplexity Crawlers, undated, checked October 11, 2026.