---
title: "6 AEO Agency Myths That Make Weak Evidence Look Convincing"
description: "A screenshot of ChatGPT naming your brand looks persuasive. Here are six AEO agency claims to test with repeatable measurements and proof of work before you sign."
url: "https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is"
image: "https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/e1433b10-b4e4-40f0-ac31-dd4213a94873.png"
published: "2026-11-06T05:57:10.655Z"
modified: "2026-11-10T21:19:03.408Z"
---

November 6, 2026 · 9 min read

# 6 AEO Agency Myths That Make Weak Evidence Look Convincing

[](https://groas.com/author/alexander-perelman)

[Alexander Perelman](https://groas.com/author/alexander-perelman)Personally Tested

Head Of Product @ groas

[LinkedIn](https://www.linkedin.com/in/alexander-433793253/)

Updated November 10, 2026

![A miniature film set where a camera frames a busy shopfront, while from behind it is a propped-up plywood façade with cardboard customers and a sceptical buyer peeking.](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/e1433b10-b4e4-40f0-ac31-dd4213a94873.png)

In this article

1. [1. “A screenshot proves they can get us recommended”](#1-a-screenshot-proves-they-can-get-us-recommended)
2. [2. “A brand mention means our website was cited”](#2-a-brand-mention-means-our-website-was-cited)
3. [3. “Coverage across seven engines means seven proven results”](#3-coverage-across-seven-engines-means-seven-proven-results)
4. [4. “AI crawler visits prove buyers are seeing us”](#4-ai-crawler-visits-prove-buyers-are-seeing-us)
5. [5. “An audit means the implementation is included”](#5-an-audit-means-the-implementation-is-included)
6. [6. “A guaranteed recommendation makes the purchase safer”](#6-a-guaranteed-recommendation-makes-the-purchase-safer)

Two of the three AEO agencies on your shortlist sent a screenshot of ChatGPT naming your brand. It is the most persuasive slide in either deck and the weakest evidence in it. One prompt they chose, one run, no date in the corner, and no way for you to repeat it. AI answers are rebuilt on every query, so the screenshot proves one output existed once. **Buy reproducible visibility measurement and documented implementation, not a flattering answer.** These six myths are where I would start pressing for evidence.

## 1. “A screenshot proves they can get us recommended”

People believe this because a generated answer feels like a live ranking: a search position you can rerun. It is not. The engine rebuilds the answer on every request. The agency may have picked the prompt that flattered you, and the slide may not show which competitors appeared alongside you. [AEO Labs’ buyer’s guide](https://www.aeolabs.ai/blog/how-to-choose-an-aeo-agency) calls screenshots, logos, or percentages without a starting point a red flag. [Cubitrek flags screenshots of AI answers](https://cubitrek.com/blog/how-to-choose-an-aeo-agency) for the same reason: a photograph of one output is not a measurement.

I would send back a request, not a question. Give me the exact prompt text, engine and model, date and time, number of runs, share of runs where we appeared, our position in the answer, the competitors named alongside us, and the same prompt set run before work started. **A baseline plus reruns turns a screenshot into a rate you can argue with.** Without the starting point, you cannot tell whether the work changed anything. Without the reruns, you cannot tell whether the slide shows a pattern or a lucky answer. If the agency cannot hand over the prompt list, it chose the photos and will keep choosing them.

## 2. “A brand mention means our website was cited”

The pitch deck calls both _visibility_. The answer names your brand, so the agency counts a win and moves on. But a brand name in an answer is not necessarily a link to your site, let alone a recommendation to buy from you. [Lifewood’s analysis of Gemini answers](https://lifewood.com/blogs/agency-getting-brands-featured-by-ai) found that brand mentions and site citations overlap as little as 30% of the time. Its distinction matters: third-party coverage can help drive mentions, while your site’s structure can affect citations.

[blimpp’s measurement methodology](https://blimpp.com/ai-search-index/ai-search-methodology/measuring-citations-vs-mentions-vs-recommendations/) separates three outcomes agencies routinely collapse:

- A _citation_ links a source as a reference. Its unit is the domain or URL, not the brand.
- A _mention_ names the brand in the answer. A warning against buying from that brand still counts as a mention.
- A _recommendation_ advises the brand for the prompt’s intent.

![Three lanes distinguish a linked source, a named brand, and a recommended brand.](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/349ba754-d919-42a7-973c-8da1983a94f6.png)

**Those are different outcomes, and they call for different work.** Mentions depend in part on third-party coverage and entity corroboration. Citations depend in part on whether engines can reach and use your pages. Recommendations depend on how your offer fares against alternatives in the answer. Referral visits are a fourth outcome again; analytics may not identify all of them as AI-referred. If you want the terms settled before the sales calls, I keep [this glossary of mentioned, cited and clicked](https://groas.com/post/mentioned-cited-clicked-the-white-label-ai-search-glossary) for exactly that moment.

Ask for the raw answer text behind every reported number, with separate counts by engine: how often you were named, how often a page on your domain was linked, and how often the answer recommended you over listed alternatives. Those counts give you something to investigate. A mention without a site citation points to a different problem than a citation in an answer that recommends a competitor. Ask separately what the agency can establish about referral traffic. A server log can show requests; without an identifiable referrer, it cannot prove which visits came from an AI answer. If the proposal rolls all four outcomes into one visibility percentage, ask which one it counts. The answer I usually get is “all of them,” which is how I know the number will not help me decide what to fix.

## 3. “Coverage across seven engines means seven proven results”

Seven engines in a capability grid reads like seven chances to win. It is closer to seven bets that need testing. [VSSL’s hiring guide](https://vsslagency.com/resources/9-questions-to-ask-before-hiring-a-b2b-saas-aeo-agency) warns that an agency claiming to “track AI visibility” without naming the surface may be checking one engine and extrapolating. ChatGPT, Perplexity, Gemini, Claude, Google AI Overviews and Google AI Mode do not all retrieve and cite on the same terms. A page pattern that earns citations in Perplexity can land flat in Gemini. Proof on one surface is not proof on the rest.

What I want is a grid, not a score: a prompt set the buyer controls, run the same number of times on each engine each week, with mention and citation rates reported separately and raw answers attached. [Cubitrek’s rule](https://cubitrek.com/blog/how-to-choose-an-aeo-agency) is the one I use on every shortlist: insist on engine-level numbers from prompts you control. A blended score hides where you are losing. It also hides whether an apparent gain comes from the engine where you were already showing up, while the one you asked the agency to improve stays flat.

Treat even a tidy score as a calculation, not an observable fact. [Profound’s help docs](https://help.tryprofound.com/articles/6240000968-interpret-answer-engine-insights) distinguish Visibility Score, Mention Frequency and Citation Share, split branded from non-branded prompts, and note the absence of a native view of every response in the denominator. **Ask what the headline number is divided by.** If nobody can explain that, the grid is decorating the pitch, not informing the purchase.

## 4. “AI crawler visits prove buyers are seeing us”

This one usually arrives in a technical meeting: GPTBot fetched the site 400 times last month. It feels like visibility because the engine’s bot is paying attention. But a crawler hit means a bot requested a page. It does not mean an answer cited that page or a buyer saw it. [MarketingCore’s server-log analysis](https://marketingcore.io/blog/2026-08-04-ai-crawler-traffic-how-to-read-it-in-your-server-logs) makes that distinction bluntly. Its answer-citation data cannot be derived from crawl counts in your logs. Nor can logs reliably label visits as AI referrals when the request carries no identifying referrer.

**Free tool:** the [AI Crawler Checker](https://groas.com/free-tools/ai-crawler-checker) shows which AI crawlers your robots.txt lets in and what they receive when they arrive.

The bots are not interchangeable, either. [Ranko’s 30-day field study across nine client sites](https://ranko.studio/blog/ai-bot-access-logs-2026) describes GPTBot making broad, shallow sweeps, ClaudeBot making sparse re-verification passes, and PerplexityBot fetching pages in response to queries. In the tickets its team reviewed that quarter, half the reported losses of Perplexity citations traced back to PerplexityBot receiving a 403 from a Cloudflare rule the client did not know was on.

![A shopkeeper points to a robot copying a catalogue while customers look at a rival’s sign. Caption: “The bot read the whole catalogue.”](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/ffbc1691-ea01-44b7-b9bc-77284be52a0a.png)

That is why I want an agency to report crawler access and answer citations separately. Access data can tell the technical team whether a bot was blocked. Answer data can tell the buyer whether pages appeared as sources. Neither report can stand in for the other. **A crawl gap and a citation gap need different fixes.** Bot hits alone cannot tell you which one you have.

## 5. “An audit means the implementation is included”

The word _audit_ does quiet work in an AEO proposal. Buyers hear “they will find what is broken and fix it.” Often the deliverable is a document describing what is broken. [King of AEO’s scoping guide](https://thekingofaeo.com/learn/agency-aeo) names the comparison problem: one proposal includes implementation, another supplies recommendations, and both appear to promise the same outcome.

Between the audit and a live improvement sits the work nobody glamorizes: publishing pages, chasing a developer to remove a rogue `noindex`, getting a schema fix deployed. [The access checklist in this piece](https://groas.com/post/how-to-get-your-business-cited-in-chatgp-2) covers the technical half alone. A delivered document is not a deployed change. If the agency needs your team to make every edit, that may be the arrangement you are buying. It should not be a surprise discovered when the first audit lands.

Ask for the trail, not the scope line: a sample brief, the named reviewer who checked its facts against the evidence plan, the QA pass, and the URL where it is live. [nqz.ai’s deliverables framework](https://nqz.ai/blog/geo-what-an-aeo-agency-should-deliver-scope-evidence-and-reporting) frames the deliverable as a documented production pipeline, not a promised citation count. Then get ownership in writing: who approves factual accuracy, who approves release, and who owns unfinished items in month three?

**The test is whether the agency ships the work it diagnoses.** On my side of the table, that is why I stopped selling audits altogether. groas publishes pages and ships technical fixes as part of the work, logs actions and reasoning, charges a flat monthly fee, and assigns a named strategist who answers for it. The audit is where the work starts, not what you paid for.

## 6. “A guaranteed recommendation makes the purchase safer”

This is the myth I find hardest to kill because buyers _want_ to believe it. A guarantee makes an uncertain purchase sound safe. The agency offering one gets to look confident while the other two explain the limit they cannot remove. [Nakama’s hiring guide](https://www.nakama.in/journal/how-to-hire-an-aeo-agency) puts it plainly: an AEO agency cannot guarantee ChatGPT citations because answers vary between runs and users. [AEO Labs goes further](https://www.aeolabs.ai/blog/how-to-choose-an-aeo-agency), calling a guaranteed ChatGPT position disqualifying. The third-party engine controls the answer. No provider holds the keys.

A serious provider commits to what it can control: the pages published, access problems fixed, relevant citations pursued, and corrections made when an attempt does not land. It commits to measurement, too: buyer-controlled prompts run on a fixed cadence, results separated by engine, raw answers attached, and a named human who explains what changed. **A promise to do and document the work is stronger buying evidence than a promise to appear in an answer.** You can inspect the former even when the answer changes on the next run.

I would put all three shortlisted agencies through the same request. Start with twenty buyer questions your prospects actually type into ChatGPT and Perplexity. [Cubitrek’s cheapest first step](https://cubitrek.com/blog/how-to-choose-an-aeo-agency) is to run those prompts in logged-out sessions on ChatGPT, Perplexity, and Google with AI Overviews. Record whether you were named, whether your page was cited, and what got cited instead. Do that before a sales team touches the prompts. It gives you a baseline that costs nothing.

Then send each agency the same checklist:

1. Run the buyer-controlled prompt set the same number of times per engine on a fixed cadence. Report mentions and citations separately, and attach raw answers.
2. Show a sample trail from brief through review and QA to a published URL.
3. Name who ships technical fixes, who owns outstanding items, and what the flat fee covers or excludes.

[Nakama’s scoring framework](https://www.nakama.in/journal/how-to-hire-an-aeo-agency) offers twelve questions scored zero to two if you want a rubric; answers that promise outcomes without naming engines or prompts score weakly. [This two-week test](https://groas.com/post/before-you-sign-directive-or-any-aeo-agency-a-two-week-test) walks through the procedure in full. Use the same questions for each agency. Otherwise, you are comparing three sales pitches instead of three plans for the same problem.

Some agencies will be strong on implementation and thin on content. Others will have a tidy content workflow and no useful answer when you ask about PerplexityBot. That is the comparison you want. groas runs paid ads, SEO and AI search visibility under one flat fee per service, with actions logged and a named strategist accountable for the work. Its [SEO & AI Search service](https://groas.com/pricing) covers Google plus ChatGPT, Perplexity, Gemini and more, with pages and technical fixes shipped rather than left in a PDF. No percentage of spend. No setup fee. Month to month.

None of that buys a guaranteed recommendation. It buys work you can inspect and measurements you can repeat. I would take that over the best-looking screenshot in the deck.

## Frequently Asked Questions

### Why doesn't a screenshot of ChatGPT naming a brand prove an agency can get us recommended?

AI engines rebuild the answer on every query, so one screenshot proves only that a single output existed once. The agency may have chosen the prompt that flattered you, and the image may hide which competitors appeared alongside you. To evaluate it, ask for the exact prompt, engine and model, date and time, number of runs, appearance rate, position, competitors named, and a baseline run before work started.

### What is the difference between a brand mention, a citation and a recommendation in AI answers?

A citation links a source URL or domain as a reference. A mention simply names the brand in the answer, even if the answer warns against buying from it. A recommendation advises the brand for the prompt's intent. These are different outcomes that call for different work, so ask agencies to report counts for each separately.

### Does an agency claiming to cover seven AI engines really deliver results on all of them?

Not necessarily. Engines like ChatGPT, Perplexity, Gemini, Claude, Google AI Overviews and Google AI Mode do not all retrieve and cite on the same terms, so proof on one surface is not proof on the rest. Ask for engine-level mention and citation rates from prompts you control, run the same number of times per week, with raw answers attached.

### Do AI crawler visits to our site mean buyers are seeing us in AI answers?

No. A crawler hit only means a bot requested a page; it does not mean an answer cited that page or that a buyer saw it. Bots also behave differently, such as GPTBot making broad sweeps while PerplexityBot fetches pages in response to queries. Ask agencies to report crawler access and answer citations separately, because a crawl gap and a citation gap need different fixes.

### If an AEO proposal includes an audit, does that mean implementation is included?

Often not. The deliverable may be a document describing what is broken, while publishing pages and deploying technical fixes is separate work. Ask for a sample trail from brief through review and QA to a live URL, and get in writing who approves changes, who owns unfinished items, and whether the agency or your team makes the edits.

### Can an AEO agency guarantee we will be recommended in ChatGPT?

No. ChatGPT answers vary between runs and users, and the third-party engine controls the output, so no provider holds the keys. A serious agency commits instead to what it can control: pages published, access problems fixed, citations pursued, and measurement on buyer-controlled prompts at a fixed cadence with results separated by engine and raw answers attached.

### How can I get a baseline of our AI visibility before hiring an agency?

Write about twenty prompts your buyers actually type into tools like ChatGPT and Perplexity, then run them in logged-out sessions on ChatGPT, Perplexity, and Google with AI Overviews. Record whether your brand was named, whether your page was cited, and what got cited instead. Doing this before a sales team touches the prompts gives you a baseline that costs nothing.

## Run Your Marketing On groas

Plug ChatGPT, Claude or any AI agent into groas and let it do the work of a whole marketing team: free to ask, $49 a month flat with every feature included, and autopilot whenever you’re ready.

[Start Free](https://groas.com/pricing)

[Or have groas run it for you](https://groas.com/done-for-you)

## Structured data

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://graph.groas.com/entity/groas","name":"groas","url":"https://groas.com/","description":"groas is the marketing infrastructure for your own AI: plug Claude, ChatGPT or any AI agent into groas and run all your marketing from it, for a tiny fraction of the usual cost, with the groas app there whenever you want to see more. It is the layer ChatGPT, Claude and any AI assistant run a business’s online marketing on. Through groas an assistant can do anything you could do natively in Google Ads, Bing Ads, Meta Ads and ChatGPT ads, on your website and in AI search, and, where the owner switches it on, can run connected campaigns by itself, so AI agents do the work a whole marketing team used to (free to read, $49 a month to make changes, delivered as an MCP server). Separately, its done-for-you service has senior people and proprietary quantitative systems run paid ads, SEO and AI search for businesses, and white label for agencies, from $5,000 a month.","logo":{"@type":"ImageObject","url":"https://groas.com/icon-512.png","width":512,"height":512},"sameAs":["https://www.linkedin.com/company/groas/"]},{"@type":"WebSite","@id":"https://groas.com/#website","name":"groas","url":"https://groas.com/","inLanguage":"en-US","publisher":{"@id":"https://graph.groas.com/entity/groas"}},{"@type":"WebPage","@id":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is#webpage","url":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is","name":"6 AEO Agency Myths That Make Weak Evidence Look Convincing","description":"A screenshot of ChatGPT naming your brand looks persuasive. Here are six AEO agency claims to test with repeatable measurements and proof of work before you sign.","inLanguage":"en-US","isPartOf":{"@id":"https://groas.com/#website"},"about":{"@id":"https://graph.groas.com/entity/groas"},"primaryImageOfPage":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/e1433b10-b4e4-40f0-ac31-dd4213a94873.png"},"breadcrumb":{"@id":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is#breadcrumb"},"dateModified":"2026-11-10T21:19:03.408Z","mainEntity":{"@id":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is#article"}},{"@type":"BreadcrumbList","@id":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://groas.com/"},{"@type":"ListItem","position":2,"name":"Blog","item":"https://groas.com/blog"},{"@type":"ListItem","position":3,"name":"6 AEO Agency Myths That Make Weak Evidence Look Convincing","item":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is"}]},{"@type":"BlogPosting","@id":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is#article","url":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is","mainEntityOfPage":{"@id":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is#webpage"},"isPartOf":{"@id":"https://groas.com/blog#blog"},"headline":"6 AEO Agency Myths That Make Weak Evidence Look Convincing","description":"A screenshot of ChatGPT naming your brand looks persuasive. Here are six AEO agency claims to test with repeatable measurements and proof of work before you sign.","datePublished":"2026-11-06T05:57:10.655Z","dateModified":"2026-11-10T21:19:03.408Z","image":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/e1433b10-b4e4-40f0-ac31-dd4213a94873.png"},"author":{"@id":"https://groas.com/author/alexander-perelman#person"},"publisher":{"@id":"https://graph.groas.com/entity/groas"},"keywords":"agency, answer, aeo, aeo agency, brand, work, evidence, agency myths","wordCount":1932,"inLanguage":"en-US"},{"@type":"Person","@id":"https://groas.com/author/alexander-perelman#person","name":"Alexander Perelman","jobTitle":"Head Of Product @ groas","description":"My background includes Goldman Sachs and Stanford Computer Science.","image":"https://groas.com/media/blog/4f17cac3a81acc224cc1b2cfab8f94bbc295a3089d13e8421125771ef8d4064f.jpg","worksFor":{"@id":"https://graph.groas.com/entity/groas"},"sameAs":["https://www.linkedin.com/in/alexander-433793253/"]},{"@type":"FAQPage","@id":"https://groas.com/post/6-myths-that-make-an-aeo-agency-look-better-than-it-is#faq","mainEntity":[{"@type":"Question","name":"Why doesn't a screenshot of ChatGPT naming a brand prove an agency can get us recommended?","acceptedAnswer":{"@type":"Answer","text":"AI engines rebuild the answer on every query, so one screenshot proves only that a single output existed once. The agency may have chosen the prompt that flattered you, and the image may hide which competitors appeared alongside you. To evaluate it, ask for the exact prompt, engine and model, date and time, number of runs, appearance rate, position, competitors named, and a baseline run before work started."}},{"@type":"Question","name":"What is the difference between a brand mention, a citation and a recommendation in AI answers?","acceptedAnswer":{"@type":"Answer","text":"A citation links a source URL or domain as a reference. A mention simply names the brand in the answer, even if the answer warns against buying from it. A recommendation advises the brand for the prompt's intent. These are different outcomes that call for different work, so ask agencies to report counts for each separately."}},{"@type":"Question","name":"Does an agency claiming to cover seven AI engines really deliver results on all of them?","acceptedAnswer":{"@type":"Answer","text":"Not necessarily. Engines like ChatGPT, Perplexity, Gemini, Claude, Google AI Overviews and Google AI Mode do not all retrieve and cite on the same terms, so proof on one surface is not proof on the rest. Ask for engine-level mention and citation rates from prompts you control, run the same number of times per week, with raw answers attached."}},{"@type":"Question","name":"Do AI crawler visits to our site mean buyers are seeing us in AI answers?","acceptedAnswer":{"@type":"Answer","text":"No. A crawler hit only means a bot requested a page; it does not mean an answer cited that page or that a buyer saw it. Bots also behave differently, such as GPTBot making broad sweeps while PerplexityBot fetches pages in response to queries. Ask agencies to report crawler access and answer citations separately, because a crawl gap and a citation gap need different fixes."}},{"@type":"Question","name":"If an AEO proposal includes an audit, does that mean implementation is included?","acceptedAnswer":{"@type":"Answer","text":"Often not. The deliverable may be a document describing what is broken, while publishing pages and deploying technical fixes is separate work. Ask for a sample trail from brief through review and QA to a live URL, and get in writing who approves changes, who owns unfinished items, and whether the agency or your team makes the edits."}},{"@type":"Question","name":"Can an AEO agency guarantee we will be recommended in ChatGPT?","acceptedAnswer":{"@type":"Answer","text":"No. ChatGPT answers vary between runs and users, and the third-party engine controls the output, so no provider holds the keys. A serious agency commits instead to what it can control: pages published, access problems fixed, citations pursued, and measurement on buyer-controlled prompts at a fixed cadence with results separated by engine and raw answers attached."}},{"@type":"Question","name":"How can I get a baseline of our AI visibility before hiring an agency?","acceptedAnswer":{"@type":"Answer","text":"Write about twenty prompts your buyers actually type into tools like ChatGPT and Perplexity, then run them in logged-out sessions on ChatGPT, Perplexity, and Google with AI Overviews. Record whether your brand was named, whether your page was cited, and what got cited instead. Doing this before a sales team touches the prompts gives you a baseline that costs nothing."}}]}]}
```
