---
title: "Before You Compare AI Visibility Tools, Compare Their Denominators"
description: "An AI visibility score measures a chosen test, not your whole brand. Compare prompts, engines, repetitions and scoring rules before comparing providers."
url: "https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their"
image: "https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/7d7ecfa0-a90b-4506-8307-59864db90a35.png"
published: "2026-11-15T05:19:35.912Z"
modified: "2026-11-15T05:19:35.984Z"
---

November 15, 2026 · 10 min read

# Before You Compare AI Visibility Tools, Compare Their Denominators

[](https://groas.com/author/alexander-perelman)

[Alexander Perelman](https://groas.com/author/alexander-perelman)Personally Tested

Head Of Product @ groas

[LinkedIn](https://www.linkedin.com/in/alexander-433793253/)

![Equal pours of amber liquid fill a slim vial to the brim but barely cover the floor of a wide beaker: the same result looks bigger or smaller depending on the container.](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/7d7ecfa0-a90b-4506-8307-59864db90a35.png)

In this article

1. [Start with the questions, not the percentage](#start-with-the-questions-not-the-percentage)
2. [The denominator decides what the percentage means](#the-denominator-decides-what-the-percentage-means)
3. [Define the hit before counting it](#define-the-hit-before-counting-it)
4. [Repeat the test before calling it a position](#repeat-the-test-before-calling-it-a-position)
5. [Use crawler logs to explain gaps, not claim visibility](#use-crawler-logs-to-explain-gaps-not-claim-visibility)
6. [Compare the specification, then decide who does the work](#compare-the-specification-then-decide-who-does-the-work)
7. [Read the two reports again](#read-the-two-reports-again)

Two AI visibility reports can give the same brand 78% and 35% in the same week without either provider lying. They just ran different tests.

The fact everything else follows from is simple: **an AI visibility percentage describes a measurement setup, not a universal score for your brand**. At its simplest, it is qualifying appearances divided by answer opportunities in the sample. Change the questions, engines, repetitions or definition of an appearance, and the score can change without anything changing about the brand.

Before I compare tools, I compare their denominators. Here is how I work backward from the percentage to what it actually tells me.

## Start with the questions, not the percentage

Say the business sells standing desks under the name ApexDesk. I want to know how often ChatGPT recommends it. I cannot treat generated answers like a stable list of search positions. The useful starting point is [a fixed panel run on a schedule](https://www.nativecode.ai/post/how-to-measure-ai-visibility): controlled questions, repeated over time, with appearances counted across the sample.

For the running example, I start with ten prompts aimed at the same buyer:

- **Three branded prompts**, such as “Is ApexDesk good for back pain?”
- **Three category prompts**, such as “Best standing desk for small apartment.”
- **Four purchase-intent prompts**, such as “Standing desk under $500 with free returns, which should I buy?”

That is the _prompt panel_. For one run on one engine, it produces ten answer opportunities. Everything that follows changes what 40% or 80% means without necessarily changing whether any real buyer discovers the brand.

### Separate recognition from discovery

Branded prompts nearly always mention the brand. Ask “Is ApexDesk good?” and ApexDesk is already in the question. Category and purchase-intent prompts ask the model to choose it without that hint.

That is why [blending branded prompts into overall visibility can flatter the result](https://serpent.so/blog/how-to-choose-prompts-to-track/). Suppose ApexDesk appears in all three branded answers and one of the seven unbranded answers. The combined rate is 40%, but it hides the useful distinction: 100% on branded prompts and about 14% where the buyer has not named a brand.

**Recognition and discovery belong on separate lines.** I want to know both, but I do not want one disguising the other.

### Attach the engine, market and dates

The same ten prompts asked in ChatGPT and Perplexity produce different measurements. The question format matters, too: [a short seed keyword for AI Overviews is not the same test as a full prompt for AI Mode or ChatGPT](https://serpent.so/blog/how-to-choose-prompts-to-track/).

Location and observation time also belong beside the result. “40% visibility” is incomplete. “40% across this prompt panel, on these engines, in this market, during this week” is something I can begin to interpret.

I do not file a visibility report unless its setup lists the prompt count, engines, market and dates.

## The denominator decides what the percentage means

Back to ApexDesk. Four appearances across ten answers gives me 40%. The arithmetic is simple. The meaning depends on the list.

Four appearances on purchase-intent questions describe a different result from four appearances when three questions already name the brand. The latter is mostly a receipt confirming that the model can spell ApexDesk.

This is how a score can improve without buyer discovery improving. [Adding easy or branded prompts can inflate the percentage without changing what engines say](https://www.stefka.com/blog/how-to-track-brand-visibility-ai-search/). The measurement moves because the test changes.

Expanding a panel to “cover more ground” is not automatically wrong. Mixing the expanded panel into the old trend line is the problem. If I add questions, I need to keep the original set visible so I can distinguish a change in answers from a change in the exam.

**Freeze the comparison panel, and report additions separately.** For this example, I hold the ten-prompt set for a month and keep branded and unbranded rates apart.

### Why two providers’ percentages may not be comparable

Imagine two providers testing ApexDesk:

| Measurement choice | Provider A               | Provider B                     |
| ------------------ | ------------------------ | ------------------------------ |
| Prompt panel       | 50 prompts, half branded | 20 unbranded purchase prompts  |
| Engines            | ChatGPT only             | ChatGPT, Gemini and Perplexity |
| What counts        | Any name match           | A top-three recommendation     |

Both can send a perfectly tidy percentage. Those percentages share a label, not a measurement specification.

I also need the repeat count and the way results are combined. Without those, I cannot tell whether the score describes one batch of answers or a pattern across repeated runs.

**A higher score from a softer setup is not better visibility.** A defensible comparison uses identical prompts, engines, markets, scoring rules and observation periods, with the same number of repeats. Otherwise, the exercise mostly reveals who wrote the kinder test.

## Define the hit before counting it

Even with the denominator fixed, I still need to know what goes in the numerator. A tool reports 60% visibility. What happened in those answers?

These are [three different observations](https://geocitely.com/blog/ai-mentions-vs-citations):

- A **mention** puts the brand name in the answer text.
- A **citation** shows a page as a source.
- A **recommendation** presents the brand as a choice for the buyer.

They do not always travel together. In one 30-prompt test, 11 tools were mentioned, but four never had their own sites cited. Another tool was cited once without being named.

For ApexDesk, a citation without a mention does not establish that the answer introduced the brand by name. A mention without an own-domain citation may rely on a review site or Reddit thread that also discusses competitors. A recommendation tells me something different again: the answer has put ApexDesk forward as an option.

None of these observations, by itself, proves a sale. They tell me what appeared in the answer, not what happened afterward.

**Count mentions, citations and recommendations separately.** I also split citations into links to the brand’s own domain and links to third parties. One blended “visible” flag throws away the distinction I need to decide what to fix.

## Repeat the test before calling it a position

A fixed panel and clear scoring rules still do not make one answer a stable ranking. Generated answers vary, so the same prompt can produce different shortlists on repeated runs.

Volunteers ran prompts [2,961 times across ChatGPT, Claude and Google AI](https://kinetixseo.com/articles/geo-ranking). The same brand list came back fewer than one in 100 times; the same order returned about once in 1,000. A single answer tells me what one draw looked like, not where a brand permanently ranks.

Citations change over time, too. Re-running identical prompts a month apart [changed cited domains by 40.5% on Perplexity and up to 59.3% on Google AI Overviews](https://kinetixseo.com/articles/geo-ranking). Another study, covering more than 43,000 keywords, found [AI Overviews averaged 2.15 days before their content changed](https://diploria.ai/blog/ai-visibility-volatility).

**One answer is a sample, not a position.** As a practical starting point, I repeat each prompt at least three times per week and report the observed range rather than presenting one run as the result.

### Show the variation without dressing it up as certainty

Three repeats do not give me a confidence interval worth framing. They give me a first look at variability.

Suppose ApexDesk appears in one of three runs for a prompt on Monday and two of three on Friday. I report those observations as 1/3 and 2/3, with their dates, rather than compressing them into a reassuring 50% and hiding the movement.

For a baseline, I hold five prompts unchanged for four weeks and watch the weekly share. A movement that persists across three weeks of repeated runs is more persuasive than a one-week jump. Neither is a reason to stop checking the underlying answers.

I cover that discipline in more detail in [_Your AI Visibility Score Is a Sample, Not a Ranking_](https://groas.com/post/why-your-ai-visibility-number-changes-ev), including the repeat counts and baseline setup I use to separate a trend from run-to-run wobble.

Keep the raw observations beside the summary. A range is useful only when I know what produced it.

![One buyer question producing five different AI shortlists side by side](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/001a5dd7-83fc-4d11-8ddf-061c7d62fcd6.png)

## Use crawler logs to explain gaps, not claim visibility

Once the answer measurements are clear, crawler logs can help explain what happens before inclusion. They cannot replace the answer measurements.

Server logs show AI bots fetching pages, but [training crawl is not live retrieval](https://believe.digital/thinking/ai-bots-in-your-logs/). GPTBot collects content that may be used for training. ChatGPT-User is associated with user-triggered fetching. Those are different activities, and counting them together produces another flattering number with an unclear meaning.

For ApexDesk, hundreds of training-crawler hits do not establish that a product page appeared in a buyer’s answer. Equally, the absence of an observed live fetch does not, by itself, prove the brand was absent from every answer.

**A fetch proves a fetch, not a recommendation or a lead.** The logs are evidence about access; the answer is evidence about inclusion.

![Server log lines separating training crawls from live-answer fetches for one buyer question](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/36dfce2b-6fad-4d7e-a4b8-c919daff3c32.png)

I keep three stages separate:

1. **Verified crawling:** the assistant’s bot fetched the page.
2. **Live-answer retrieval:** the page was fetched in connection with a specific prompt.
3. **Answer inclusion:** the brand or link appeared in the resulting answer.

These are different events, not interchangeable counts. A large number at the first stage does not establish a large number at the third. This [four-week test of fetches, prompts and gaps](https://groas.com/post/run-your-own-ai-citation-audit-a-four-week-test-to-separate) shows how I separate a real ChatGPT or Perplexity fetch from background bot noise.

The last gap matters. A page can be fetched for a live answer and still lose the citation to a review site. It can also appear in a footnote rather than in the recommendation itself.

I treat retrieval as evidence that the page entered the process, not evidence that it persuaded anyone. For the visibility question, I return to repeated appearances in answers to the same purchase-intent prompts, counted under the same rules. Everything before that is plumbing.

![Funnel diagram showing crawler hit narrowing to live fetch then to brand recommendation](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/6e27a6a0-f9b2-4254-a7ba-e0c9fcbabe5b.png)

## Compare the specification, then decide who does the work

At this point, the buying test is straightforward. I send every shortlisted provider the same ten prompts and ask for the same five-part specification:

1. **Exact prompt text**, with branded and unbranded results separated.
2. **Engines and market tested**, including the question format used.
3. **Repeats per prompt**, with the method used to combine results.
4. **Definitions of a hit**, separating mentions, citations and recommendations.
5. **Run dates**, with the observed variation across repeats.

A provider unwilling to supply that information has made comparison impossible. A glossy percentage does not repair the omission.

**Judge the spec sheet before the score.** Only after the specifications match can I compare what the providers actually observed.

Then comes the operational question: who acts on the findings? Monitoring software leaves someone on the team responsible for rewriting category pages, tightening product feeds and earning third-party proof. The report becomes useful when it points to work that ships, not when it generates another meeting about visibility.

When nobody owns that work, I favor managed delivery. That is the loop [groas](https://groas.com/) was built to absorb: measurement, investigation and page changes handled together instead of three vendors pointing at each other. The aim is not to manage a more flattering dashboard. It is to connect the findings to execution.

## Read the two reports again

Now take the opening case: 78% and 35% for the same brand in the same week. I would not average them, choose the higher one or assume the lower one is more honest. I would reconstruct the tests.

Suppose the 78% report records 39 hits across 50 prompts. Thirty prompts name the brand, and any mention anywhere counts. The 35% report records seven hits across 20 unbranded purchase prompts, counting only top-three recommendations with a link to the brand’s own site.

First, the prompt panels differ. One leans heavily on recognition; the other tests selection without a branded hint. Next, the scoring rules differ. A passing mention qualifies in one report but not the other. Before treating either result as a trend, I would still need the engines, market, repeat counts and dates.

**The lower number is more useful for this buyer-discovery question because of what it measures, not because it is lower.** It describes a harder, more relevant test for a buyer still choosing a desk.

That is where I would start: freeze that purchase-intent panel, repeat it under the same rules, and let the next report show whether ApexDesk appears more often. The percentage comes last.

## Frequently Asked Questions

### Why can two AI visibility tools report completely different scores for the same brand in the same week?

Because an AI visibility percentage describes the measurement setup, not a universal score for the brand. It is qualifying appearances divided by answer opportunities in the sample, so changing the prompts, engines, repetitions or definition of an appearance changes the number even when nothing about the brand changes.

### Why should branded prompts be kept separate from unbranded prompts when measuring AI visibility?

Because branded prompts almost always mention the brand, so they mostly measure recognition rather than discovery. Blending them into one rate can flatter the result, for example a combined 40% that hides 100% on branded prompts versus about 14% where the buyer has not named a brand. Report recognition and discovery on separate lines.

### What details should be listed alongside an AI visibility percentage?

The prompt panel size, the engines tested, the market and the dates of the runs. A bare number like 40% visibility cannot be interpreted, while a statement such as 40% across a specific prompt panel, on named engines, in a defined market, during a given week can be.

### Can an AI visibility score improve without the brand actually gaining more visibility?

Yes. Adding easy or branded prompts can inflate the percentage without changing what engines actually say, because the measurement moves when the test changes. Keep the original comparison panel frozen and report any added prompts separately so a change in answers is not confused with a change in the exam.

### What is the difference between a mention, a citation and a recommendation in an AI answer?

A mention puts the brand name in the answer text, a citation shows a page as a source, and a recommendation presents the brand as a choice for the buyer. They do not always travel together, so count them separately and split citations into links to the brand's own domain and links to third parties.

### Do AI answers give a stable ranking for a brand?

No. Generated answers vary, so the same prompt can produce different shortlists on repeated runs; in one study of 2,961 runs, the same brand list returned fewer than one in 100 times. Repeat each prompt at least three times per week and report the observed range rather than treating a single run as the result.

### Do lots of AI bot hits in my server logs mean my pages show up in AI answers?

Not necessarily. Training crawls, such as GPTBot fetching content, are a different activity from user-triggered live retrieval, and counting them together produces a flattering number with unclear meaning. A fetch proves a fetch, not an answer inclusion; hundreds of training-crawler hits do not establish that a page appeared in a buyer's answer.

### How do I compare two AI visibility providers fairly?

Send each provider the same prompts and ask for the same specification: exact prompt text with branded and unbranded results separated, engines and market tested, repeats per prompt with the combining method, definitions of a hit separating mentions, citations and recommendations, and run dates with observed variation. Only when the specifications match can the observed percentages be compared.

## Run Your Marketing On groas

Plug ChatGPT, Claude or any AI agent into groas and let it do the work of a whole marketing team: free to ask, $49 a month flat with every feature included, and autopilot whenever you’re ready.

[Start Free](https://groas.com/pricing)

[Or have groas run it for you](https://groas.com/done-for-you)

## Structured data

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://graph.groas.com/entity/groas","name":"groas","url":"https://groas.com/","description":"groas is the marketing infrastructure for your own AI: plug Claude, ChatGPT or any AI agent into groas and run all your marketing from it, for a tiny fraction of the usual cost, with the groas app there whenever you want to see more. It is the layer ChatGPT, Claude and any AI assistant run a business’s online marketing on. Through groas an assistant can do anything you could do natively in Google Ads, Bing Ads, Meta Ads and ChatGPT ads, on your website and in AI search, and, where the owner switches it on, can run connected campaigns by itself, so AI agents do the work a whole marketing team used to (free to read, $49 a month to make changes, delivered as an MCP server). Separately, its done-for-you service has senior people and proprietary quantitative systems run paid ads, SEO and AI search for businesses, and white label for agencies, from $5,000 a month.","logo":{"@type":"ImageObject","url":"https://groas.com/icon-512.png","width":512,"height":512},"sameAs":["https://www.linkedin.com/company/groas/"]},{"@type":"WebSite","@id":"https://groas.com/#website","name":"groas","url":"https://groas.com/","inLanguage":"en-US","publisher":{"@id":"https://graph.groas.com/entity/groas"}},{"@type":"WebPage","@id":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their#webpage","url":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their","name":"Before You Compare AI Visibility Tools, Compare Their Denominators","description":"An AI visibility score measures a chosen test, not your whole brand. Compare prompts, engines, repetitions and scoring rules before comparing providers.","inLanguage":"en-US","isPartOf":{"@id":"https://groas.com/#website"},"about":{"@id":"https://graph.groas.com/entity/groas"},"primaryImageOfPage":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/7d7ecfa0-a90b-4506-8307-59864db90a35.png"},"breadcrumb":{"@id":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their#breadcrumb"},"dateModified":"2026-11-15T05:19:35.984Z","mainEntity":{"@id":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their#article"}},{"@type":"BreadcrumbList","@id":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://groas.com/"},{"@type":"ListItem","position":2,"name":"Blog","item":"https://groas.com/blog"},{"@type":"ListItem","position":3,"name":"Before You Compare AI Visibility Tools, Compare Their Denominators","item":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their"}]},{"@type":"BlogPosting","@id":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their#article","url":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their","mainEntityOfPage":{"@id":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their#webpage"},"isPartOf":{"@id":"https://groas.com/blog#blog"},"headline":"Before You Compare AI Visibility Tools, Compare Their Denominators","description":"An AI visibility score measures a chosen test, not your whole brand. Compare prompts, engines, repetitions and scoring rules before comparing providers.","datePublished":"2026-11-15T05:19:35.912Z","dateModified":"2026-11-15T05:19:35.984Z","image":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/7d7ecfa0-a90b-4506-8307-59864db90a35.png"},"author":{"@id":"https://groas.com/author/alexander-perelman#person"},"publisher":{"@id":"https://graph.groas.com/entity/groas"},"keywords":"prompts, compare, visibility, before, brand, answer, apexdesk, without","wordCount":2027,"inLanguage":"en-US"},{"@type":"Person","@id":"https://groas.com/author/alexander-perelman#person","name":"Alexander Perelman","jobTitle":"Head Of Product @ groas","description":"My background includes Goldman Sachs and Stanford Computer Science.","image":"https://groas.com/media/blog/4f17cac3a81acc224cc1b2cfab8f94bbc295a3089d13e8421125771ef8d4064f.jpg","worksFor":{"@id":"https://graph.groas.com/entity/groas"},"sameAs":["https://www.linkedin.com/in/alexander-433793253/"]},{"@type":"FAQPage","@id":"https://groas.com/post/before-you-compare-ai-visibility-tools-compare-their#faq","mainEntity":[{"@type":"Question","name":"Why can two AI visibility tools report completely different scores for the same brand in the same week?","acceptedAnswer":{"@type":"Answer","text":"Because an AI visibility percentage describes the measurement setup, not a universal score for the brand. It is qualifying appearances divided by answer opportunities in the sample, so changing the prompts, engines, repetitions or definition of an appearance changes the number even when nothing about the brand changes."}},{"@type":"Question","name":"Why should branded prompts be kept separate from unbranded prompts when measuring AI visibility?","acceptedAnswer":{"@type":"Answer","text":"Because branded prompts almost always mention the brand, so they mostly measure recognition rather than discovery. Blending them into one rate can flatter the result, for example a combined 40% that hides 100% on branded prompts versus about 14% where the buyer has not named a brand. Report recognition and discovery on separate lines."}},{"@type":"Question","name":"What details should be listed alongside an AI visibility percentage?","acceptedAnswer":{"@type":"Answer","text":"The prompt panel size, the engines tested, the market and the dates of the runs. A bare number like 40% visibility cannot be interpreted, while a statement such as 40% across a specific prompt panel, on named engines, in a defined market, during a given week can be."}},{"@type":"Question","name":"Can an AI visibility score improve without the brand actually gaining more visibility?","acceptedAnswer":{"@type":"Answer","text":"Yes. Adding easy or branded prompts can inflate the percentage without changing what engines actually say, because the measurement moves when the test changes. Keep the original comparison panel frozen and report any added prompts separately so a change in answers is not confused with a change in the exam."}},{"@type":"Question","name":"What is the difference between a mention, a citation and a recommendation in an AI answer?","acceptedAnswer":{"@type":"Answer","text":"A mention puts the brand name in the answer text, a citation shows a page as a source, and a recommendation presents the brand as a choice for the buyer. They do not always travel together, so count them separately and split citations into links to the brand's own domain and links to third parties."}},{"@type":"Question","name":"Do AI answers give a stable ranking for a brand?","acceptedAnswer":{"@type":"Answer","text":"No. Generated answers vary, so the same prompt can produce different shortlists on repeated runs; in one study of 2,961 runs, the same brand list returned fewer than one in 100 times. Repeat each prompt at least three times per week and report the observed range rather than treating a single run as the result."}},{"@type":"Question","name":"Do lots of AI bot hits in my server logs mean my pages show up in AI answers?","acceptedAnswer":{"@type":"Answer","text":"Not necessarily. Training crawls, such as GPTBot fetching content, are a different activity from user-triggered live retrieval, and counting them together produces a flattering number with unclear meaning. A fetch proves a fetch, not an answer inclusion; hundreds of training-crawler hits do not establish that a page appeared in a buyer's answer."}},{"@type":"Question","name":"How do I compare two AI visibility providers fairly?","acceptedAnswer":{"@type":"Answer","text":"Send each provider the same prompts and ask for the same specification: exact prompt text with branded and unbranded results separated, engines and market tested, repeats per prompt with the combining method, definitions of a hit separating mentions, citations and recommendations, and run dates with observed variation. Only when the specifications match can the observed percentages be compared."}}]}]}
```
