---
title: "7 Ways to Check Whether Your SEO and AI Search Agency Did Useful Work"
description: "Check live pages, technical fixes, AI citations and enquiries with seven practical tests that separate delivered work from visibility and business results."
url: "https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did"
image: "https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/ebcf874b-77c7-4df7-93c2-de5e4f59ae19.png"
published: "2026-11-09T05:37:31.667Z"
modified: "2026-11-09T05:37:31.728Z"
---

November 9, 2026 · 10 min read

# 7 Ways to Check Whether Your SEO and AI Search Agency Did Useful Work

[](https://groas.com/author/alexander-perelman)

[Alexander Perelman](https://groas.com/author/alexander-perelman)Personally Tested

Head Of Product @ groas

[LinkedIn](https://www.linkedin.com/in/alexander-433793253/)

![A tiny inspector in a model town follows a red thread from a giant glossy report through the streets, finding it ends at a closed, unlit shop door.](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/ebcf874b-77c7-4df7-93c2-de5e4f59ae19.png)

In this article

1. [1. Open the pages they say they published](#1-open-the-pages-they-say-they-published)
2. [2. Ask for the before-and-after of one technical fix](#2-ask-for-the-before-and-after-of-one-technical-fix)
3. [3. Follow claimed mentions and citations back to their sources](#3-follow-claimed-mentions-and-citations-back-to-their-sources)
4. [4. Repeat a small sample of the tracked AI questions](#4-repeat-a-small-sample-of-the-tracked-ai-questions)
5. [5. Inspect Google performance at the page-and-query level](#5-inspect-google-performance-at-the-page-and-query-level)
6. [6. Ask a buyer to use the content to make a decision](#6-ask-a-buyer-to-use-the-content-to-make-a-decision)
7. [7. Trace a sample of enquiries back to the evidence you actually have](#7-trace-a-sample-of-enquiries-back-to-the-evidence-you-actually-have)

Your agency’s monthly SEO report is not proof anything useful happened. If you pay for ongoing SEO and AI search management, I want you checking evidence you can open, repeat or trace, not admiring a score you have to trust. These seven checks keep **implementation, visibility and business results separate**. Mixing them is how a report turns “we published something” into “we grew your business” without showing the work in between.

## 1. Open the pages they say they published

I used to tell clients to start with rankings. I was wrong. Rankings move for reasons your agency did not cause. A PDF that says “4 pages published” proves nothing until those URLs load on your domain and read like finished work.

Start with an [evidence trail, not rankings](https://audit.brandedagency.com/blog/generative-engine-optimization): live pages, sitemap changes, Search Console queries you did not appear for before, and a dated log of shipped changes. Those are different kinds of evidence. A live URL shows that a page exists. A new query shows observed visibility. Neither, on its own, proves the page brought in a buyer.

Open every URL they list. Check that each page answers one real buyer question instead of restating another page in new words. If two pages could swap titles and nobody would notice, you paid for duplication.

Ask for three things:

- The live URL.
- The publication date.
- One sentence explaining which buyer question the page answers.

**First step: request that list in one email, then open the pages.** Do not let a content-production total stand in for an inspection. Four published pages can be four useful assets or four more things your next agency has to clean up.

## 2. Ask for the before-and-after of one technical fix

An audit recommendation is not work. I have seen 40-page audits where every ticket sat in “recommended” status while the client kept paying a retainer. The document got longer. The site stayed the same.

A fix counts when it is live on the URL where the problem was found. Re-check the same evidence after deployment, whether that means schema present, a canonical corrected or a robots rule removed. A [fix-verification loop](https://www.growthract.com/insights/blogs/seo-fix-verification-loop) closes the gap between advice delivered and changes actually deployed.

Pick one fix from the report and ask for:

1. What the affected page showed before.
2. What that same page shows now.
3. The date the change went live.

A relevant Search Console screenshot, page-source record or crawl record can provide the comparison. The evidence should match the problem, not merely show that someone opened a tool.

**First step: choose one supposedly completed fix and ask to see it live.** If they send a closed ticket instead, you have evidence of a workflow status, not yet evidence of a deployed fix. And even a verified fix proves implementation, not a traffic or revenue gain. Keep that boundary intact.

## 3. Follow claimed mentions and citations back to their sources

A logo wall in a report is not a citation. Click every claimed third-party mention and confirm the page exists, names you correctly and links where the report says it links.

For AI answers, make another distinction: a brand name in the response is not the same thing as a clickable link. ChatGPT [names brands about 3.2 times more often than it links to them](https://www.dviodigital.com/blogs/track-brand-visibility-chatgpt-gemini-perplexity/). “Mentioned in 40 answers” can therefore describe something quite different from 40 clickable citations.

Different engines fetch different sources, and answers get rewritten. A report needs to tell you what was observed, where and when, rather than flattening every appearance into _coverage_.

For each claimed result, ask for:

- The source URL, where a page is being claimed.
- The engine and observation date, where an AI answer is being claimed.
- Whether the result was a text mention or a clickable link.

**First step: trace the claimed mentions back to the underlying evidence.** If a source page now returns a 404, flag it as unavailable rather than counting it as current coverage. If it never named you, cross it off. A historical appearance and a link a buyer can click today are not interchangeable.

What the deck calls “coverage,” I call inventory until I can inspect it.

## 4. Repeat a small sample of the tracked AI questions

Pick five prompts from the agency’s tracker and run them yourself in the same engine. Record the engine, date, exact wording and result: named you, linked you or neither.

This is a spot-check, not a verdict. AI answers shift from run to run. In [SISTRIX’s analysis of AI visibility](https://www.sistrix.com/blog/measuring-ai-visibility/), 70% of brands that appeared showed up on fewer than 1 in 5 days, while only 6% appeared on 4 in 5 days across the surfaces studied. One manual check that misses you proves very little. Repeated misses deserve a closer look, not an immediate accusation.

The broader measurement question is whether the tracker covers enough different buyer questions. In the same analysis, [testing 20 different prompts was more than three times as accurate as testing one prompt for 20 days](https://www.sistrix.com/blog/measuring-ai-visibility/). Repeating a narrow sample does not make it representative of everything your buyers ask.

Ask the agency to show:

- How many distinct prompts sit behind the score.
- Which buyer questions those prompts represent.
- Which engines were checked and on which dates.
- How mentions and links are counted separately.

**First step: ask for the prompt list behind the visibility score, then rerun five of those prompts.** A small list is not automatically useless, but it is a narrow view. I would rather see that limitation stated plainly than watch twelve prompts dressed up as the whole market.

## 5. Inspect Google performance at the page-and-query level

Traffic totals lie by omission. A PR hit, a seasonal spike or your own brand searches can lift sessions while buyer discovery falls. The total can be accurate and still answer the wrong question.

Open Search Console’s Search results performance report and inspect queries alongside pages. Separate searches for your brand from non-branded discovery queries; this [branded-versus-non-branded breakdown](https://www.gscmcpserver.com/blog/branded-vs-non-branded-queries-search-console) is more useful than treating all clicks as one undifferentiated win.

Then look at the pages the agency says it improved. Are they appearing for the buyer questions those pages were meant to answer? Are clicks changing on those pages, or is the headline increase happening elsewhere?

If non-branded clicks to your money pages are flat while total clicks rise, the total does not demonstrate stronger buyer discovery. It also does not prove the agency did nothing. It tells you where the explanation needs to get more specific.

Pair that inspection with GA4 before accepting an AI traffic claim. Look at the session source and medium behind reported referrals, rather than assuming a dashboard label explains the whole journey. Keep an identifiable referral separate from an impression, and both separate from a business result.

**First step: choose the pages the agency claims improved and inspect their queries, clicks and key events.** Ask what changed on those pages and what happened afterward. A rise in AI impressions is not proof of visits; a rise in visits is not proof of enquiries. Screenshots of exposure cannot do all three jobs.

## 6. Ask a buyer to use the content to make a decision

A page can rank, get cited and still fail at its job. I learned this on an ecommerce account where a buying guide pulled steady traffic for six months and produced almost no checkouts. The copy answered the general question correctly. It never answered the buyer question: will this fit my case, what exactly am I getting, and what do I do next?

Visibility without a decision is just publishing costs with better charts.

Hand the page to someone who buys what you sell and give them two minutes. Ask them to explain:

1. Who this is for, and who should skip it.
2. What the offer includes and what it costs to start.
3. What the next step is if they want it.

If they hesitate, you have something concrete to investigate. You do not need another abstract discussion about whether the content feels “authoritative.” You need to know which part of the buying decision the page leaves unresolved.

This check does not establish how much revenue the page caused. It tests whether the content helps a buyer understand the offer and act on it. That is a useful judgment in its own right.

**First step: run this on your two highest-traffic SEO pages this week.** Fix fit, offer clarity and the next step before paying for five more pages with the same problem.

![Paper layers with a rising chart lifting to reveal blank pages underneath](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/76443fbd-cc79-4b5e-90eb-dda7570738de.png)

## 7. Trace a sample of enquiries back to the evidence you actually have

Pull your last 20 enquiries and sort them into three groups. Not everything belongs in a revenue chart just because somebody can draw an arrow to it.

- **Observed referrals:** a source and medium you can inspect in GA4, such as a referral from chatgpt.com or perplexity.ai.
- **Customer-reported discovery:** what a buyer tells you in a “How did you hear about us?” field.
- **Inferred influence:** a possible journey you cannot verify, such as an AI answer shaping a shortlist before someone finds you through Google.

The first two give you evidence of a recorded referral or a buyer’s account of discovery. They are not identical, and neither automatically establishes closed-won revenue. The third is a hypothesis. Keep it labelled that way.

I have watched agencies move every unattributed lead into the third group and call it AI revenue. That is how a mention becomes a closed-won claim with no path between them.

**First step: tag one month of enquiries this way before you renew.** If almost everything sits in the inferred group, you do not have demonstrated attribution. You have a story to investigate. That does not mean the work had no influence; it means the available evidence cannot carry the claim being made.

This is also where I would ask for the rest of the evidence package. A managed SEO and AI search service should hand over the following without an argument:

- Live URLs with publication dates and the buyer question each page answers.
- Change records with before-and-after evidence for technical work.
- Source links for claimed third-party mentions, with mentions and citations distinguished.
- The visibility method: prompt count, engines, dates and re-check rules.
- Business results labelled as observed, customer-reported or inferred.

These are not five versions of the same proof. They answer different questions. The distinction also runs through the [seven AI SEO myths agencies sell](https://groas.com/post/7-myths-agencies-believe-before-reselling-ai-seo-and-what): a service claim is not a substitute for something the buyer can inspect.

That is the standard I hold groas to as well. groas runs [paid ads, SEO and AI search around the clock](https://groas.com/), with a named strategist accountable for the work and actions logged with the reasoning behind them in plain language. That model should make inspection straightforward. If the log says a page shipped, you should see the URL. If it says a citation was earned, you should see the source link and the engine that returned it.

I do not want a special standard for our reports. I want three separate answers from any provider, including groas:

- **Implementation:** did the work ship, and can I inspect it?
- **Visibility:** did observed presence change across the measured queries, prompts and engines?
- **Business results:** which enquiries and outcomes can we trace, and where does the evidence stop?

A provider that merges those answers into one score is asking you to trust the maths instead of checking the work.

If I had one hour with a new account, I would start with this seventh check. I would pull the last 20 enquiries and tag them before opening the agency’s report. Knowing which sources are observable and which ones buyers actually named tells me what the SEO and AI work needs to explain.

Say you are spending $20k a month, 14 of those 20 enquiries have branded-search or direct traffic sources, 2 buyers name ChatGPT, and none show an AI referral in GA4. Those observations should stay separate, not be forced into one attribution total. They give the other checks a purpose: inspect the pages, test the buyer questions and examine the visibility method to understand the gaps.

That is where I would spend the first hour. Not arguing about whether a visibility score went up. Finding out what the business can actually trace, then asking the provider for links that explain the work behind it.

## Frequently Asked Questions

### What should I ask my SEO agency for to prove they actually published the pages they claim?

Ask for three things in one email: the live URL, the publication date, and one sentence explaining which buyer question the page answers. Then open each URL yourself and check it answers a real buyer question rather than duplicating another page with different wording.

### How do I check that an SEO agency actually implemented a technical fix instead of just recommending it?

Pick one supposedly completed fix and ask to see it live on the URL where the problem was found. Request what the page showed before, what it shows now, and the deployment date. Evidence like a Search Console screenshot, page-source record or crawl record should match the specific problem. A closed ticket only proves workflow status, not a deployed fix.

### How can I verify that AI answers actually cite my brand, not just mention it?

Ask for the engine, the observation date, and whether the result was a text mention or a clickable link. ChatGPT names brands about 3.2 times more often than it links to them, so being mentioned in 40 answers is not the same as 40 clickable citations. If a claimed source page now returns a 404, count it as unavailable rather than current coverage.

### Can I spot-check my agency's AI visibility score myself?

Yes. Pick five prompts from the agency's tracker, run them yourself in the same engine, and record the engine, date, exact wording and whether the result named you, linked you or neither. AI answers shift between runs, so a single miss proves little, but repeated misses deserve a closer look.

### Why isn't a high AI visibility score enough on its own?

Because the score depends on how many distinct prompts were tested and which engines were checked. Testing 20 different prompts was more than three times as accurate as testing one prompt for 20 days, so a narrow prompt list only gives a narrow view. Ask how many prompts sit behind the score, which buyer questions they represent, and how mentions and links are counted separately.

### How do I check whether my SEO agency actually improved the pages it claims it improved?

Open Search Console's Search results performance report and inspect queries alongside pages. Separate brand searches from non-branded discovery queries, then check whether the claimed pages are appearing for the buyer questions they were meant to answer and whether their clicks are changing. If non-branded clicks to your money pages are flat while total clicks rise, the total does not demonstrate stronger buyer discovery.

### How can I tell if my content is useful to buyers, not just getting traffic?

Hand the page to someone who buys what you sell and give them two minutes. Ask them to explain who it is for, what the offer includes and costs, and what the next step is. If they hesitate, the page is leaving part of the buying decision unresolved, even if it ranks and gets cited.

### How should I attribute enquiries to SEO and AI search work?

Pull your last 20 enquiries and tag each as an observed referral you can inspect in GA4, customer-reported discovery from a how-did-you-hear-about-us field, or inferred influence where no verifiable journey exists. Only the first two count as recorded evidence, and neither automatically establishes closed-won revenue. If most enquiries sit in the inferred group, you have a story to investigate, not demonstrated attribution.

## Run Your Marketing On groas

Plug ChatGPT, Claude or any AI agent into groas and let it do the work of a whole marketing team: free to ask, $49 a month flat with every feature included, and autopilot whenever you’re ready.

[Start Free](https://groas.com/pricing)

[Or have groas run it for you](https://groas.com/done-for-you)

## Structured data

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://graph.groas.com/entity/groas","name":"groas","url":"https://groas.com/","description":"groas is the marketing infrastructure for your own AI: plug Claude, ChatGPT or any AI agent into groas and run all your marketing from it, for a tiny fraction of the usual cost, with the groas app there whenever you want to see more. It is the layer ChatGPT, Claude and any AI assistant run a business’s online marketing on. Through groas an assistant can do anything you could do natively in Google Ads, Bing Ads, Meta Ads and ChatGPT ads, on your website and in AI search, and, where the owner switches it on, can run connected campaigns by itself, so AI agents do the work a whole marketing team used to (free to read, $49 a month to make changes, delivered as an MCP server). Separately, its done-for-you service has senior people and proprietary quantitative systems run paid ads, SEO and AI search for businesses, and white label for agencies, from $5,000 a month.","logo":{"@type":"ImageObject","url":"https://groas.com/icon-512.png","width":512,"height":512},"sameAs":["https://www.linkedin.com/company/groas/"]},{"@type":"WebSite","@id":"https://groas.com/#website","name":"groas","url":"https://groas.com/","inLanguage":"en-US","publisher":{"@id":"https://graph.groas.com/entity/groas"}},{"@type":"WebPage","@id":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did#webpage","url":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did","name":"7 Ways to Check Whether Your SEO and AI Search Agency Did Useful Work","description":"Check live pages, technical fixes, AI citations and enquiries with seven practical tests that separate delivered work from visibility and business results.","inLanguage":"en-US","isPartOf":{"@id":"https://groas.com/#website"},"about":{"@id":"https://graph.groas.com/entity/groas"},"primaryImageOfPage":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/ebcf874b-77c7-4df7-93c2-de5e4f59ae19.png"},"breadcrumb":{"@id":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did#breadcrumb"},"dateModified":"2026-11-09T05:37:31.728Z","mainEntity":{"@id":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did#article"}},{"@type":"BreadcrumbList","@id":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://groas.com/"},{"@type":"ListItem","position":2,"name":"Blog","item":"https://groas.com/blog"},{"@type":"ListItem","position":3,"name":"7 Ways to Check Whether Your SEO and AI Search Agency Did Useful Work","item":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did"}]},{"@type":"BlogPosting","@id":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did#article","url":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did","mainEntityOfPage":{"@id":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did#webpage"},"isPartOf":{"@id":"https://groas.com/blog#blog"},"headline":"7 Ways to Check Whether Your SEO and AI Search Agency Did Useful Work","description":"Check live pages, technical fixes, AI citations and enquiries with seven practical tests that separate delivered work from visibility and business results.","datePublished":"2026-11-09T05:37:31.667Z","dateModified":"2026-11-09T05:37:31.728Z","image":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/ebcf874b-77c7-4df7-93c2-de5e4f59ae19.png"},"author":{"@id":"https://groas.com/author/alexander-perelman#person"},"publisher":{"@id":"https://graph.groas.com/entity/groas"},"keywords":"pages, work, page, buyer, search, check, seo, agency","wordCount":2067,"inLanguage":"en-US"},{"@type":"Person","@id":"https://groas.com/author/alexander-perelman#person","name":"Alexander Perelman","jobTitle":"Head Of Product @ groas","description":"My background includes Goldman Sachs and Stanford Computer Science.","image":"https://groas.com/media/blog/4f17cac3a81acc224cc1b2cfab8f94bbc295a3089d13e8421125771ef8d4064f.jpg","worksFor":{"@id":"https://graph.groas.com/entity/groas"},"sameAs":["https://www.linkedin.com/in/alexander-433793253/"]},{"@type":"FAQPage","@id":"https://groas.com/post/7-ways-to-check-whether-your-seo-and-ai-search-agency-did#faq","mainEntity":[{"@type":"Question","name":"What should I ask my SEO agency for to prove they actually published the pages they claim?","acceptedAnswer":{"@type":"Answer","text":"Ask for three things in one email: the live URL, the publication date, and one sentence explaining which buyer question the page answers. Then open each URL yourself and check it answers a real buyer question rather than duplicating another page with different wording."}},{"@type":"Question","name":"How do I check that an SEO agency actually implemented a technical fix instead of just recommending it?","acceptedAnswer":{"@type":"Answer","text":"Pick one supposedly completed fix and ask to see it live on the URL where the problem was found. Request what the page showed before, what it shows now, and the deployment date. Evidence like a Search Console screenshot, page-source record or crawl record should match the specific problem. A closed ticket only proves workflow status, not a deployed fix."}},{"@type":"Question","name":"How can I verify that AI answers actually cite my brand, not just mention it?","acceptedAnswer":{"@type":"Answer","text":"Ask for the engine, the observation date, and whether the result was a text mention or a clickable link. ChatGPT names brands about 3.2 times more often than it links to them, so being mentioned in 40 answers is not the same as 40 clickable citations. If a claimed source page now returns a 404, count it as unavailable rather than current coverage."}},{"@type":"Question","name":"Can I spot-check my agency's AI visibility score myself?","acceptedAnswer":{"@type":"Answer","text":"Yes. Pick five prompts from the agency's tracker, run them yourself in the same engine, and record the engine, date, exact wording and whether the result named you, linked you or neither. AI answers shift between runs, so a single miss proves little, but repeated misses deserve a closer look."}},{"@type":"Question","name":"Why isn't a high AI visibility score enough on its own?","acceptedAnswer":{"@type":"Answer","text":"Because the score depends on how many distinct prompts were tested and which engines were checked. Testing 20 different prompts was more than three times as accurate as testing one prompt for 20 days, so a narrow prompt list only gives a narrow view. Ask how many prompts sit behind the score, which buyer questions they represent, and how mentions and links are counted separately."}},{"@type":"Question","name":"How do I check whether my SEO agency actually improved the pages it claims it improved?","acceptedAnswer":{"@type":"Answer","text":"Open Search Console's Search results performance report and inspect queries alongside pages. Separate brand searches from non-branded discovery queries, then check whether the claimed pages are appearing for the buyer questions they were meant to answer and whether their clicks are changing. If non-branded clicks to your money pages are flat while total clicks rise, the total does not demonstrate stronger buyer discovery."}},{"@type":"Question","name":"How can I tell if my content is useful to buyers, not just getting traffic?","acceptedAnswer":{"@type":"Answer","text":"Hand the page to someone who buys what you sell and give them two minutes. Ask them to explain who it is for, what the offer includes and costs, and what the next step is. If they hesitate, the page is leaving part of the buying decision unresolved, even if it ranks and gets cited."}},{"@type":"Question","name":"How should I attribute enquiries to SEO and AI search work?","acceptedAnswer":{"@type":"Answer","text":"Pull your last 20 enquiries and tag each as an observed referral you can inspect in GA4, customer-reported discovery from a how-did-you-hear-about-us field, or inferred influence where no verifiable journey exists. Only the first two count as recorded evidence, and neither automatically establishes closed-won revenue. If most enquiries sit in the inferred group, you have a story to investigate, not demonstrated attribution."}}]}]}
```
