---
title: "Before You Hire a Meta Agency: The Creative-Testing Acceptance Checklist"
description: "New ads are not proof of testing. Use this 16-point checklist to trace each hypothesis through delivery, spend, business results, and an accountable decision."
url: "https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing"
image: "https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/63423439-494b-4f91-988a-0e230111be27.png"
published: "2026-11-08T05:39:23.183Z"
modified: "2026-11-08T05:39:23.240Z"
---

November 8, 2026 · 9 min read

# Before You Hire a Meta Agency: The Creative-Testing Acceptance Checklist

[](https://groas.com/author/alexander-perelman)

[Alexander Perelman](https://groas.com/author/alexander-perelman)Personally Tested

Head Of Product @ groas

[LinkedIn](https://www.linkedin.com/in/alexander-433793253/)

![A tray of identical lemons, each in a different silly disguise, with a jeweller's loupe revealing the same scar on one: many variations, one idea.](https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/63423439-494b-4f91-988a-0e230111be27.png)

In this article

1. [Before signing: ask for the work behind the deck](#before-signing-ask-for-the-work-behind-the-deck)
2. [Before production: separate a hypothesis from an editing task](#before-production-separate-a-hypothesis-from-an-editing-task)
3. [Before judging: establish that the test received delivery](#before-judging-establish-that-the-test-received-delivery)
4. [Before declaring a winner: connect the result to the business](#before-declaring-a-winner-connect-the-result-to-the-business)
5. [Before accepting the report: demand a decision and its receipt](#before-accepting-the-report-demand-a-decision-and-its-receipt)
6. [Before payment: put acceptance and ownership in writing](#before-payment-put-acceptance-and-ownership-in-writing)

A folder of new ads is not evidence of creative testing. **Before I accept a testing deliverable, I want a chain I can follow: a genuinely different hypothesis, actual delivery, spend, downstream results, and a decision someone owns.** Two dozen thumbnails do not establish that chain, especially when half show the same footage wearing different on-screen text. [Meta’s own announcement](https://www.facebook.com/business/news/demystifying-creative-diversification) distinguishes iteration, such as identical visuals with different text or CTAs, from diversification: distinctly different assets aimed at different personas or use cases. Both have a place. They are not interchangeable, and an agency should not invoice you for one while presenting it as the other. Keep this checklist open during finalist calls and monthly reviews. The question is not whether the agency made something. It is whether the work answered something, and whether you can inspect the evidence.

## Before signing: ask for the work behind the deck

1. Ask who produces the creative, who approves its claims, and who makes the next decision once results land. Get those responsibilities clear before discussing production volume. The “creative team” can turn out to be a media buyer with a stock-imagery account, a mismatch flagged by [Powercouch Media](https://www.powercouchmedia.com/blog-posts/questions-to-ask-before-hiring-a-facebook-ads-agency). That is a different service from a testing program. The acceptance check is simple: the agency can explain who turns a hypothesis into an asset, who checks what the asset promises, and who decides what happens after delivery. A department name is not an answer to all three.

2. **Request a redacted sample test log and monthly report from a live account.** A performance deck is a highlight reel; a log should include the losers and unresolved tests, too. Ask for the _hit rate_: the share of tested ads that reached the agency’s winning threshold over 30 and 90 days, as suggested by [Opascope](https://opascope.com/insights/meta-ads-agency/). Then ask what that threshold means and which ads entered the denominator. The number is useful only if the agency can show how it was calculated. Accept evidence of a repeatable method, not a percentage floating above a row of attractive thumbnails.

3. Ask what share of the budget stays in a standing test lane, and what that allocation can realistically support. [Meta’s November 2024 guidance](https://www.facebook.com/business/news/three-steps-to-optimize-your-performance-with-creative-diversification) recommends at least 20 diversified ads in Advantage+ shopping campaigns and 20–30% of the overall budget toward new ads. Ask how the agency applies that guidance to your account rather than treating those numbers as the deliverable. A production target still needs delivery, a judging rule, and enough spend to answer the question. “We test when there is time” is not a plan for replacing a winner when it starts to fatigue.

## Before production: separate a hypothesis from an editing task

4. **Write the customer objection or buying motivation in one sentence before anyone shoots anything.** “We are testing hooks” describes a task, not a hypothesis. “Renters leave in the first three seconds because the video reads like an ad, so a price claim up front should hold them” makes a prediction that can fail. Ask what result would count against that prediction, not just what success would look like. If every possible outcome supports the original idea, the agency has written a rationale for making an ad. It has not written a test. Get the question into the log before production makes everyone attached to the answer.

5. Mark what changes between assets: opening hook, footage, format, message, or tone. Use one row per asset and one column per variable so the distinction survives beyond the briefing call. [Mereny’s testing framework](https://mereny.com/resources/meta-ads-creative-testing) provides a useful vocabulary: a _concept_ is a genuinely different idea, such as a new angle, format, or messenger; a _variation_ modifies something, such as a hook line, edit, or thumbnail. I use concepts to organize the search for winners and variations to extend promising work. The acceptance check is whether the labels describe meaningful differences, rather than whatever makes the production total look largest.

6. **Label text swaps on identical footage as variations, not distinct concepts.** Two videos carrying “Text A” and “Text B” may test a message difference; they do not, by themselves, demonstrate creative diversification. That distinction matters because similar-looking assets can be grouped together by Meta’s ranking systems, as discussed by [Engage Era](https://eesmm.com/news/meta-same-ad). Do not reject iteration. Reject inflated accounting. If the agency ships thirty text swaps, the log should show which questions those variations address and what their results establish. Thirty exported files are thirty exported files. They are not automatically thirty different ideas about why someone might buy.

## Before judging: establish that the test received delivery

7. **Inspect spend and impressions by concept, not just by campaign total.** Export ad-level delivery and group it using the concept labels from item 5. If one concept takes 80% of the budget, inspect what the others actually received before accepting a comparison. [AdEye’s framework](https://adeye.ai/blog/ad-creative-testing-framework) suggests 3–5 genuinely different concepts at a time, with even budgets and a run of at least 5–7 days or roughly 50 conversions per variant. Treat that as a planning reference, not proof that a test succeeded or failed. The acceptance question is whether each concept received enough delivery to support the verdict attached to it. A campaign total cannot answer that.

8. **Separate an underdelivered ad from a demonstrated loser.** An ad that spends $40 of a $400 test allocation has not automatically failed. Ask for a numeric kill rule agreed in advance: the spend floor, the relationship to target CAC, and the observation window. A [discussion in r/FacebookAds](https://www.reddit.com/r/FacebookAds/comments/1w8eo6a/hired_a_meta_ads_agency_3_weeks_ago_they_made/) about an agency logging 1,000-plus changes in three weeks illustrates the problem with constant intervention: activity can destroy the conditions needed to judge performance. The agency should explain why it stops an ad, not merely point out that it stopped spending. “Underdelivered” and “lost” belong in different rows of the explanation.

9. Ask how the agency separates concept exploration from a controlled comparison. [Meta’s A/B test guidance](https://www.facebook.com/business/help/290009911394576) calls for testing one variable with otherwise identical ad sets, avoiding overlapping audiences, and running tests for at least 7 days and no more than 30 unless customers convert slowly. A comparison of genuinely different concepts can change several creative elements; it should not then claim to isolate the effect of one hook. Likewise, creative running alongside established winners does not automatically produce a clean causal comparison. Require the agency to name the kind of test it ran and limit the conclusion to what that setup can establish.

## Before declaring a winner: connect the result to the business

10. **Connect clicks and leads to qualified enquiries or purchases wherever tracking permits.** A form fill is not a customer, and creative that wins at lead level can lose at pipeline level. Name the downstream signal used for each verdict: purchase value, qualified enquiry, or booked call. Then ask how that signal reaches Meta, whether through Conversions API or an offline conversions import from the CRM. Commonly done wrong: the sales data stays in a disconnected CRM while the agency judges creative entirely on platform-reported leads. If the connection is missing, record that limitation. Do not let a lead-volume result quietly become a claim about revenue.

11. Record conversion lag and measurement limitations beside the result, not in a footnote nobody reads. [Meta’s A/B test guidance](https://www.facebook.com/business/help/290009911394576) says to extend the test window when the typical customer takes longer than 7 days to convert. A day-three verdict is premature for a purchase that takes two weeks of consideration. Ask when the test stopped receiving spend, when its results were judged, and whether the agency allowed for the expected lag. Those are different questions. The acceptance check is whether the observation window matches the buying process, rather than ending whenever the reporting deck needs a winner.

12. **Reject a business winner declared on CTR alone.** CTR is a diagnostic, not a substitute for the outcome named in item 10. Meta’s [diversification announcement](https://www.facebook.com/business/news/demystifying-creative-diversification) reports image-generation features producing 11% higher CTR and 7.6% higher CVR: even in that example, the metrics do not move in lockstep. [AdRiseLab](https://adriselab.com/blog/meta-ads-ab-testing-guide-2026) also notes that creative comparisons can reflect both user response and Meta’s delivery efficiency. Ask what the winner actually won on, and what remains uncertain. If the hypothesis concerns attention, a click metric may help answer it. That still does not make the ad a proven purchase or pipeline winner.

## Before accepting the report: demand a decision and its receipt

13. **Require one verdict per test: keep, retire, retest, or inconclusive, with the reasoning attached.** A leaderboard of top creatives does not tell you what the agency learned or what it intends to do. “Inconclusive” is a legitimate verdict when delivery is too thin to support a decision; it should not be disguised as a loss to keep the table tidy. Check the reasoning against the original hypothesis, the agreed judging rule, and the business signal. A verdict that cannot survive those checks is an opinion with a metric beside it. Accept a decision with a cause, including an honest decision that the evidence does not yet settle the question.

14. **Reconcile the monthly summary with the underlying change log.** Every summarized test should trace back to its hypothesis, delivery, spend, and verdict; every spend spike should have an explanation. For the broader reporting review, use the separate [monthly acceptance checklist](https://groas.com/post/before-you-accept-your-meta-agency-s-report-12-checks-that). The creative-testing check is narrower: pick three rows at random from the summary and ask to see their entries in the log. Do not let the agency substitute its three favourite examples. The summary should compress the evidence, not replace it. If the trail disappears as soon as you leave the presentation, the deliverable is not ready to accept.

## Before payment: put acceptance and ownership in writing

15. **Define the first reporting period’s acceptance criteria before you pay.** Specify the required log fields, scheduled tests, and business metric for each verdict. At an illustrative $20k a month, the agreement might call for four genuine concepts in a standing test lane by week three, a verdict for every closed test, and a trace from each verdict to spend and the closest available revenue signal. Then use a written hiring verdict: _pass_ means the hypothesis, delivery, outcome, and decision all connect; _conditional pass_ means one or two gaps need proof in the first reporting period; _reject_ means the agency cannot show a log, judges everything on CTR, or mislabels text swaps and refuses to correct it. Missing evidence is an unanswered question, not proof of fraud. It is still not evidence you can accept.

16. **Name the owner of every unresolved test, next action, and creative-policy decision. This is the item most often skipped.** “The team owns it” leaves the decision owner unnamed. Claim approval and policy compliance belong inside the testing deliverable, not in an onboarding document that disappears after signature; this [first-hand account of repeated account restrictions](https://www.reddit.com/r/FacebookAds/comments/1x3kjk6/meta_ads_account_restricted_twice_after_hiring_an/) shows why the responsibility matters. Put a name beside the decision before a rejected ad, a killed winner, or a policy restriction starts the search for whoever was supposedly responsible. The cost is not just wasted test spend or interrupted delivery. It is months of unverifiable claims because nobody must explain the reasoning or own what happens next. Most of this checklist asks the agency to demonstrate a method. The final two items ask it to commit to one. An agency that refuses both has told you what you are buying: a folder of new ads.

## Frequently Asked Questions

### Is a folder of new ad creatives proof that an agency actually ran creative tests?

No. A folder of new ads does not establish that creative testing happened. Real testing requires a genuinely different hypothesis, actual delivery and spend, downstream results, and a decision someone owns. Two dozen thumbnails, especially variants of the same footage with different on-screen text, do not show that chain.

### What is the difference between creative iteration and creative diversification in Meta ads?

Iteration means identical visuals with different text or CTAs, while diversification means distinctly different assets aimed at different personas or use cases. Both have a place in Meta advertising, but they are not interchangeable, and an agency should not invoice for one while presenting it as the other.

### How do I know if my agency wrote a real creative testing hypothesis?

A real hypothesis states a prediction that can fail, such as renters leaving in the first three seconds because a video reads like an ad, so a price claim up front should hold them. Saying we are testing hooks describes a task, not a hypothesis. If every possible outcome supports the original idea, the agency has written a rationale for making an ad, not a test.

### Do text swaps on the same video footage count as creative diversification?

No. Two videos carrying different text on identical footage may test a message difference, but they do not by themselves demonstrate creative diversification, because similar-looking assets can be grouped together by Meta's ranking systems. Iteration is worth doing, but the log should show which questions those variations address rather than inflating the count of distinct ideas.

### How can I tell whether an ad lost a test or simply never got enough budget?

Inspect spend and impressions by concept rather than campaign total, and check whether each concept received enough delivery to support its verdict. An ad that spent $40 of a $400 allocation has not automatically failed. Ask for a numeric kill rule agreed in advance, covering the spend floor, the relationship to target CAC, and the observation window, so underdelivered and lost sit in different rows.

### Can an agency declare a winning Meta ad based only on CTR?

No. CTR is a diagnostic, not a substitute for a business outcome. Connect clicks and leads to qualified enquiries or purchases wherever tracking permits, using signals such as purchase value, qualified enquiry, or booked call, and make sure that signal reaches Meta through the Conversions API or a CRM offline conversions import. A click-metric win still does not make an ad a proven purchase or pipeline winner.

### When should a Meta creative test be judged if customers take a long time to convert?

Meta's A/B test guidance says to extend the test window when the typical customer takes longer than 7 days to convert. A day-three verdict is premature for a purchase that takes two weeks of consideration. Ask when the test stopped receiving spend, when results were judged, and whether the observation window matched the buying process rather than the reporting schedule.

### What should I require from an agency when a creative test ends?

Require one verdict per test, such as keep, retire, retest, or inconclusive, with the reasoning attached and checked against the original hypothesis and judging rule. Inconclusive is legitimate when delivery is too thin. Also name the owner of every unresolved test and next decision before payment, and define the first reporting period's acceptance criteria, including required log fields, scheduled tests, and the business metric for each verdict.

## Run Your Marketing On groas

Plug ChatGPT, Claude or any AI agent into groas and let it do the work of a whole marketing team: free to ask, $49 a month flat with every feature included, and autopilot whenever you’re ready.

[Start Free](https://groas.com/pricing)

[Or have groas run it for you](https://groas.com/done-for-you)

## Structured data

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://graph.groas.com/entity/groas","name":"groas","url":"https://groas.com/","description":"groas is the marketing infrastructure for your own AI: plug Claude, ChatGPT or any AI agent into groas and run all your marketing from it, for a tiny fraction of the usual cost, with the groas app there whenever you want to see more. It is the layer ChatGPT, Claude and any AI assistant run a business’s online marketing on. Through groas an assistant can do anything you could do natively in Google Ads, Bing Ads, Meta Ads and ChatGPT ads, on your website and in AI search, and, where the owner switches it on, can run connected campaigns by itself, so AI agents do the work a whole marketing team used to (free to read, $49 a month to make changes, delivered as an MCP server). Separately, its done-for-you service has senior people and proprietary quantitative systems run paid ads, SEO and AI search for businesses, and white label for agencies, from $5,000 a month.","logo":{"@type":"ImageObject","url":"https://groas.com/icon-512.png","width":512,"height":512},"sameAs":["https://www.linkedin.com/company/groas/"]},{"@type":"WebSite","@id":"https://groas.com/#website","name":"groas","url":"https://groas.com/","inLanguage":"en-US","publisher":{"@id":"https://graph.groas.com/entity/groas"}},{"@type":"WebPage","@id":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing#webpage","url":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing","name":"Before You Hire a Meta Agency: The Creative-Testing Acceptance Checklist","description":"New ads are not proof of testing. Use this 16-point checklist to trace each hypothesis through delivery, spend, business results, and an accountable decision.","inLanguage":"en-US","isPartOf":{"@id":"https://groas.com/#website"},"about":{"@id":"https://graph.groas.com/entity/groas"},"primaryImageOfPage":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/63423439-494b-4f91-988a-0e230111be27.png"},"breadcrumb":{"@id":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing#breadcrumb"},"dateModified":"2026-11-08T05:39:23.240Z","mainEntity":{"@id":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing#article"}},{"@type":"BreadcrumbList","@id":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://groas.com/"},{"@type":"ListItem","position":2,"name":"Blog","item":"https://groas.com/blog"},{"@type":"ListItem","position":3,"name":"Before You Hire a Meta Agency: The Creative-Testing Acceptance Checklist","item":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing"}]},{"@type":"BlogPosting","@id":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing#article","url":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing","mainEntityOfPage":{"@id":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing#webpage"},"isPartOf":{"@id":"https://groas.com/blog#blog"},"headline":"Before You Hire a Meta Agency: The Creative-Testing Acceptance Checklist","description":"New ads are not proof of testing. Use this 16-point checklist to trace each hypothesis through delivery, spend, business results, and an accountable decision.","datePublished":"2026-11-08T05:39:23.183Z","dateModified":"2026-11-08T05:39:23.240Z","image":{"@type":"ImageObject","url":"https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/63423439-494b-4f91-988a-0e230111be27.png"},"author":{"@id":"https://groas.com/author/alexander-perelman#person"},"publisher":{"@id":"https://graph.groas.com/entity/groas"},"keywords":"agency, before, test, acceptance, delivery, ask, checklist, different","wordCount":1886,"inLanguage":"en-US"},{"@type":"Person","@id":"https://groas.com/author/alexander-perelman#person","name":"Alexander Perelman","jobTitle":"Head Of Product @ groas","description":"My background includes Goldman Sachs and Stanford Computer Science.","image":"https://groas.com/media/blog/4f17cac3a81acc224cc1b2cfab8f94bbc295a3089d13e8421125771ef8d4064f.jpg","worksFor":{"@id":"https://graph.groas.com/entity/groas"},"sameAs":["https://www.linkedin.com/in/alexander-433793253/"]},{"@type":"FAQPage","@id":"https://groas.com/post/before-you-hire-another-meta-agency-the-creative-testing#faq","mainEntity":[{"@type":"Question","name":"Is a folder of new ad creatives proof that an agency actually ran creative tests?","acceptedAnswer":{"@type":"Answer","text":"No. A folder of new ads does not establish that creative testing happened. Real testing requires a genuinely different hypothesis, actual delivery and spend, downstream results, and a decision someone owns. Two dozen thumbnails, especially variants of the same footage with different on-screen text, do not show that chain."}},{"@type":"Question","name":"What is the difference between creative iteration and creative diversification in Meta ads?","acceptedAnswer":{"@type":"Answer","text":"Iteration means identical visuals with different text or CTAs, while diversification means distinctly different assets aimed at different personas or use cases. Both have a place in Meta advertising, but they are not interchangeable, and an agency should not invoice for one while presenting it as the other."}},{"@type":"Question","name":"How do I know if my agency wrote a real creative testing hypothesis?","acceptedAnswer":{"@type":"Answer","text":"A real hypothesis states a prediction that can fail, such as renters leaving in the first three seconds because a video reads like an ad, so a price claim up front should hold them. Saying we are testing hooks describes a task, not a hypothesis. If every possible outcome supports the original idea, the agency has written a rationale for making an ad, not a test."}},{"@type":"Question","name":"Do text swaps on the same video footage count as creative diversification?","acceptedAnswer":{"@type":"Answer","text":"No. Two videos carrying different text on identical footage may test a message difference, but they do not by themselves demonstrate creative diversification, because similar-looking assets can be grouped together by Meta's ranking systems. Iteration is worth doing, but the log should show which questions those variations address rather than inflating the count of distinct ideas."}},{"@type":"Question","name":"How can I tell whether an ad lost a test or simply never got enough budget?","acceptedAnswer":{"@type":"Answer","text":"Inspect spend and impressions by concept rather than campaign total, and check whether each concept received enough delivery to support its verdict. An ad that spent $40 of a $400 allocation has not automatically failed. Ask for a numeric kill rule agreed in advance, covering the spend floor, the relationship to target CAC, and the observation window, so underdelivered and lost sit in different rows."}},{"@type":"Question","name":"Can an agency declare a winning Meta ad based only on CTR?","acceptedAnswer":{"@type":"Answer","text":"No. CTR is a diagnostic, not a substitute for a business outcome. Connect clicks and leads to qualified enquiries or purchases wherever tracking permits, using signals such as purchase value, qualified enquiry, or booked call, and make sure that signal reaches Meta through the Conversions API or a CRM offline conversions import. A click-metric win still does not make an ad a proven purchase or pipeline winner."}},{"@type":"Question","name":"When should a Meta creative test be judged if customers take a long time to convert?","acceptedAnswer":{"@type":"Answer","text":"Meta's A/B test guidance says to extend the test window when the typical customer takes longer than 7 days to convert. A day-three verdict is premature for a purchase that takes two weeks of consideration. Ask when the test stopped receiving spend, when results were judged, and whether the observation window matched the buying process rather than the reporting schedule."}},{"@type":"Question","name":"What should I require from an agency when a creative test ends?","acceptedAnswer":{"@type":"Answer","text":"Require one verdict per test, such as keep, retire, retest, or inconclusive, with the reasoning attached and checked against the original hypothesis and judging rule. Inconclusive is legitimate when delivery is too thin. Also name the owner of every unresolved test and next decision before payment, and define the first reporting period's acceptance criteria, including required log fields, scheduled tests, and the business metric for each verdict."}}]}]}
```
