Every agency on the planet now claims to "use AI." Very few can show you what that means in leads, booked calls, and revenue. We run an AI marketing agency. We've generated 50,000+ leads across 43+ industries with 7,000+ AI-produced ads. So this checklist is written from the inside: the questions we'd ask if we were hiring one, including the ones that would disqualify us if we couldn't answer them.
The core economic advantage of AI marketing is testing volume. A traditional agency ships 1 to 3 polished creatives per cycle; a real AI operation ships 10 to 40 variants and lets paid-media data pick the winner. Ask to see an actual campaign's creative grid. Not a showreel. If they can't show you dozens of variants per concept, they're a traditional agency with an AI logo.
Generic AI content loses to whoever did their homework. The agencies that win run a research layer before production, mining sales calls, intake questions, and objection patterns so every hook names a moment the buyer is actually living. Ask: "What would you need from us before writing a single script?" If the answer is "your brand guidelines," walk. If the answer involves your sales calls, your intake team's most-asked questions, and your lead form data, you're talking to operators.
AI marketing is a performance loop, not a deliverable. Winning creative should be identified and scaled within days, losers killed, and learnings fed into the next batch. If the agency's plan is "we'll report monthly, " the loop is broken. You're paying AI-era prices for traditional-era iteration speed.
Most agencies stop at the form fill. The revenue is in what happens next: follow-up speed, qualification, and booking. Ask whether they build the full system, ads, follow-up automation, AI voice agents for speed-to-lead, calendar booking, or just the traffic. A lead that waits hours for a callback is a lead your competitor already called. (This is why we build the full Lead Machine system, not just campaigns.)
Anyone can demo results in an easy niche. Ask for proof in industries where the buyer is skeptical, regulated, or expensive to reach, legal, medical, finance. Real example from our own book: an employment law firm generating 35+ on-target leads a week, and a funding company that produced 12,765 leads at a 57.9% qualification rate. Whatever agency you evaluate, make them show you case studies with numbers, not adjectives.
You should own the ad accounts, the creative, the lead data, and the tracking. Some agencies hold campaigns hostage inside their own accounts, leaving means starting over. Get asset ownership in writing before signing anything.
AI marketing compounds: each testing cycle sharpens the next batch of creative. An honest agency will describe a flywheel, hooks that emerged, angles retired, costs trending down. A dishonest one will promise month-1 miracles. Ask for the trajectory, not the launch.
| Signal | Real AI marketing agency | AI-washed agency |
|---|---|---|
| Creative per cycle | 10 to 40 tested variants | 1 to 3 polished spots |
| Script source | Your sales calls & buyer data | Brand guidelines |
| Iteration speed | 48 to 72 hour creative loop | Monthly reports |
| Post-click | Follow-up + booking system | Traffic only |
| Proof | Case studies with numbers | "AI-powered" homepage |
| Asset ownership | Yours, in writing | Theirs, hostage |
How much should an AI marketing agency cost?
Meaningfully less than traditional production for far more output, see our full breakdown in What does an AI marketing agency cost?
How fast should I expect results?
Testing signal in days, reliable lead flow inside the first month, compounding improvements from there. Distrust both "overnight" and "give it six months before judging anything."
Is AI-generated creative allowed on Meta and Google?
Yes. The platforms care about policy compliance and performance, not production method. Disclosure rules apply in some categories (e.g., political), a competent agency handles this.
What's the single best predictor of a good agency?
Whether their questions to you are better than your questions to them.
Ready to hold us to our own checklist? See how the Lead Machine works or watch real client breakdowns on our case studies page.
AI video ads earn the click, AI voice agents earn the sale. See why running them as one connected system beats hiring a video shop and a voice vendor
One yacht brokerage went from months of dead leads to $10 qualified leads. Here's the AI marketing system built for fractional and luxury yacht owners
A savings audit only works if the business owner actually opens it. Here's how AI marketing gets a skeptical CFO to trust a payment processing pitch.