You're paying somewhere between four and twenty thousand dollars a month for search work, and the only proof you get is a PDF. That PDF decides whether the retainer renews, whether the CFO keeps funding the channel, and whether anyone inside the business trusts what the agency is doing. Most of the ones hitting inboxes right now are decorative. Rankings went up. Impressions went up. A Search Console screenshot, a chart with no context, a line about "continued optimization." None of it tells you whether the money is working.
A monthly report is the clearest artifact an agency produces. Read it correctly and you can tell, inside ten minutes, whether the team behind it is moving the business or performing motion. Read it the wrong way and you'll re-sign a contract you should have canceled two quarters ago.
The Vanity Dashboard Is the Default
Open a typical monthly SEO deliverable and count the slides before you see a revenue number, a pipeline number, or even a conversion tied to a specific page. Usually you count all of them. The report opens on keyword position changes, then a total impressions chart, then a domain authority score, then a list of backlinks acquired. By the time anything resembling business impact shows up, the reader has already formed an opinion, and that opinion is shaped by whichever number went up the most.
This is by design. Vanity metrics are easier to move, easier to visualize, and hard to argue with on a monthly call. Impressions climb when Google shows your pages more often, even if nobody clicks. Rankings climb when you target easier terms, even if nobody searches for them with buying intent. Backlink counts climb when someone runs a low-effort outreach campaign to sites that will rarely send you a customer. Every one of those charts can trend up while the pipeline the channel is supposed to fill sits flat.
The awkward part is that some of that data does matter. Impressions and average position aren't fake numbers. They come from real sources like Search Console, which is the underlying instrument any competent report is built on. The raw data is fine. The tell is what the agency chose to put on page one and what they left off entirely.
Read the Report Backwards
The most useful habit a client can develop is reading the monthly deck from the last page to the first. The final slide is usually where the work actually lives: what shipped, what got fixed, what was written, what got linked. Start there. Then work backwards to see whether the metrics on page one can plausibly be caused by that work.
A few things to look for as you go:
- Named pages, not page counts. A strong report tells you which URLs were touched, why, and what happened to their traffic and conversions afterward. "Optimized 14 pages" tells you nothing. Naming the specific URLs rewritten, the queries they now rank for, and the movement in conversion rate on each one tells you everything.
- Non-brand as its own line. Branded and non-branded organic should be reported separately, every month, without you having to ask. If they're blended, you can't tell whether the agency is capturing existing demand or building new demand.
- A visibility view that includes AI surfaces. Google now reports impressions and clicks from AI Overviews and AI Mode inside its generative AI reports. A modern dashboard shows what's happening there, not only the classic ten blue links.
- A losses section. Every real SEO program has pages that dropped, experiments that failed, and rankings that slipped. A report with no losses has been edited for the client's feelings, and it means you're not seeing the full picture.
- A next-month plan tied to a hypothesis. "We'll publish four posts and build ten links" is activity. "We believe the /solutions cluster is under-indexed relative to demand; we'll rebuild internal linking and expect impressions on those URLs to rise within six weeks" is a hypothesis. One is a to-do list. The other is thinking.
One Question Separates the Good Ones From the Rest
At your next monthly review, ask this: "Which specific piece of work on this report did the most to move a business metric, and how do you know?" Then stop talking.
A good agency will answer with a page, a query cluster, or a technical fix, plus the before-and-after numbers and a plain-English walk through the causal chain. A mediocre one will pivot to totals, wave at a trend line, or explain that SEO is a long game and attribution is complicated. Both of those things are true. Neither is an answer to the question. The response you get is a more honest signal than any chart in the deck, and it's the fastest way to sort operators from performers.
If you want a broader frame on what to look for when evaluating an what to look for when evaluating an SEO agency agency, the monthly report is the artifact where those qualities either show up or don't. Everything else is a sales conversation. The dashboard is the audit.
