NEXSUM_LABS
  1. Home
  2. Work
  3. A SaaS vendor measured its brand-search spend honestly and moved half the budget
Book a call

[ Case study ]

SaaSGoogle AdsGeo-holdout testAuction insightsQuery-level attribution

A SaaS vendor measured its brand-search spend honestly and moved half the budget

The account's best 'performing' campaign was brand search — near-100% ROAS, uncontested, beloved. Competitors had started bidding on the brand name, so 'defensive' spend had doubled. Nobody could say how much was defense and how much was paying for customers who were coming anyway.

CLIENT a B2B SaaS vendor with strong brand demand — FOCUS Test the brand campaign with holdouts

Google AdsPaid MediaGoogle AdsSaaSRepresentative example
Client
a B2B SaaS vendor with strong brand demand
Industry
SaaS
Engagement
5 weeks — growth pod — paid search specialist
Service
Paid Media / Google Ads
Headline outcome
Brand-search spend after the holdout, with branded-organic sessions unchanged (within 2%): −52%, read from Holdout results + Search Console

Representative examplesEvery case study in this library is an illustrative composite of the kind of engagement we deliver — written to show our method and standards, not to name clients.

Where they started

Growth at the B2B SaaS vendor had made the brand name a shorthand in its niche, and branded search volume reflects it — prospects arrive at Google already primed, typing the product's name. Sales runs demo-led, the CFO reviews marketing monthly, and competitor ads against the brand had multiplied over a year. Brand search was the account's untouchable line: near-perfect reported ROAS, defended by the logic that competitors were bidding on it, growing without a measurement in sight.

What it was costing

The account's best 'performing' campaign was brand search — near-100% ROAS, uncontested, beloved. Competitors had started bidding on the brand name, so 'defensive' spend had doubled. Nobody could say how much was defense and how much was paying for customers who were coming anyway.

What they could see

  • Brand-search spend had doubled across the year with no change in the branded traffic the site's analytics reported.
  • The campaign's near-perfect ROAS made it untouchable — any suggestion to examine it died against the number itself.
  • Competitor ads sat above the organic result on brand queries most mornings, and the response had always been to bid higher.
  • The CFO began asking what portion of the line was defense versus customers who were coming anyway; nobody had an answer.

The constraints we worked inside

  • Competitor bidding on the brand was real and growing — some defense had merit.
  • The CFO wanted the budget line justified; faith-based ROAS would not survive the meeting.
  • Pausing brand search entirely was too risky — a competitor would fill the space.

What had been tried before

Brand bids were raised reactively whenever competitor ads appeared on the brand name.
Reactive raising pays competitor-auction prices across every brand query, including the many where organic already wins — defense priced like panic.
Brand search was paused globally for a single day as a test.
One day mixes weekday patterns, hands competitors a free window, and produces numbers too coarse to separate organic capture from paid defense.
A spreadsheet estimate of organic-versus-paid overlap was prepared for the CFO meeting.
Assumed capture rates dressed as math; the meeting needed measured evidence, and modeled opinion collapsed the first time someone asked where a number came from.

What we proposed

We proposed measuring the brand line like an insurance policy. A two-week geo holdout — ads paused in matched regions — would separate organic capture from paid defense. Where the holdout showed no loss, organic-only brand queries would come out of paid; where competitors were live, bids would reset to a cost-per-defense basis on competitor-triggered queries. The budget line would then report competitor impression share and defensive win rate instead of a near-perfect ROAS nobody trusted once examined.

Just as important is what we ruled out, and why:

  • Raising bids on all brand queriesBlanket raises pay competitor-auction prices on every brand search, including the majority where organic already captures the click.
  • Pausing brand search entirelyThe constraint ruled this out upfront; competitors were actively bidding and an empty slot on the brand name was a real risk to demo-day revenue.
  • Trademark complaints as the remedyComplaints take weeks, apply unevenly across regions and reseller exceptions, and do nothing about the spend already committed while waiting.

How the work ran

01Test the brand campaign with holdouts

A two-week geo holdout (and a temporary pause in matched regions) measured organic capture versus paid defense — the incrementality question, answered directly.

02Rebuild the line as measured defense

Brand bids reset to a cost-per-defense basis on competitor-triggered queries, with organic-only queries excluded from paid where the holdout showed no loss.

03Report defense like an insurance line

The budget line reports on competitor impression share and defensive win rate — the honest framing replaced the flattering ROAS.

Delivered by the growth pod — paid search specialist over 5 weeks, with working increments reviewed with the client every week.

The stack, and the reasoning

Google Ads
Brand defense happens in this auction whether we like it or not — the work was measuring it, and the levers live in the account.
Geo-holdout test
Pausing in matched regions separated organic capture from paid defense, the one question the account's ROAS numbers could never answer.
Auction insights
Competitor impression share on brand terms became the defense metric — it prices the threat without needing competitor spend estimates.
Query-level attribution
Splitting competitor-triggered from organic-only brand queries let the line pay for defense only where defense is real.

What went wrong

Obstacle

One holdout region hosted a local industry event during the test window, and its conversion spike muddied a week of the read.

Handled: We extended the window to absorb the contamination, excluded the affected week from the paired analysis, and the final read used matched-week comparisons only.

Obstacle

Sales noticed brand ads missing in holdout regions mid-test and escalated, worried about demo-day pipeline in exactly those territories.

Handled: We briefed the sales lead on the design before the next check-in, gave them a daily branded-organic monitor for the holdout regions, and the concern died when traffic held.

Obstacle

A second competitor entered the brand auction mid-holdout with aggressive copy, changing the very condition the test was trying to price.

Handled: We logged the change, kept the holdout running as designed, and folded the new entrant into the defense-basis pricing — the measurement captured reality rather than pausing for it.

How we worked together

Cadence
A weekly thirty-minute call with the marketing lead during the holdout, then fortnightly; the CFO joined two sessions — one before the test, one after the result.
Client side
The marketing lead owned the account; the sales lead received a daily branded-traffic summary during holdout weeks and returned one question, once.
Decisions
The CFO approved the decision rule in the pre-test session; the result then executed itself — the meeting after was shorter than the one before.
They provided
Analytics access for branded-organic monitoring, sales-team buy-in for the holdout regions, and the CFO's explicit tolerance for two weeks of unoptimized brand spend.

What changed

The headline: brand-search spend after the holdout, with branded-organic sessions unchanged (within 2%)−52%, read from Holdout results + Search Console. A second check: competitor impression share on brand terms (defense working, cheaper) at 94% → 71%.

The brand line gets discussed as insurance, with a premium and a coverage level, instead of being defended by a ROAS figure nobody believed. The CFO's monthly review runs faster because the number presented is the one he asked for. Sales stopped noticing brand-ad gaps because the defense now concentrates exactly where competitors actually bid. The marketing lead describes the account as spending where the fight is — and the spend that vanished was never doing defensive work at all.

The result was read from Holdout results + Search Console against the pre-engagement baseline over the stated window, with a guardrail check on competitor impression share on brand terms (defense working, cheaper). Where platform-reported numbers and business outcomes differ, this record says which layer it is quoting.

What they own now

  • The cost-per-defense bidding structure on competitor-triggered brand queries.
  • The geo-holdout methodology and results, archived for the next incrementality question.
  • The defense reporting format — competitor impression share and win rate — for the CFO pack.
  • Query-level attribution setup separating competitor-triggered from organic-only brand traffic.
  • Auction-insights monitoring routine with thresholds for when defense bids adjust.

What we would do differently

We would have sized the holdout regions against seasonality — one region's local event muddied a week until the window was extended.

Paid MediaGoogle AdsSaaSGoogle Ads

Next case study

An emergency plumber stopped paying for clicks at 3am and started paying for calls