[ Case study ]
Retargeting was the account's celebrated star: 8× reported ROAS, the slide the board loved. The new CMO suspected the number, since most of those users had the item in their cart already.
CLIENT a demi-fine jewelry brand — FOCUS Run the holdout the skepticism demanded
Representative examplesEvery case study in this library is an illustrative composite of the kind of engagement we deliver — written to show our method and standards, not to name clients.
Demi-fine jewelry lives on repeat gifting and trust, and the brand had grown into a solid direct business with a strong December. Retargeting was its most celebrated marketing line — the board saw the platform ROAS number quarterly and had built budget expectations around it. A new CMO arrived from a performance-marketing background, pulled the audience definitions, found cart abandoners dominating the retargeting pools, and inherited the task of telling a room its favorite slide might be arithmetic luck.
Retargeting was the account's celebrated star: 8× reported ROAS, the slide the board loved. The new CMO suspected the number, since most of those users had the item in their cart already.
We proposed answering the CMO's suspicion with a pre-registered experiment rather than an argument. Matched geo pairs would run with and without retargeting for four weeks, sized to read a result but small enough not to ruin peak-season groundwork. The design and the decision rule went to the board before launch. When the measured number returned, budget would re-weight toward prospecting creative, and the board pack would report platform ROAS and incrementality side by side from then on.
Just as important is what we ruled out, and why:
Matched geo pairs ran with and without retargeting for four weeks, sized large enough to read the result — the test was pre-registered with the board before it started.
Incremental ROAS came in at 1.3× — real but far from 8×. Budget re-weighted toward prospecting creative with the found money.
The board pack now shows platform ROAS and incrementality side by side — the gap is the metric.
Delivered by the growth pod — paid social specialist over 6 weeks, with working increments reviewed with the client every week.
Obstacle
Matching geo pairs proved tougher than the account's size suggested — several candidate regions were unbalanced in seasonality or email-list density, bad pairs would have poisoned the read, and the business refused to leave its strongest region dark for the test window.
Handled: We rebuilt the pairs from two seasons of order data rather than ad-platform geography alone, dropped the unmatchable regions and the one the business would not surrender, and sized the holdout on what remained.
Obstacle
The pre-registered decision rule was challenged after the result arrived — the measured incrementality drew a proposal to re-run the test until the number improved.
Handled: The registration document, signed before launch, settled it: the budget re-weighting proceeded as pre-agreed, and the dual reporting format made the debate unnecessary going forward.
Obstacle
EU-region consent gating cut the Conversions API match quality well below the domestic figures, shrinking the usable signal for value-based bids there.
Handled: We modeled those regions separately rather than blending them into the optimization signal, keeping the domestic bidding honest and the European read honest too.
The headline: retargeting's measured incremental roas versus its platform-reported one — and the honest number changed the budget — 8× → 1.3×, read from Pre-registered geo-holdout test. A second check: new-customer revenue share of paid-attributed sales, following quarter at +21%.
The board pack carries two numbers side by side now, and the room reads them without argument — the CMO calls the pre-registration the most valuable hour of the engagement. Budget conversations moved from defending the retargeting slide to funding prospecting with intent. The marketing team stopped celebrating platform ROAS internally, and new-customer growth became the shared scoreboard. The skepticism that started the project hardened into a permanent habit: every claim now expects a control.
The result was read from Pre-registered geo-holdout test against the pre-engagement baseline over the stated window, with a guardrail check on new-customer revenue share of paid-attributed sales, following quarter. Where platform-reported numbers and business outcomes differ, this record says which layer it is quoting.
What we would do differently
We would have pre-agreed the decision rule with the board ('below 2× means re-weight') — the argument after the result was avoidable.
[ Related service ]
[ Related builds ]
−33%Cost per qualified enquiry over the quarter versus the prior one, on verified conversion tracking
0.8s 2.3sAverage 3-second hold rate on ads (proxy for hook survival), cohort over cohort
[ Next step ]
Next case study