AJO journey-level holdout: the feature that sends nothing – and proves everything

This week, Adobe ships a feature that does… nothing. It sends no emails. No SMS. Nothing at all – to a slice of your customers. On purpose. And it might be the most valuable thing in the entire August release.

The feature is called journey-level holdout, part of Adobe Journey Optimizer‘s August 18 update – Limited Availability for now, meaning your Adobe contact has to enable it.

The idea, borrowed from medicine

New drugs aren’t approved because patients “felt reached.” They’re tested against a group that gets no treatment – the difference between the groups is the proof. Marketing almost never does this: everyone gets the campaign, so there is nothing to compare against. Which means “our journeys drove €2M this quarter” is usually a belief, not a measurement.

What shipped, exactly

• Journey-level holdout (Aug 18–19, Limited Availability): set a percentage directly on a journey; that share of the target audience is excluded from entering the journey and receives no communication from it.
• Measurement: lift is read in Customer Journey Analytics by comparing holdout profiles against active profiles.

The architecture behind it

The holdout is configured in journey properties – an entry-level exclusion, not a message variant. That is exactly why A/B tests never answered this question: a content experiment compares message A against message B, and both groups get something. It tells you which message wins – never whether the journey should exist at all. The journey-level holdout is the missing control group.

Why this matters for the budget round

When a CFO asks what the marketing platform contributed this year, “we sent 40 million messages” is activity. “Customers in journeys spent 12% more than identical customers who weren’t in them” is an answer. The CMOs who deliberately hold customers back will win the 2027 budget rounds; the ones reporting opens and clicks will keep explaining themselves.

Questions to settle

1. Which journeys get a holdout first – the expensive ones, the contested ones, or the ones you’re proudest of?
2. What holdout share can you defend – 5% is statistically thin on small audiences, 10% hurts on revenue journeys.
3. Is CJA set up to compare holdout vs. active profiles on the metrics the CFO actually cares about?
4. Who is allowed to see the result – and what happens if a flagship journey shows no lift?

Would you dare to hold back 10% of your best customers to prove your marketing works?

Also in AJO’s August timeframe: quiet hours now cover Orchestrated Campaigns · content simulation renders every variant in one grid.

Frequently asked questions

What is a journey-level holdout in Adobe Journey Optimizer?

A percentage set directly on a journey. That share of the target audience is excluded from entering the journey and receives no communication from it. The feature shipped on 18 and 19 August 2026 in Limited Availability, which means an Adobe contact has to enable it.

How is a holdout different from an A/B test?

An A/B test compares message A against message B, and both groups receive something. It tells you which message performs better, never whether the journey should exist at all. The journey-level holdout is configured in journey properties as an entry-level exclusion, which makes it the control group an A/B test cannot provide.

Where is the lift from a holdout measured?

In Customer Journey Analytics, by comparing holdout profiles against active profiles – not in journey reporting. That means the measurement has to be set up on the metrics the business actually cares about before the first holdout runs.

Sources: Adobe Journey Optimizer release notes and pre-release notes on Adobe Experience League, August 2026. Adobe, Adobe Journey Optimizer and Customer Journey Analytics are trademarks of Adobe Inc. This is an independent analysis; no partnership with or endorsement by Adobe. First published as part of my LinkedIn series, August 2026.