How to Build a Pharma Media Performance Narrative Without Cherry-Picking
How to write a pharma media performance narrative that uses predeclared criteria, includes contrary signals, and states uncertainty plainly.
The short answer
Every campaign report tells a story. The risk is that the story is chosen first and the data is chosen to fit it. The best metric is highlighted, weak results are left in an appendix, and the conclusion is always "the campaign worked." This is cherry-picking, and it erodes trust over time. A performance narrative that includes contrary signals and states uncertainty is more credible and more useful.
Declare criteria before results
The most effective defense against cherry-picking is deciding before launch what success looks like:
- Primary KPI and target.
- Secondary KPIs.
- What result would lead to scaling, holding, or cutting.
Then report against those criteria, even if other metrics look better. The ASA's statement on p-values warns against selective reporting of analyses.
Structure of an honest narrative
- What we set out to do. The objective and predeclared criteria.
- What happened on the primary KPI. With uncertainty stated.
- What supported the result. Secondary signals pointing the same way.
- What contradicted it. Signals pointing the other way.
- What we cannot conclude. Limits of the data and design.
- What we recommend. Tied to the criteria.
Sections four and five are the ones most often missing.
Build an evidence table
| Signal | Direction | Strength | Notes |
|---|---|---|---|
| Incremental NRx lift | Positive | Moderate; interval includes small effects | Primary KPI |
| Target-list reach | Positive | Strong | Above plan |
| Site engagement | Neutral | Moderate | Flat versus prior year |
| Partner B outcome | Negative | Weak; small sample | Investigate before acting |
Illustrative entries. A table like this lets readers see the full picture at a glance.
Label claim strength
Use language that matches the evidence:
- "Media caused" only with a credible counterfactual design.
- "Associated with" for attributed results.
- "Suggests" for weak or small-sample signals.
See attributed vs. incremental prescriptions and statistical significance vs. commercial importance.
Why honest narratives win
Stakeholders notice when every report is positive. Over time, they discount all of them. A team that reports mixed results honestly builds credibility that makes its strong results more believable. It also makes better decisions, because weak spots are visible.
Practical takeaway
Add a "what contradicted this" section and an evidence table to every performance report. If there are no contrary signals, say so explicitly and explain how you looked for them.
Sources
External guidance and platform documentation change. Links were current at publication; check them again before relying on them for a decision.
Editorial note. Analysis and frameworks are the author's own and do not represent Acxiom or any current or former employer, client, or named platform. Examples labeled hypothetical or illustrative are not results from real campaigns. Nothing here is legal, regulatory, or medical advice.
New pharma programmatic breakdowns, occasionally
One email when I publish something worth reading. Benchmarks, measurement teardowns, and case studies with the caveats attached. No cadence promises, no reselling your address.
Unsubscribe any time. See the privacy policy.
Working through this decision on a real plan?
I work on health and pharma data, identity, and activation, after five years running HCP and DTC programmatic agency-side. Happy to talk through how this applies to your situation.