Produce a Stakeholder Summary
Lead with the decision and its conditions. A compact summary should include:
- treated geography, outcome, launch, cooldown, and measurement dates;
- eligible donor universe and material exclusions;
- design-stage MDE at the stated target power and plausible lift range;
- inference status, ATT in outcome units, interval, p-value, and placebo count;
- pre-period fit and donor concentration;
- concurrent media, spillover, data, and sensitivity caveats;
- a clear recommendation: proceed, interpret cautiously, redesign, or reject.
Example:
GeoSC estimated average incremental revenue of £X per week against the pre-specified SparseSC counterfactual over dates A–B. The two-sided in-space placebo p-value was P using N placebo assignments; the interval was [L, U]. Interpretation is conditional on the recorded donor-eligibility and treatment- isolation assumptions. The design-stage grid-based MDE was M% at T% target power, so effects below M% were not reliably detectable under the fitted DGP.
Do not translate statistical significance into ROI without campaign cost and a
commercial value definition. Do not describe status: ok as proof of causal
validity.
Use the interval level recorded in ci.level, independently of the configured
significance threshold. An 80% average-ATT interval must not be labelled 95%,
and its bounds must remain in the ATT’s unscaled outcome units. Scaled
diagnostic bounds cannot fill missing primary uncertainty. The uplift plot’s
horizontal band concerns average ATT uncertainty, not coverage of the effect
path.
For partial results, retain warnings and state which quantities remain
available. For failed or unknown status, report errors and unavailable
inference instead of interpreting retained diagnostic numbers. Read
significance_available before the stored significant flag; an unavailable
decision is not evidence of no effect. The maintained renderers apply these
rules consistently and the HTML report escapes artifact-derived text.