Quick answer
Use comparable eligible groups and one cost definition. This worksheet normalizes the arithmetic; it does not verify randomization or infer statistical confidence from totals. Read the method.
Source context: Zettler Digital, measuring email and SMS incrementality; Common Thread Collective, measurements for profitability.
Reconcile the group totals.
Use the number of eligible shoppers assigned to each group, including those who did not buy. Use the same observation window, net-revenue definition and order-cost treatment. Check duplicate orders and subscription renewals before entering totals.
Costs not already included in either group’s variable order costs. Enter zero explicitly if none apply.
This scales control contribution to the treated group’s size. Arithmetic does not verify the experiment or establish statistical confidence.
The worksheet will show both group contributions, the scaled control and the cost deduction.
Check the comparison before the number.
A group difference needs a suitable design to support a causal interpretation. Confirm how shoppers were assigned, whether groups could receive the other treatment, and whether eligibility or tracking changed during the period.
- Contribution per eligible shopper
- Group net revenue minus group variable order costs, divided by eligible shoppers. Use the same unit in both groups.
- Normalize before subtracting
- Multiply the control contribution per eligible shopper by the treated group count. Subtract that value and additional program costs from treated contribution.
- What totals leave out
- Totals do not contain person-level variation, so this worksheet cannot calculate confidence intervals, statistical power or a reliable test duration. A positive estimate alone is insufficient evidence.
- Count each cost once
- Refunds and discounts already deducted from net revenue stay there. Product, payment and fulfillment costs belong in the order-cost definition. Additional program fees go in the program-cost field only if they have not been counted elsewhere.
Check a shopper conversation.
A helpful-sounding reply can still use the wrong fact or take an unauthorized action. Write the expected behavior from the merchant’s actual policy and permissions, then record what happened. An empty or unrun case is not a pass.
No cases recorded in this session.
Download the measurement templates
Group measurement sheet
Empty fields for consistent groups, costs, period and reconciliation notes.
Download group sheet, CSVConversation case sheet
Verified facts, permissions, expected behavior and actual observations.
Download case sheet, CSVCost input sheet
Keep the additional program cost separate from costs already counted.
Download cost sheet, CSVMethod and source notes
Use the same definitions in the tool, spreadsheet and review.
Download method, MarkdownSources and scope
- Zettler Digital, measuring email and SMS incrementality. A practical group and order-reconciliation method. This worksheet does not inherit a universal test duration or holdout size.
- Common Thread Collective, measurements for profitability. Revenue, costs and valid experimentation answer different parts of the decision.
- Red Stag, interpreting cart abandonment. Cart counts and attributed orders do not establish recoverable revenue or additional profit.
These sources explain the definitions and measurement principles used here. The worksheet applies the arithmetic to the values you enter.
Your entries stay in your browser
Amounts and case records are processed in your browser. Your entries are not sent to a server or saved between visits. Export the record to keep it.
Set up your next conversation case
Use the case sheet to record the shopper task, verified facts, permissions and actual observations.
Download case worksheetPublisher disclosure
Zobi publishes this worksheet. Your entries are processed in your browser, not sent to a server. The calculations apply the stated definitions to the values you enter.
Tell us about your store.
Start growing revenue