Live Dashboard · A/B Test

AIA Save Flow Dashboard

Last refreshed:
Auto-refresh: every hour · Test launched · Day
01

The top-line numbers

All members assigned to either variant, May 26 onward
Total in cancel flow
Members who hit the save offer (any variant)
Total accepted
overall accept rate
14-day accept rate
of assigned
30-day accept rate
of assigned
02

Variant performance

Accept rate by pause length, with lift

Side-by-side accept rate

14-day pause
accepted  ·  declined
30-day pause
accepted  ·  declined
30-day advantage — ~ more acceptances per 1,000 members shown the offer

Variant table

Variant Assigned Accepted Accept rate
14-day pause
30-day pause
Total

Lift vs control (14-day): on accept rate · ~ relative increase

03

Trial vs paying at decision time

Member status when offer was shown

2 × 2 — Status × Decision

Accepted
Declined
Total
Trial
of trial
of trial
members
Paying
of paying
of paying
members

Composition view

Who is being asked, and who is saying yes.

All members in cancel flow — status mix total
Trial
Paying
Accepters — status mix total
Trial
Paying
Decliners — status mix total
Trial
Paying
04

Variant × status × decision

The 4-row read — does the lift hold within each segment?
Variant Member status Assigned Accepted Declined Accept rate Visual
14-day Trial
14-day Paying
30-day Trial
30-day Paying

Within-segment lift — trial: · paying: . The 30-day variant wins in both segments.

05

Post-pause outcomes

2 anomaly members excluded from this section
14-day cohort
Live tracking
of accepters have hit their first post-pause billing decision
of cohort · first post-pause bill landed
Conversion rate at billing moment: · pending accepters:
Paid — billed and active ()
Cancelled at billing ()
Past due — payment failed ()
Pending accepters are parked in an extended billing window — Stripe attached the pause to the END of their natural trial/billing date, so their first post-pause bill hasn’t fired yet. Next pending bill: .
of the pending accepters above have opted to cancel after receiving the save offer but their billing hasn’t fired yet. They’ll land in cancelled when their period ends. Median time from accept → cancel: days.
Time from save-accept → flipping to cancel
Same day
()
1–3 days
()
3–7 days
()
1–2 weeks
()
2–4 weeks
()
30+ days
()
30-day cohort
Live tracking
of accepters have hit their first post-pause billing decision
of cohort · earliest acceptance:
Conversion rate at billing moment: · pending accepters:
Paid — billed and active ()
Cancelled at billing ()
Past due — payment failed ()
Next pending bill: . 30-day pauses are added to the END of each accepter’s natural trial/billing date.
of the pending accepters above have opted to cancel after receiving the save offer but their billing hasn’t fired yet. They’ll land in cancelled when their period ends. Median time from accept → cancel: days.
Time from save-accept → flipping to cancel
Same day
()
1–3 days
()
3–7 days
()
1–2 weeks
()
2–4 weeks
()
30+ days
()
06

Daily volume since launch

Stacked: accepted (green) + denied (red) = total assigned per day
Accepted Denied Total assigned = sum
Avg daily assigned: Peak day: ( assigned) Trend last 3 days: