Engagement Levers¶
What drives retention and engagement — and what doesn't. Critical distinction: correlation vs. causation determines how to use each finding.
Challenges: The Retention Engine (F004, F012)¶
Challenges are load-bearing retention infrastructure. They are NOT revenue growth levers.
The Correlation (What It Looks Like)¶
| Product | Challenge Users | Avg Spend | Non-Challenge Avg | Multiplier | Participation Rate |
|---|---|---|---|---|---|
| NBA Top Shot | 2,178 | $5,449 | $275 | 20x | 14% |
| NFL All Day | 8,141 | $2,921 | $118 | 25x | 30% |
NFL has both higher participation (30% vs 14%) AND a stronger multiplier (25x vs 20x). NFL's challenge mechanics are more accessible and more compelling.
The Causation (What Actually Happens)¶
Matched-control analysis (228 Set Challenge participants vs. 2,221 non-participants at same $10K+ lifetime spend level):
- Retention: Challenge participants retain at 93.9% vs 82.1%. +11.8 percentage points.
- Spend: Similar average spend at top decile ($1,109 vs $1,164). Controls have $0 median post-spend (they churned). Challengers have $577 median (they stayed).
Challenges prevent churn. They do not cause spending. The 20x multiplier reflects self-selection: high spenders discover challenges, not the other way around.
Do Not Project Revenue From Challenges
"If we get 1,000 new challenge participants at $5,449 each = $5.4M" is WRONG. The $5,449 reflects who challenge participants are, not what challenges cause. The correct projection: each retained whale protects ~$137K/year at $2,648/week avg XL spend. Use the +11.8pp retention number, not the 20x spend number.
Off-Season Survival Effect (NFL)¶
Challenge-active NFL users survive the off-season at 92.9% vs 63.6% for non-challengers — a +29 point gap.
This makes challenges the single most important lever for the off-season whale retention crisis (see Whale Economics). Getting users INTO challenges before the off-season starts is the critical intervention.
Disney Trading Engine (F007)¶
Disney has no challenge mechanic. Its engagement engine is trading.
| Trade Count | Avg Spend | Multiplier |
|---|---|---|
| 0 trades | $107 | 1x baseline |
| 1-10 trades | ~$1,000 | ~9x |
| 50+ trades | $23,286 | 218x |
Trading drives M→L upgrade at 57x the rate of non-traders. 22% recent participation rate among Disney users.
The Timing Problem¶
70% of Disney traders start 90+ days after first purchase. But Disney's pipeline bleeds users at the M tier weekly (51% M→S regression). Users don't survive long enough for trading to activate.
This is why the Best Pals content spike (F014) failed: 5,617 buyers acquired, 98.1% never traded, churned. The 1.9% who traded averaged $5,408 and 48 are still active.
Required Intervention¶
Disney needs a mechanism to activate trading within the first 30 days:
- Trading events in the first week post-purchase
- Post-purchase trading prompts ("Your pin is worth $X — trade for something you want")
- Sets designed to require trading to complete
- Genesis Keys tied to trade milestones
The May 4th Star Wars event must include a trading mechanic or expect Best Pals-level churn.
VIP Deposit Match: 2.7x ROI (F015)¶
The most efficient direct reactivation lever tested across all products.
- 2.7x ROI — every dollar spent on deposit matches generates $2.70 in return
- Self-funding: sustainable as a recurring program, not a one-time experiment
- Particularly valuable during off-season when whales are at highest churn risk
Who to Target¶
At ~109 point-in-time XL users and ~71 borderline L/XL oscillators, the VIP program is a manageable scale for personalized deposit match offers.
IRL Events: 317-Day Reactivation (F016)¶
Physical experiences convert and reactivate at rates no digital channel matches:
- 99% signup completion rate at in-person events
- 317-day dormant reactivation — a user inactive for nearly a year came back through an IRL event
These are the "forgot about the hobby" users — not competitive losses, but relevance losses. Physical presence re-creates emotional connection that emails, push notifications, and pack drops cannot.
Strategic Implication
IRL events should anchor the pre-off-season calendar. The off-season (June-September) is when XL whales are most at risk of permanent churn. A summer IRL event targeting XL/L whales and lapsed $1K+ users combines highest-risk timing with highest-conversion channel.
Mass Common Burns: Zero Impact (F018)¶
160x more Common moments were burned compared to Rare burns. Zero differential marketplace lift.
| Burn Tier | Avg Daily Burns | 7-Day MP Transactions | 7-Day MP Volume |
|---|---|---|---|
| Common | 6,255 | 20,800 | $420K |
| Rare | 333 | 21,505 | $415K |
| Legendary | 39 | 21,478 | $417K |
Why it doesn't work: At $2 median Common price, burning 100K Commons removes $200K of theoretical value from a marketplace doing $400K+/week. The 2.5M Common listings represent 45 months of inventory at current velocity. Burning is invisible against that denominator.
Stop Mass Common Burn Programs
Redirect engineering effort toward high-end burn events (Rare/Legendary) designed as spectacle. Whale burns create vicarious excitement and signal market conviction. Low-end burns are burning noise, and burning noise is still noise.
Set Challenges are a more effective supply reduction mechanic: each completion removes ~200 Commons from circulation while also serving as retention infrastructure.
Summary: Lever Effectiveness¶
| Lever | Type | Evidence Level | Effect Size | Best Use |
|---|---|---|---|---|
| Challenges | Retention | CAUSAL (matched control) | +11.8pp retention | Off-season whale protection |
| Disney trading | Engagement | CORRELATIONAL | 218x at 50+ trades | M→L pipeline fix |
| VIP deposit match | Reactivation | VALIDATED (2.7x ROI) | Self-funding | Off-season whale reactivation |
| IRL events | Reactivation | VALIDATED (small sample) | 99% signup, 317d dormant | Pre-off-season calendar anchor |
| Common burns | Supply reduction | CAUSAL (zero impact) | None | Don't do this |
| Content spikes (alone) | Acquisition | VALIDATED (fails) | 98.1% churn without trading | Must include trading bridge |