Analysis windows & retention

Two different clocks are easy to conflate:

  • Analysis window — the date range an experiment is analyzed over. In LLMJury this is the experiment's own duration. It is never artificially capped by plan tier, so a running experiment is never cut off before it can reach significance.
  • Retention — how long raw events stay stored (a per-plan limit: 7 days Free, 30 Pro, 90 Business, configurable Enterprise).

When an experiment outlives retention

Only the retained tail of events is analyzable; the result is flagged retention_truncated and window_days records the window actually used. This is a storage bound, never an artificial stop — upgrading extends retention. The business-metric attribution window is bounded by retention too.

Results outlive raw data

Finalized results are snapshotted (Postgres rows + object-store snapshots), so a completed experiment's verdict persists after its raw events age out. Statistical ceilings (permutations, per-arm sample caps) are also per-plan; overrides above the ceiling are clamped and the effective values are recorded on the result.