Public verificationMethodology

Strata Weather Forecast Verification

Rolling 90-day scorecards compare public lanes and explicitly labeled shadow challengers to declared baselines. Public claims only publish when completeness is at least 80% and the bootstrap 95% confidence interval excludes zero.

Stations
5
Flow runs
≤4 event/day
Flow backfill
0/30 days
Artifact
public-skill-scorecards-v3

Methodology visible

Live collection feed is not connected here.

Live scorecard uses an older verification contract; v2 data is not displayed as Flow evidence.

Collection readiness

This separates the public methodology from the live scoring feed. A lane can show methodology and baselines before it has enough settled samples to publish a claim.

Methodology visible
Live feed
Fallback
Collector cron
Disabled
Tile sampler
Missing
Sampleable lanes
0/4
Backfill
0/30 days

Zenith Flow

Baseline: Eulerian persistence · latest layer pending · 0 settled forecasts · 0 fully paired · 0 pending

Pending
LayerTimingBaselineTruth

Zenith Middle

Baseline: HRRR · latest layer pending

Pending
LayerTimingBaselineTruth

Regional Lite

Baseline: Raw NBM · latest layer pending

Pending
LayerTimingBaselineTruth

Global FCN3

Baseline: GFS · latest layer pending

Pending
LayerTimingBaselineTruth

Zenith Flow

Baseline: Eulerian persistence · Metric: Precipitation rate MAE (mm/h)

Verifying

verifying

90-day sparkline awaiting settled samples.
Completeness
0%
Samples
0/0
Lane MAE
verifying
Eulerian persistence MAE
verifying
Delta
verifying
95% CI
verifying

0.5 mm/h

CSI · POD · FAR

Persistence CSI

2 mm/h

CSI · POD · FAR

Persistence CSI

10 mm/h

CSI · POD · FAR

Persistence CSI

Zenith Middle

Baseline: HRRR · Metric: Temperature MAE (°F)

Verifying

verifying

90-day sparkline awaiting settled samples.
Completeness
0%
Samples
0/3600
Lane MAE
verifying
HRRR MAE
verifying
Delta
verifying
95% CI
verifying

Regional Lite

Baseline: Raw NBM · Metric: Temperature MAE (°F)

Verifying

verifying

90-day sparkline awaiting settled samples.
Completeness
0%
Samples
0/3600
Lane MAE
verifying
Raw NBM MAE
verifying
Delta
verifying
95% CI
verifying

Global FCN3

Baseline: GFS · Metric: Temperature MAE (°F)

Verifying

verifying

90-day sparkline awaiting settled samples.
Completeness
0%
Samples
0/3600
Lane MAE
verifying
GFS MAE
verifying
Delta
verifying
95% CI
verifying

Methodology

Declared baselines

Flow compares to Eulerian persistence; Middle to HRRR; Regional Lite to raw NBM; Global FCN3 to GFS. Missing baseline samples keep the lane in verifying state.

Truth lag

Flow T+15 is scored only after the nearest archived NOAA MRMS frame (within eight minutes) has settled for at least two hours. Samples store forecast, persistence, and truth layer identities plus truthSettledAt.

Completeness

Flow is event-driven, not continuously fresh. Every produced event run creates 5 fixed-station scoring opportunities; missed samples stay missing. Execution is capped at 4 runs per UTC day, and public claims require at least 80% opportunity coverage.

Radar sampling

Flow uses model-QC reflectivity converted to precipitation rate. Covered dry pixels are zero; outside or unknown coverage fails closed as missing. Display-smoothed radar is never verification input.

Confidence interval

Daily lane-vs-baseline skill deltas are bootstrapped into a 95% interval. If the interval crosses zero, the card shows verifying instead of a marketing claim.

Flow-vs-persistence backfill

The public claim gate requires 30 distinct days of Zenith Flow against Eulerian persistence; current proof is 0 days, so unproven claims remain verifying.

Loss display

A statistically settled loss is shown in the same card style as a win, with the baseline, window, metric, and completeness still visible.

AIFS shadow boundary

ECMWF AIFS is sampled against Global FCN3 as an internal challenger. Its artifacts stay research-only and routing-ineligible regardless of measured skill until a separate promotion decision.