Final published version of “Unbiased calculation, evaluation, and calibration of ensemble forecast anomalies” now available online in the Quarterly Journal of the Royal Meteorological Society:
https://t.co/uw9xnyoHlN
Do you calculate anomalies from ensemble forecasts?
If yes, then maybe you should be doing it differently!
🚨 New paper!🚨
"Unbiased evaluation and calibration of ensemble forecast anomalies"
https://t.co/kX7NyFOkLc
And here is an example 10 day forecast of 850 hPa Meridional Wind from AIFS-CRPS provided by Simon Lang. This animation shows that CRPS-based training does not suffer from smoothing and/or reduced variance for longer rollouts that is inherent to deterministic MSE-based training.
🚨New preprint🚨from @ECMWF introducing AIFS-CRPS, a new data-driven ensemble system for medium-range and subseasonal forecasting. https://t.co/ZGAPTKF8Dh
This is because optimising a fair ensemble score means there is no trade-off between minimising error and maintaining realistic levels of variability, which is unavoidable for deterministic training. fCRPS loss is minimised when the fc is drawn from the same distribution as obs.
AIFS-CRPS is an ensemble variant of the Artificial Intelligence Forecasting System (AIFS) developed at ECMWF. The training protocol utilises a probabilistic loss function based on the Continuous Ranked Probability Score (CRPS).
🚨New preprint🚨from @ECMWF introducing AIFS-CRPS, a new data-driven ensemble system for medium-range and subseasonal forecasting. https://t.co/ZGAPTKF8Dh
@ECMWF … Peter Deuben , Sara Hahner, Pedro Maciel, Ana Prieto-Nemesio, Cathal O'Brien, Florian Pinault, Jan Polster, Baudouin Raoult, Steffen Tietsche, Martin Leutbecher!
AIFS-CRPS is an ensemble variant of the Artificial Intelligence Forecasting System (AIFS) developed at ECMWF. The training protocol utilises a probabilistic loss function based on the Continuous Ranked Probability Score (CRPS).
This work represents a huge team effort from @ECMWF colleagues Simon Lang, Mihai Alexe, Mariana Clare, Rilwan Adewoyin, Zied Ben Bouallègue, Matthew Chantry, Jesper Dramsch…
Crucially, there is no inconsistency between the objectives of eliminating an apparent signal-to-noise paradox and traditional approaches to ensemble forecast development guided by unbiased evaluation of forecast reliability and optimization of fair ensemble scores