Multi-season evaluation and analysis of categorical trend forecasts of influenza hospital admissions in the United States

Jessica T Davis, Gursharn Kaur, Annabella Hines, Michal Ben-Nun, Srinivasan Venkatramanan, Logan Brooks, Sarabeth Mathis, Marco Ajelli, Maria Litvinova, Allisandra G Kummer, Paulo Cesar Ventura, Shreeya Mhade, David Weber, Dmitry Shemetov, Nat DeFries, Daniel J McDonald, Teresa Yamana, Rodrigo Zepeda-Tello, Jeffrey Shaman, Rami Yaari, Sen Pei, Alexander Webber, Li Shandross, Evan Ray, Spencer Wadsworth, Jarad Niemi, William T Redman, Luke Mullany, Richard Posner, Abhishek Mallela, Yen Ting Lin, William S Hlavacek, Adam Smart, Amir Aman Gill, Avery Drennan, Bria Jayde Fiebiger, Ely Finn Miller, Jaechoul Lee, Joseph R Mihaljevic, Kylie Ann Geist, Maya Baltz, Ozbej Bernik, Y-Minh B Truong, Ye Chen, Colin James Grosvenor, Mauricio Santillana, Candice Djorno, Jiecheng Lu, Shihao Yang, Fred Lu, Leonardo Clemente, Austin G Meyer, Clara Bay, Alessandra Urbinati, Nicolo Gozzi, Matteo Chinazzi, Minami Ueda, Nima Moghaddas, Remy LeWinter, Sara Venturini, Stefania Fiandrino, Alessandro Vespignani, Spencer J. Fox, Ehsan Suez, Mariah Salcedo, Rajath Prabhakar, B. K. M. Case, Amanda Perofsky, Cécile Viboud, James Turtle, VP Nagraj, Amy Benefield, Desiree Williams, Graham C. Gibson, Lauren Meyers, Edward Thommes, Christopher van Bommel, Rhiannon Loster, Benjamin Benteke Longaou, Monica Cojocaru, Pengfei Yue, Alexander Rodríguez, Ruipu Li, Sonika Potnis, Nicholas G. Reich, Thomas Robacker, Joseph Lemaitre, Aniruddha Adiga, Bryan Lewis, Madhav Marathe, Nibir Chandra Mandal, Stephen D. Turner, Naren Ramakrishnan, Yiqi Su, Michael Johansson, Matthew Biggerstaff, Rebecca K. Borchering
medRxiv
September 2, 2026

Forecasting influenza hospitalizations informs public health preparedness, yet questions remain about which types of forecasts best guide action. We evaluate categorical trend forecasts, which communicate probabilities of upcoming increases or decreases in epidemic trajectories, submitted to CDC's FluSight Forecasting Challenge between Fall-2024 and Spring-2026. Teams submitted probability distributions over five categories describing direction and magnitude of week-over-week changes in laboratory-confirmed influenza hospital admissions. We assessed performance using Ranked Probability Skill Score, Brier Skill Score, and measures of forecast-observation agreement. Most models outperformed an equal-probability baseline; the FluSight ensemble ranked among the top three in the 2024-25 and 2025-26 seasons. Forecasts were most accurate during stable periods and least during periods of rapid change, with most models underestimating observed trends. Conclusions were robust to choice of scoring metric and reference model. These results support categorical trend ensembles as an approach to communicating infectious disease forecasts that may inform public health decision-making.

Related publications