Skip to content

predsci/rsv-forecast-hub

 
 

Repository files navigation

US RSV Forecast Hub

Rationale

Respiratory Syncytial Virus (RSV) is the #1 cause of hospitalizations in children under 5 in the United States. Tracking RSV-associated hospitalization rates helps public health professionals understand trends in virus circulation, estimate disease burden, and respond to outbreaks. Accurate predictions of hospital admissions linked to RSV will help support appropriate public health interventions and planning during the 2023-2024 RSV season, as COVID-19, influenza, and other respiratory pathogens are circulating.

This repository is designed to collect forecast data for the 2023-2024 RSV Forecast Hub run by Johns Hopkins University Infectious Disease Dynamics Group. This project collects forecasts for weekly new hospitalizations due to confirmed RSV.

The most recent RSV forecasts on the RSV Forecast Hub dashboard.

How to Participate:

This RSV Forecast Hub will serve as a collaborative forecasting challenge for weekly laboratory confirmed RSV hospital admissions. Each week, participants are asked to provide national- and jurisdiction-specific probabilistic forecasts of the weekly number of confirmed RSV hospitalizations for the following four weeks. The RSV Forecast Hub is open to any team willing to provide projections at the right temporal and spatial scales. We only require that participating teams share quantile estimates, along with a short model description and answers to a list of key questions about design.

Those interested in participating, please read the submission README and email Kimberlyn Roosa at [email protected].

Model projections should be submitted via pull request to the model-output/ folder and associated metadata should be submitted at the same time to the model-metadata/ folder of this GitHub repository.

RSV Model Calibration

RSV-NET Dataset

The Respiratory Syncytial Virus Hospitalization Surveillance Network (RSV-NET) is a network that conducts active, population-based surveillance for laboratory-confirmed RSV-associated hospitalizations in children younger than 18 years of age and adults. The network currently includes 58 counties in 12 states that participate in the Emerging Infections Program (California, Colorado, Connecticut, Georgia, Maryland, Minnesota, New Mexico, New York, Oregon, and Tennessee) or the Influenza Hospitalization Surveillance Program (Michigan and Utah). Age- and state-specific data on laboratory-confirmed RSV hospitalization rates are available for 12 states and the US from RSV-NET spanning 2017-18 to present (RSV-NET CDC Webpage). Age-specific weekly rates per 100,000 population are reported in this system.

The data has been standardized and posted on the rsv-forecast-hub github target-data/ folder and is updated weekly. The target in this data is the weekly number of hospitalizations in each given state (inc_hosp variable), for all ages and for each age group. To obtain counts, we have converted RSV-NET weekly rates based on state population sizes. This method assumes that RSV-NET hospitals are representative of the whole state. To obtain national US counts, we have used the rates provided for the “overall RSV-NET network”. The data covers 2017-present. Reported age groups include: [0-6 months], [6-12 months], [1-2 yr], [2-4 yr], [5-17 yr], [18-49 yr], [50-64 yr], and 65+ years. The standardized dataset includes week- state- and age-specific RSV counts (the target), rates, and population sizes.

Note: Different states joined RSVnet in different years (between 2014 and 2018) while RSV surveillance throughout the network was initially limited to adults. Children RSV surveillance began in the 2018-19 season. Further, RSV-NET hospitalization data are preliminary and subject to change as more data become available. Case counts and rates for recent hospital admissions are subject to reporting lags that might increase around holidays or during periods of increased hospital utilization. As new data are received each month, previous case counts and rates are updated accordingly.

The source of age distribution used for calibration (RSV-NET vs other estimates) should be provided in the abstract metadata that is submitted with the projections.

Prediction Targets

Participating teams are asked to provide quantile forecasts of the weekly incident confirmed RSV hospital admissions (counts) in the 12 RSV-NET states, nationally for all ages, and for a set of minimal age groups for the four weeks following the epidemiological week that begins on the origin date. Teams can, but are not required to, submit forecasts for all age groups or all locations.

Weekly targets:

  • Weekly reported all-age and age-specific state-level incident hospital admissions, based on RSV-NET. This dataset is updated daily and covers 2017-2024. There should be no adjustment for reporting (=raw data from RSV-NET dataset to be projected).
  • All targets should be number of individuals, rather than rates.

Age target:

  • Required:
    • Weekly state-specific and national RSV hospitalizations for all ages (or 0-130) is the only mandatory age target.
  • Additional age details (optional):
    • Weekly state-specific and national RSV hospitalizations among individuals <1 yr, 1-4, 5-64, and 65+ (most of the RSV burden on hospitalizations comes from the 0-1 and 65+ age groups)

Timeline

The RSV Forecast Hub challenge period will begin February 19, 2024 and run through May 13, 2024. Participating teams are asked to submit weekly forecasts by 11:59 PM Eastern Time each Monday. However, late forecasts will be accepted during this initial start-up period.

Target Data

The target-data/ folder contains the RSV hospitalization data (also called "truth data") standardized from the Weekly Rates of Laboratory-Confirmed RSV Hospitalizations from the RSV-NET Surveillance System.

The weekly hospitalization number per location are going to be used as truth data in the hub.

Auxiliary Data

The repository stores and updates additional data relevant to the RSV modeling efforts in the auxiliary-data/ folder:

  • Population and census data:
    • National and State level name and fips code as used in the Hub and associated population size.
    • State level population size per year and per age from the US Census Bureau.

Retrospective Analyses

As this challenge is beginning late in the 2023-24 RSV season, we are asking that any willing team participate in a ‘retrospective forecasting’ exercise in addition to the weekly projections. For this, we ask that teams submit a ‘forecast’ for each week in the RSV season prior to the start of the challenge. The target-data/ folder contains a sub-folder of archived data pulled on the date listed in the file name. Participants will utilize the data available at the time of the forecast, as if the projections were made in real-time with the data available at the time. The first origin_date of this challenge will be 10-22-2023. Thus, data pulled on 10-20-2023, which contain data up to 10-14-2023, will be utilized to create projections. The data dates and corresponding origin_date can be found in the table provided in the US RSV Forecast Hub Guidelines. Data are not available for the weeks of 11-03-2023 and 11-24-2023, so we will not require submissions for these dates.

Data License and Reuse:

All source code that is specific to the overall project is available under an open-source MIT license. We note that this license does not cover model code from the various teams, model scenario data if there is (available under specified licenses as described above) and auxiliary data.

Acknowledgements

This repository follows the guidelines and standards outlined by the hubverse, which provides a set of data formats and open source tools for modeling hubs.

About

RSV Scenario Modeling Hub for forecasting

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • R 100.0%