Lessons Learned on Observed-to-Expected Analysis Using Spontaneous Reports During Mass Vaccination

Abstract

During the COVID-19 vaccination campaign, observed-to-expected analysis was used by the European Medicines Agency to contextualise data from spontaneous reports to generate real-time evidence on emerging safety concerns that may impact the benefit-risk profile of COVID-19 vaccines. Observed-to-expected analysis compares the number of cases spontaneously reported for an event of interest after vaccination (‘observed’) to the ‘expected’ number of cases anticipated to occur in the same number of individuals had they not been vaccinated. Observed-to-expected analysis is a robust methodology that relies on several assumptions that have been described in regulatory guidelines and scientific literature. The use of observed-to-expected analysis to support the safety monitoring of COVID-19 vaccines has provided valuable insights and lessons on its design and interpretability, which could prove to be beneficial in future analyses. When undertaking an observed-to-expected analysis within the context of safety monitoring, several aspects need attention. In particular, we emphasise the importance of stratified and harmonised data collection both for vaccine exposure and spontaneous reporting data, the need for alignment between coding dictionaries and the crucial role of accurate background incidence rates for adverse events of special interest. While these considerations and recommendations were determined in the context of the COVID-19 mass vaccination setting, they are generalisable in principle.

Rights

This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/.

Cite as

Downloadable citations

Identifiers

DOI

https://doi.org/10.1007/s40264-024-01422-8

Repository URI

https://discovery.dundee.ac.uk/en/publications/44f2bc4b-ab07-48e6-88ac-b2cb199c6d64