NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.
Structured Abstract
Background:
The question of how to determine when a systematic review needs to be updated is of considerable importance. Changes in the evidence can have significant implications for clinical practice guidelines and for clinical and consumer decision-making that depend on up-to-date systematic reviews as their foundation. Methods have been developed for assessing signals of the need for updating, but these methods have been applied only in studies designed to demonstrate and refine the methods , and not as an operational component of a program for systematic reviews.
Objectives:
The Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice (EPC) program commissioned RAND's Southern Californian Evidence-based Practice Center (SCEPC) and University of Ottawa Evidence-based Practice Center (UOEPC), with assistance from the ECRI EPC, to develop and implement a surveillance process for quickly identifying Comparative Effectiveness Reviews (CERs) in need of updating.
Approach:
We established a surveillance program that implemented and refined a process to assess the need for updating CERs. The process combined methods developed by the SCEPC and the UOEPC for prior projects on identifying signals for updating: an abbreviated literature search, abstraction of the study conditions and findings for each new included study, solicitation of expert judgments on the currency of the original conclusions, and an assessment of whether the new findings provided a signal according to the Ottawa Method and/or the RAND Method, on a conclusion-by-conclusion basis. Lastly, an overall summary assessment was made that classified each CER as being of high, medium, or low priority for updating. If a CER was deemed to be a low or medium priority for updating, the process would be repeated 6 months later; if the priority for updating was deemed high, the CER would be withdrawn from subsequent 6-month assessments.
Results and Conclusions:
Between June 2011 and June 2012, we established a surveillance process and completed the evaluation of 14 CERs. Of the 14 CERs, 2 were classified as high priority, 3 as medium priority, and 9 as low priority. Of the 6 CERs released prior to 2010 (meaning over 18 months before the start of the program) 2 were judged high priority, 2 were judged medium priority, and 2 were judged low priority for updating. We have shown it is both useful and feasible to do such surveillance, in real time, across a program that produces a large number of systematic reviews on diverse topics.
Contents
- Preface
- Acknowledgments
- Introduction
- Methods
- Identifying New Evidence From Published Studies
- Identifying New Evidence From the U.S. Food and Drug Administration, Health Canada, and Medicines and Healthcare Products Regulatory Agency (MHRA) (UK)
- Identifying New Evidence From Experts and Expert Opinion
- Check for Qualitative and Quantitative Signals
- Determining Priority for Updating a CER
- Summary Dissemination of Reports to AHRQ
- Peer Review and Public Commentary
- Results
- Discussion
- References
- Abbreviations
- Appendix A Examples of “Low,” “Medium,” and “High” Assessments
- Appendix B Methods for Identifying Regulatory Information or Safety Alerts
Prepared for: Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services1, Contract No.: 290-2007-10062-I (Southern California EPC), 290-2007-10059-I (Ottawa EPC). Prepared by: The RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, CA, University of Ottawa Evidence-based Practice Center, Ottawa, Canada
Suggested citation:
Newberry SJ, Ahmadzai N, Motala A, Tsertsvadze A, Maglione M, Ansari MT, Hempel S, Tsouros S, Schneider Chafen J, Shanman R, Skidmore B, Moher D, Shekelle, PG. Surveillance and Identification of Signals for Updating Systematic Review: Implementation and Early Experience. Methods Research Report (Prepared by the RAND Corporation, Southern California Evidence-based Practice Center under Contract No. 290-2007-10062-I and University of Ottawa Evidence-based Practice Center 290-2007-10059-I). AHRQ Publication No. 13-EHC088-EF. Rockville, MD: Agency for Healthcare Research and Quality; June 2013. www.effectivehealthcare.ahrq.gov/reports/final.cfm.
This report is based on research conducted by the Southern California and University of Ottawa Evidence-based Practice Centers (EPCs) under contract to the Agency for Healthcare Research and Quality (AHRQ), Rockville, MD (Contract No. 290-2007-10062-I [Southern California EPC] and 290-2007-10059-I [University of Ottawa EPC]). The findings and conclusions in this document are those of the authors, who are responsible for its contents; the findings and conclusions do not necessarily represent the views of AHRQ. Therefore, no statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.
The information in this report is intended to help health care decisionmakers—patients and clinicians, health system leaders, and policymakers, among others—make well-informed decisions and thereby improve the quality of health care services. This report is not intended to be a substitute for the application of clinical judgment. Anyone who makes decisions concerning the provision of clinical care should consider this report in the same way as any medical reference and in conjunction with all other pertinent information, i.e., in the context of available resources and circumstances presented by individual patients.
This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or as a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.
None of the investigators have any affiliations or financial involvement that conflicts with the material presented in this report.
- 1
540 Gaither Road, Rockville, MD 20850; www
.ahrq.gov
- NLM CatalogRelated NLM Catalog Entries
- Review Assessment of a Method to Detect Signals for Updating Systematic Reviews[ 2014]Review Assessment of a Method to Detect Signals for Updating Systematic ReviewsShekelle PG, Motala A, Johnsen B. 2014 Mar
- Assessment of a method to detect signals for updating systematic reviews.[Syst Rev. 2014]Assessment of a method to detect signals for updating systematic reviews.Shekelle PG, Motala A, Johnsen B, Newberry SJ. Syst Rev. 2014 Feb 14; 3:13. Epub 2014 Feb 14.
- Review Updating Systematic Reviews[ 2007]Review Updating Systematic ReviewsShojania KG, Sampson M, Ansari MT, Ji J, Garritty C, Rader T, Moher D. 2007 Sep
- A surveillance system to assess the need for updating systematic reviews.[Syst Rev. 2013]A surveillance system to assess the need for updating systematic reviews.Ahmadzai N, Newberry SJ, Maglione MA, Tsertsvadze A, Ansari MT, Hempel S, Motala A, Tsouros S, Schneider Chafen JJ, Shanman R, et al. Syst Rev. 2013 Nov 14; 2:104. Epub 2013 Nov 14.
- Updating comparative effectiveness reviews: current efforts in AHRQ's Effective Health Care Program.[J Clin Epidemiol. 2011]Updating comparative effectiveness reviews: current efforts in AHRQ's Effective Health Care Program.Tsertsvadze A, Maglione M, Chou R, Garritty C, Coleman C, Lux L, Bass E, Balshem H, Moher D. J Clin Epidemiol. 2011 Nov; 64(11):1208-15. Epub 2011 Jun 17.
- Surveillance and Identification of Signals for Updating Systematic Reviews: Impl...Surveillance and Identification of Signals for Updating Systematic Reviews: Implementation and Early Experience
Your browsing activity is empty.
Activity recording is turned off.
See more...