U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Cover of Surveillance and Identification of Signals for Updating Systematic Reviews: Implementation and Early Experience

Surveillance and Identification of Signals for Updating Systematic Reviews: Implementation and Early Experience

Methods Research Reports

Investigators: , PhD, , MD, MSc, MPH, , BA, , MD, MSc, , MPP, , MBBS, MMedSc, MPhil, , PhD, , BHKin, , MD, , MLS, , MLS, , PhD, and , MD, PhD.

Author Information and Affiliations
Rockville (MD): Agency for Healthcare Research and Quality (US); .
Report No.: 13-EHC088-EF

Structured Abstract

Background:

The question of how to determine when a systematic review needs to be updated is of considerable importance. Changes in the evidence can have significant implications for clinical practice guidelines and for clinical and consumer decision-making that depend on up-to-date systematic reviews as their foundation. Methods have been developed for assessing signals of the need for updating, but these methods have been applied only in studies designed to demonstrate and refine the methods , and not as an operational component of a program for systematic reviews.

Objectives:

The Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice (EPC) program commissioned RAND's Southern Californian Evidence-based Practice Center (SCEPC) and University of Ottawa Evidence-based Practice Center (UOEPC), with assistance from the ECRI EPC, to develop and implement a surveillance process for quickly identifying Comparative Effectiveness Reviews (CERs) in need of updating.

Approach:

We established a surveillance program that implemented and refined a process to assess the need for updating CERs. The process combined methods developed by the SCEPC and the UOEPC for prior projects on identifying signals for updating: an abbreviated literature search, abstraction of the study conditions and findings for each new included study, solicitation of expert judgments on the currency of the original conclusions, and an assessment of whether the new findings provided a signal according to the Ottawa Method and/or the RAND Method, on a conclusion-by-conclusion basis. Lastly, an overall summary assessment was made that classified each CER as being of high, medium, or low priority for updating. If a CER was deemed to be a low or medium priority for updating, the process would be repeated 6 months later; if the priority for updating was deemed high, the CER would be withdrawn from subsequent 6-month assessments.

Results and Conclusions:

Between June 2011 and June 2012, we established a surveillance process and completed the evaluation of 14 CERs. Of the 14 CERs, 2 were classified as high priority, 3 as medium priority, and 9 as low priority. Of the 6 CERs released prior to 2010 (meaning over 18 months before the start of the program) 2 were judged high priority, 2 were judged medium priority, and 2 were judged low priority for updating. We have shown it is both useful and feasible to do such surveillance, in real time, across a program that produces a large number of systematic reviews on diverse topics.

Prepared for: Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services1, Contract No.: 290-2007-10062-I (Southern California EPC), 290-2007-10059-I (Ottawa EPC). Prepared by: The RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, CA, University of Ottawa Evidence-based Practice Center, Ottawa, Canada

Suggested citation:

Newberry SJ, Ahmadzai N, Motala A, Tsertsvadze A, Maglione M, Ansari MT, Hempel S, Tsouros S, Schneider Chafen J, Shanman R, Skidmore B, Moher D, Shekelle, PG. Surveillance and Identification of Signals for Updating Systematic Review: Implementation and Early Experience. Methods Research Report (Prepared by the RAND Corporation, Southern California Evidence-based Practice Center under Contract No. 290-2007-10062-I and University of Ottawa Evidence-based Practice Center 290-2007-10059-I). AHRQ Publication No. 13-EHC088-EF. Rockville, MD: Agency for Healthcare Research and Quality; June 2013. www.effectivehealthcare.ahrq.gov/reports/final.cfm.

This report is based on research conducted by the Southern California and University of Ottawa Evidence-based Practice Centers (EPCs) under contract to the Agency for Healthcare Research and Quality (AHRQ), Rockville, MD (Contract No. 290-2007-10062-I [Southern California EPC] and 290-2007-10059-I [University of Ottawa EPC]). The findings and conclusions in this document are those of the authors, who are responsible for its contents; the findings and conclusions do not necessarily represent the views of AHRQ. Therefore, no statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.

The information in this report is intended to help health care decisionmakers—patients and clinicians, health system leaders, and policymakers, among others—make well-informed decisions and thereby improve the quality of health care services. This report is not intended to be a substitute for the application of clinical judgment. Anyone who makes decisions concerning the provision of clinical care should consider this report in the same way as any medical reference and in conjunction with all other pertinent information, i.e., in the context of available resources and circumstances presented by individual patients.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or as a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

None of the investigators have any affiliations or financial involvement that conflicts with the material presented in this report.

1

540 Gaither Road, Rockville, MD 20850; www​.ahrq.gov

Bookshelf ID: NBK148794PMID: 23865098

Views

  • PubReader
  • Print View
  • Cite this Page
  • PDF version of this title (1018K)

Related information

Similar articles in PubMed

See reviews...See all...

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...