U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Cover of Systematizing the Use of Value of Information Analysis in Prioritizing Systematic Reviews

Systematizing the Use of Value of Information Analysis in Prioritizing Systematic Reviews

Methods Research Reports

Investigators: , PhD, , BA, , PhD, and , MD, PhD.

Author Information and Affiliations
Rockville (MD): Agency for Healthcare Research and Quality (US); .
Report No.: 12-EHC109-EF

Structured Abstract

Background:

As a means to inform clinical and health policy decisions, systematic reviews are inexpensive relative to clinical trials and other (observational) studies but are costly enough that not all possible systematic reviews can be performed. Value of information (VOI) analysis has been considered as a tool to help prioritize topics for systematic review. Since VOI analysis typically involves constructing a complex decision-analytic model of the disease and its treatment to fully characterize the uncertainty in the health outcomes and costs of the treatments or other health interventions being studied, the standard approach to VOI may be prohibitively costly for use in prioritizing systematic reviews. As alternatives to typical full modeling VOI, three newer approaches to analyzing the value of information can be identified that are less burdensome: (1) In a conceptual approach to VOI, information is used about multiplicative elements of VOI, which include comprehensive outcome measures and the implementation and durability of review findings, to provide informative bounds on value of research without formally quantifying this through modeling. (2) In a minimal modeling approach to VOI, which is possible when data on comprehensive outcome measures, such as quality-adjusted life-years or net benefit, are readily available from existing research, VOI can be estimated without constructing a complex model. (3) In a maximal modeling approach to VOI, a single comprehensive model may be constructed to simultaneously inform priorities concerning multiple clinical questions. The presence of these lower cost VOI methods creates the possibility for VOI analysis to be practically applied in priority-setting process for systematic reviews, and raises questions about how the use of VOI can be systematized.

Methods:

This study (1) reviews VOI methods and the approaches currently used to inform priorities for systematic reviews in the literature and in practice; (2) describes an algorithm for selecting an effective and efficient approach to VOI for a given clinical question; and (3) applies this algorithm to assess its potential utility in prioritizing topics nominated to the Agency for Healthcare Research and Quality (AHRQ) and Quality Evidence-based Practice Centers (EPCs) for systematic review.

Results:

Our review of past research identified a substantial number of VOI studies but found that VOI had not been used to set priorities for systematic reviews. We did find that many of the elements that are used to estimate VOI are often considered in prioritizing systematic reviews, but they are rarely quantified or combined in an explicit manner that would be consistent with VOI principles. We propose an algorithm that describes a multistage process for identifying an effective and efficient approach to VOI for a given clinical question. This process begins with conceptual VOI to provide informative bounds on VOI, followed by the clustering of review topics and consideration of the use of maximal modeling VOI, and then minimal modeling using comprehensive outcome measures of the benefits of the alternative treatments or health interventions under study. In applying our algorithm to topics nominated to AHRQ’s EPCs for systematic review, we found the algorithm useful in selecting the appropriate VOI methods to inform priorities for systematic reviews and found examples in which each of the lower cost VOI approaches might be valuable. Although full modeling VOI may aid in the planning and design of research, we find limited conditions for its use in prioritizing systematic reviews.

Conclusion:

We conclude that consideration of VOI principles and methods may have a useful role in informing priorities for systematic reviews. VOI can help decision makers and others involved in priority-setting for systematic reviews to explicate criteria and quantify measures of expected value that can be used to prioritize reviews. Systematic application of VOI using an algorithm that guides the choice among conceptual VOI, maximal modeling, minimal and full modeling may aid in minimizing the costs and burden to the practical application of VOI. We propose future work that would (1) incorporate VOI into the process by which systematic review topics proposed to AHRQ’s EPCs are prioritized, and (2) assess whether that process is found to be useful by decision makers and others.

Contents

Prepared for: Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services1, Contract No. 290-2007-10058, Prepared by: University of Chicago Medical Center through the Blue Cross and Blue Shield Association Technology Evaluation Center Evidence-based Practice Center

Suggested citation:

Hoomans T, Seidenfeld J, Basu A, Meltzer, D. Systematizing the Use of Value of Information Analysis in Prioritizing Systematic Reviews. (Prepared by the University of Chicago Medical Center through the Blue Cross and Blue Shield Association Technology Evaluation Center Evidence-based Practice Center under Contract No. 290-2007-10058.) AHRQ Publication No. 12-EHC109-EF. Rockville, MD: Agency for Healthcare Research and Quality. August 2012. www.effectivehealthcare.ahrq.gov/reports/final.cfm.

This report is based on research conducted by the University of Chicago Medical Center through the Blue Cross and Blue Shield Association Technology Evaluation Center Evidence-based Practice Center (EPC) under contract to the Agency for Healthcare Research and Quality (AHRQ), Rockville, MD (Contract No. 290-2007-10058). The findings and conclusions in this document are those of the authors, who are responsible for its contents; the findings and conclusions do not necessarily represent the views of AHRQ. No statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.

Financial support for this work was provided by the Agency for Health Care Policy and Research through the Blue Cross and Blue Shield Association Technology Evaluation Center Evidence-based Practice Center with funds through the American Recovery and Reinvestment Act (290-2007-10058-I) (Huang/Meltzer PI), a Midcareer Career Development Award from the National Institute of Aging (1 K24 AG031326-01, Meltzer, PI) and the Agency for Healthcare Quality and Research through the Hospital Medicine and Economics Center for Education and Research in Therapeutics (CERT) (U18 HS016967-01, Meltzer, PI).

The information in this report is intended to help health care decisionmakers—patients and clinicians, health system leaders, and policymakers, among others—make well-informed decisions and thereby improve the quality of health care services. This report is not intended to be a substitute for the application of clinical judgment. Anyone who makes decisions concerning the provision of clinical care should consider this report in the same way as any medical reference and in conjunction with all other pertinent information, i.e., in the context of available resources and circumstances presented by individual patients.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or as a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

None of the investigators have any affiliations or financial involvement that conflicts with the material presented in this report.

1

540 Gaither Road, Rockville, MD 20850; www​.ahrq.gov

Bookshelf ID: NBK107294PMID: 23035303

Views

Related information

Similar articles in PubMed

See reviews...See all...

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...