NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.
Concordance Between the Findings of Epidemiological Studies and Randomized Trials in Nutrition: An Empirical Evaluation and Citation Analysis
Technical Reviews, No. 17.6
Investigators: Denish Moorthy, MBBS, MS, Mei Chung, PhD, Jounghee Lee, PhD, Winifred W Yu, PhD, Joseph Lau, MD, and Thomas A Trikalinos, MD.
Author Information and AffiliationsStructured Abstract
Background:
In nutrition, there are several examples of discordance between the results of observational studies and of randomized controlled trials (RCTs).
Objectives:
To provide empirical data on how often the summary results of epidemiological studies and of RCTs are concordant, and to explore whether the probability of concordant findings is associated with quantifiable metrics of citation maps formed between studies belonging to the evidence base of the nutrient-outcome association at hand. Citation maps are an objective representation of the translational paths in each association, and may be a surrogate of the maturity of the relevant evidence base.
Methods:
We searched MEDLINE to identify meta-analyses of RCTs or of epidemiological studies on the association between nutrients and health outcomes. Summary findings from both research designs that were statistically significant and in the same direction were considered qualitatively concordant. We also calculated the statistical significance of the difference in the summary effects from epidemiological studies and from RCTs (a measure of quantitative concordance). For each nutrient-outcome association we defined an “evidence base” including all publications identifiable by MEDLINE searches on the nutrient and outcome of interest and constructed citation maps of all articles in the evidence base that were cited by the epidemiological studies or the RCTs in the meta-analyses, either directly, or through one or more intermediary papers. We then quantified the size of the graphs (number of vertices and citation relationships), and their connectivity (density of citation relationships, mean hub and authority scores, and mean number of citations made or received over the included papers). We tested for associations between these metrics and the probability that the summary results from epidemiological studies and from RCTs are concordant between them.
Findings:
In 23 out of 34 associations the summary findings from meta-analyses of epidemiological studies and of RCTs were in the same direction. In 6 of 23 associations, meta-analyses of epidemiological studies and of RCTs had statistically significant findings. In the remaining 11 out of 34 assocations, meta-analyses of epidemiological studies and of RCTs had summaries pointing in opposite directions. In 12 out of 34 associations the summary findings of epidemiological studies were statistically significantly different from those of RCTs, in 6 out of 12 point estimates were in the same direction, and in the other 6 in opposing directions. Despite the variation in the size and the connectivity of the citation graphs across the examined associations, we find no evidence of association between quantitative metrics of the citation graphs and the probability that the two research designs have concordant or discordant findings (using various definitions of concordance or discordance).
Conclusions:
The examined quantitative characteristics of the citation maps in each association cannot predict the probability that the findings from the two designs agree or disagree. It is unclear whether there is a good way to describe the maturity of the evidence base on an association between nutrients and outcomes. At a minimum, purely bibliometric approaches are not a good way to prioritize which nutrient exposures merit further study, and for which health outcomes.
Contents
Prepared for: Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services1, Contract No. 290-2007-10055-I, Prepared by: Tufts Medical Center Evidence-based Practice Center, Boston, MA
Suggested citation:
Moorthy D, Chung M, Lee J, Yu WW, Lau J, Trikalinos TA. Concordance Between the Findings of Epidemiological Studies and Randomized Trials in Nutrition: An Empirical Evaluation and Citation Analysis. Technical Review No. 17 Volume 6. (Prepared by the Tufts Medical Center Evidence-based Practice Center under Contract No. 290-2007-10055-I.) AHRQ Publication No. 13-EHC067-EF. Rockville, MD: Agency for Healthcare Research and Quality, May 2013. www.ahrq.gov/research/findings/evidence-based-reports/technical/methodology/index.html.
This report is based on research conducted by the Tufts Medical Center Evidence-based Practice Center (EPC) under contract to the Agency for Healthcare Research and Quality (AHRQ), Rockville, MD (Contract No. 290-2007-10055-I). The findings and conclusions in this document are those of the authors, who are responsible for its contents; the findings and conclusions do not necessarily represent the views of AHRQ. Therefore, no statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.
The information in this report is intended to help health care decisionmakers—patients and clinicians, health system leaders, and policymakers, among others—make well informed decisions and thereby improve the quality of health care services. This report is not intended to be a substitute for the application of clinical judgment. Anyone who makes decisions concerning the provision of clinical care should consider this report in the same way as any medical reference and in conjunction with all other pertinent information, i.e., in the context of available resources and circumstances presented by individual patients.
This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or as a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.
None of the investigators have any affiliations or financial involvement that conflicts with the material presented in this report.
- 1
540 Gaither Road, Rockville, MD 20850; www
.ahrq.gov
- NLM CatalogRelated NLM Catalog Entries
- Review Comparison of Translational Patterns in Two Nutrient-Disease Associations: Nutritional Research Series, Vol. 5[ 2011]Review Comparison of Translational Patterns in Two Nutrient-Disease Associations: Nutritional Research Series, Vol. 5Trikalinos TA, Moorthy D, Chung M, Yu WW, Lee J, Lichtenstein AH, Lau J. 2011 Oct
- Meta-analysis: Problems with Russian Publications.[Int J Risk Saf Med. 2015]Meta-analysis: Problems with Russian Publications.Verbitskaya EV. Int J Risk Saf Med. 2015; 27 Suppl 1:S89-90.
- Concordance of randomized and nonrandomized studies was unrelated to translational patterns of two nutrient-disease associations.[J Clin Epidemiol. 2012]Concordance of randomized and nonrandomized studies was unrelated to translational patterns of two nutrient-disease associations.Trikalinos TA, Moorthy D, Chung M, Yu WW, Lee J, Lichtenstein AH, Lau J. J Clin Epidemiol. 2012 Jan; 65(1):16-29. Epub 2011 Nov 1.
- Review Low-Dose Aspirin for the Prevention of Morbidity and Mortality From Preeclampsia: A Systematic Evidence Review for the U.S. Preventive Services Task Force[ 2014]Review Low-Dose Aspirin for the Prevention of Morbidity and Mortality From Preeclampsia: A Systematic Evidence Review for the U.S. Preventive Services Task ForceHenderson JT, Whitlock EP, O'Conner E, Senger CA, Thompson JH, Rowland MG. 2014 Apr
- Citation networks of related trials are often disconnected: implications for bidirectional citation searches.[J Clin Epidemiol. 2014]Citation networks of related trials are often disconnected: implications for bidirectional citation searches.Robinson KA, Dunn AG, Tsafnat G, Glasziou P. J Clin Epidemiol. 2014 Jul; 67(7):793-9. Epub 2014 Apr 13.
- Concordance Between the Findings of Epidemiological Studies and Randomized Trial...Concordance Between the Findings of Epidemiological Studies and Randomized Trials in Nutrition: An Empirical Evaluation and Citation Analysis
- Case Study Comparing Bayesian and Frequentist Approaches for Multiple Treatment ...Case Study Comparing Bayesian and Frequentist Approaches for Multiple Treatment Comparisons
Your browsing activity is empty.
Activity recording is turned off.
See more...