NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.
Karlsson LE, Takahashi R. A Resource for Developing an Evidence Synthesis Report for Policy-Making [Internet]. Copenhagen: WHO Regional Office for Europe; 2017. (Health Evidence Network Synthesis Report, No. 50.)
A Resource for Developing an Evidence Synthesis Report for Policy-Making [Internet].
Show detailsThe HEN synthesis report series uses an established and standardized format so that the structure of each report is clear and familiar to the readers. The common pathway of introduction, method, results, discussion and conclusion is followed.
Title
The title of the report is often the synthesis question.
Abstract
In 150 words or less, the abstract succinctly outlines the most important elements of the report including the synthesis question, results and policy options.
Summary
The summary includes the public health issue at hand, the corresponding synthesis question, types of evidence reviewed and policy considerations. The summary section is the essence of the HEN report and provides the most relevant information in the fewest possible words so that policy-makers with different technical skills can quickly grasp the evidence within a few minutes (1–3).
Main text
Introduction
The introduction describes the background focus of the problem or issue analysed, a description of the contexts and determinants of the problem and a clear statement of the importance, timeliness and policy relevance of the issue to the target audience.
Methodology
The method section should leave a transparent trail for others to replicate the search and to alert readers to any potential bias connected to the inclusion/exclusion of information. As was the case for the review protocol, it is essential to describe which databases, websites and other sources were searched, and what key terms were used (4–9). Often the methodology is expanded in an annex.
The ENTREQ statement (enhancing transparency in reporting the synthesis of qualitative research) (10) might be useful, particularly in reporting explicitly the methods of a qualitative synthesis. It consists of 21 items grouped into five main domains, which can help the authors to report the stages most commonly associated with the synthesis of qualitative health research: searching and selecting qualitative research, quality appraisal and methods for synthesizing qualitative findings.
The methods should include sources of information used; search strategy and databases searched; inclusion/exclusion criteria and data extraction; type of review applied; and a statement of the source of any grading scale applied to the evidence.
Results
Findings should be presented as precisely as possible so that decision-makers have access to key evidence to build upon. Discussing interpretation of results in terms of “certainty” helps policy-makers to understand what is known and what is not known about the subject, while avoiding statistical jargon where possible.
There are many guidelines available for reporting the synthesis process and findings that have increased the standardization of reporting study results and helped to ensure that crucial information is available for translating evidence into practice and policy. Examples include CONSORT (consolidated standards of reporting trials (11)), STROBE (strengthening the reporting of observational studies in epidemiology (12)), TREND (transparent reporting of evaluations with nonrandomized designs (13)), COREQ (consolidated criteria for reporting qualitative research (14)) and CERQual (15). Keeping in mind that these technical guidelines are focused on producing syntheses for policy-making, it is important that the findings and policy options are linked.
Given the nontechnical background of most policy-makers, authors are recommended to state clearly that the lack of available evidence does not mean that there is no effect of such a programme or intervention, merely that the effect is not known. This precautionary principle should be mentioned in the reports.
Discussion
The discussion section includes the strengths and limitations of the review and additional considerations to operationalize proposed policy options in national/regional/local contexts. As relevant, it is important to recognize possible opinions and debate around the issue, including:
- cost and cost–effectiveness;
- potential social, legal and ethical implications;
- current debate in the field (e.g. media);
- ongoing projects (e.g. evaluation or action) of particular importance in the field and protocols of ongoing or planned projects; and
- other aspects important for the issue/topic of concern.
In addition, the discussion should reflect on the publication and language bias. Unfunded and small sample studies are less likely to be published in the format of peer-reviewed articles (contributing to publication bias). It is well known that papers reporting positive results have a higher chance of publication than those that find an intervention ineffective (16,17). The findings of unpublished studies may be more controversial than those that were published and, consequently, bias the synthesis. The bias also includes the tendency for authors to submit, and editors to accept for publication, research that is consistent with previously published findings (16).
Conclusions
The conclusions is the section where the reader finds the synthesis question and detailed (much more than in the Summary) policy options (section 2.7) proposed by the findings. This section is often read together with the summary before the reader proceeds to the main report.
References
The list of referenced sources is a key element of a synthesis report as it allows the reader to judge the basis on which the arguments are built and it provides a guide to the currently available sources on the topic in question, which can then be used further.
Annexes
Although the synthesis is a short and targeted document, authors sometimes decide that their argument needs further support and so include one or more annexes (e.g. the details of the methodology).
References
- 1.
- Colby DC, Quinn BC, Williams CH, Bilheimer LT, Goodell S. Research glut and information famine: making research evidence more useful for policy-makers. Health Affairs. 2008;27(4):1177–82. [PubMed: 18607053]
- 2.
- Rosenbaum SE, Glenton C, Wiysonge CS, Abalos E, Mignini L, Young T, et al. Evidence summaries tailored to health policy-makers in low-and middle-income countries. Bull World Health Organ. 2011;89(1):54–61. [PMC free article: PMC3040014] [PubMed: 21346891]
- 3.
- Pettman TL, Armstrong R, Doyle J, Burford B, Anderson LM, Hillgrove T, et al. Strengthening evaluation to capture the breadth of public health practice: ideal vs. real. J Public Health. 2012;34(1):151–5. [PubMed: 22362969]
- 4.
- Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions, version 5.1.0. Oxford: Cochrane Collaboration; 2011. (http://handbook
.cochrane.org/ accessed 4 April 2017). - 5.
- Systematic reviews: CRD's guidance for undertaking reviews in health care. York, UK: Centre for Reviews and Dissemination, University of York; 2009. (http://www
.york.ac.uk/inst/crd/report4 .htm accessed 28 March 2017). - 6.
- Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P): elaboration and explanation. BMJ. 2015;349:g7647. [PubMed: 25555855]
- 7.
- Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. [PMC free article: PMC4320440] [PubMed: 25554246]
- 8.
- Wilczynski NL, Haynes RB, Lavis JN, Ramkissoonsingh R, Arnold-Oatley AE. Optimal search strategies for detecting health services research studies in MEDLINE. CMAJ. 2004;171(10):1179–85. [PMC free article: PMC524948] [PubMed: 15534310]
- 9.
- Wilczynski NL, Marks S, Haynes RB. Search strategies for identifying qualitative studies in CINAHL. Qual Health Res. 2007;17(5):705–10. [PubMed: 17478652]
- 10.
- Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181. [PMC free article: PMC3552766] [PubMed: 23185978]
- 11.
- Schulz KF, Altman DG, Moher D. CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. BMC Med. 2010;8(1):18. [PMC free article: PMC2860339] [PubMed: 20334633]
- 12.
- Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Int J Surg. 2014;12(12):1495–9. [PubMed: 25046131]
- 13.
- Des Jarlais DC, Lyles C, Crepaz N. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health. 2004;94(3):361–6. [PMC free article: PMC1448256] [PubMed: 14998794]
- 14.
- Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57. [PubMed: 17872937]
- 15.
- Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin CJ, Gülmezoglu M, et al. Using qualitative evidence in decision-making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLOS Med. 2015;12(10):e1001895. [PMC free article: PMC4624425] [PubMed: 26506244]
- 16.
- Conn VS, Valentine JC, Cooper HM, Rantz MJ. Grey literature in meta-analyses. Nurs Res. 2003;52(4):256–61. [PubMed: 12867783]
- 17.
- Crombie IK. The pocket guide to critical appraisal: a handbook for health care professionals. London: BMJ Publishing; 1997.
- ANNEX 1. A FORMAT FOR A HEN SYNTHESIS REPORT - A Resource for Developing an Evid...ANNEX 1. A FORMAT FOR A HEN SYNTHESIS REPORT - A Resource for Developing an Evidence Synthesis Report for Policy-Making
Your browsing activity is empty.
Activity recording is turned off.
See more...