© 2011 Crown Copyright.
Included under terms of UK Non-commercial Government License.
Bookshelf ID: NBK84046
NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.
NIHR Health Technology Assessment programme: Executive Summaries. Southampton (UK): NIHR Journals Library; 2003-.
Background
Methods for reviewing and synthesising findings from quantitative research studies in health care are well established. Although there is recognition of the need for qualitative research to be brought into the evidence base, there is no consensus about how this should be done and methods for synthesising qualitative research are at a relatively early stage of development.
Aim
Our aim was to undertake methodological research to evaluate meta-ethnography as a method for synthesising qualitative research studies in health and health care.
Methods of synthesis for qualitative research
A review of methods of qualitative synthesis was undertaken to examine the ways in which meta-ethnography, first described by Noblit and Hare (Noblit G, Hare R. Meta-ethnography: synthesising qualitative studies. 11th edn. London: Sage Publications; 1988), was being used, and to identify what other methods of qualitative synthesis were available. A range of methods for synthesising qualitative research was identified; none has become established, but meta-ethnography was the most widely cited method. Methods of qualitative synthesis could be broadly categorised as integrative or interpretative. In integrative syntheses, data in the primary studies are considered comparable and can therefore be pooled or aggregated. Methods falling into this category include numeric methods that involve the systematic pooling of qualitative data as a precursor to a quantitative analysis, narrative methods and cross-case techniques. Interpretative syntheses entail an emic approach with concepts and explanatory frameworks emerging through a process of induction. Meta-ethnography and grounded theory are examples of methods included in this second category.
Meta-ethnography has been applied in ways consistent with the approach originally described by Noblit and Hare (1988), but it has also been used as a procedure within an all-embracing form of synthesis called meta-study. Critical interpretative synthesis has also been proposed as a new method which evolved from an attempt to use meta-ethnography to bring together findings from a large and methodologically diverse group of studies.
Identification and selection of studies for synthesis
For this research, two full-qualitative syntheses were conducted using meta-ethnography: the first a synthesis of qualitative studies of medicine-taking and the second a synthesis of studies exploring patients’ experiences of living with rheumatoid arthritis (RA). Searching the literature to identify studies for possible inclusion in a qualitative synthesis remains problematic. Our findings suggest that multiple search strategies should be employed and that hand-searching key journals is particularly worthwhile. The yield of relevant papers produced by electronic databases appeared to be topic dependent, suggesting that a variety should be searched. Similarly, the effectiveness of the electronic search strategy depended on the subject of the search, making it advisable to try more than one approach. Potentially relevant studies identified in literature searches, conducted in July and August 2002, were appraised using a modified version of the Critical Appraisal Skills Programme [Critical Appraisal Skills Program. (CASP) collaboration for qualitative methodologies. 1998 URL: www.casp-uk.net] questions for understanding qualitative research. Candidate papers for both of our syntheses were excluded only on the grounds of lack of relevance to the aims of the synthesis or because the work failed to employ qualitative methods of data collection and analysis. Papers were not excluded on quality grounds alone. Quantifiable data from the appraisal process showed inter-rater agreement to be low.
Reproducibility
Before proceeding with the full syntheses, the first four papers to be synthesised in each of the two topic areas were independently synthesised by two researchers to explore the reproducibility of the meta-ethnographic method. The findings from these two preliminary syntheses produced mixed evidence of reproducibility. There were broad similarities in interpretation, but differences of detail. It is not possible to predict whether the differences would have become more or less pronounced as more papers were drawn into the syntheses.
Medicine-taking synthesis
Thirty-eight studies were entered into the synthesis, one of which did not contribute to the final synthesis. Most of the papers were about medicine-taking for chronic illness. Studies were initially synthesised by reciprocal translation within groups of papers defined by the type of medication. This process produced diagrams and textual summaries of medicine-taking within each group. The textual summaries were then synthesised thematically across the medicine groups as a lines-of-argument synthesis and the models were synthesised to produce a general model of medicine-taking. The synthesis revealed a general caution about taking medicine, and that the practice of lay testing of medicines was widespread. People were found to take their medicine passively or actively or to reject it outright. Some, in particular clinical areas, were coerced into taking it. Those who actively accepted their medicine often modified the regimen prescribed by a doctor, without the doctor’s knowledge. This synthesis concluded that people do not take their medicines as prescribed because of concerns about the medicines themselves. ‘Resistance’ emerged from the synthesis as a concept that best encapsulates the lay response to prescribed medicines. It was suggested that a future policy focus should be on the problems associated with the medicines themselves and on evaluating the effectiveness of alternative treatments that some people use in preference to prescribed medicines.
Synthesis of studies of lay experiences of living with rheumatoid arthritis
This synthesis began with 29 papers. Four of these could not be synthesised, leaving 25 papers (describing 22 studies) contributing to the final synthesis. Most of the papers were concerned with the everyday experience of living with RA. Papers were synthesised chronologically. The earliest paper in the series was used as an index paper and each subsequent paper entered into the synthesis was compared with it and all preceding papers. The smaller number and coherence of papers in this synthesis permitted the reciprocal translation of findings for all papers to be tabulated. These reciprocal translations were then subject to a process of reordering and reanalysis. The final synthesis was presented as a textual distillation of the findings supported by novel tabular summaries of the needs of people with RA and the general and specific coping strategies that they deployed to accommodate the disease. This synthesis did not produce significant new insights, probably because the early papers in the area were substantial and theoretically rich, and later papers were mostly confirmatory.
Conclusions
This methodological research, conducted between April 2002 and September 2004, has shown that meta-ethnography is an effective method for synthesising qualitative research. The meta-ethnographic method enables a body of qualitative research to be drawn together in a systematic way. The process of reciprocally translating the findings from each study into those from all the other studies in the synthesis, if applied rigorously, ensures that qualitative data can be combined. Following this essential process, the synthesis can then be expressed as a ‘line of argument’ that can be presented as text and in summary tables and diagrams or models. Meta-ethnography can produce significant new insights, as was achieved in the medicine-taking synthesis. However, as the synthesis of studies about lay experiences of arthritis showed, not all meta-ethnographic syntheses will lead to new insights. This does not signal failure, however, because, as our RA synthesis showed, the meta-ethnographic method is able to identify fields in which saturation has been reached and in which no theoretical development has taken place for some time, an outcome that can ensure that resources are not wasted in future. Both of our syntheses found that only a minority of the studies included referenced each other, suggesting that unnecessary replication occurred. In addition to being able to demonstrate what the cumulative knowledge is in a particular area, meta-ethnographic syntheses are also able to identify absences of knowledge and can reveal aspects of a body of literature that may have been obscured.
Meta-ethnography as described by Noblit and Hare (1988) is a highly interpretative method, and considerable immersion in the individual studies is necessary to achieve a synthesis. It is a method that places substantial demands upon the synthesiser and requires a high degree of qualitative research skill. Experience to date suggests that the inclusion of > ~40 papers would result in a trade-off between the breadth of included papers and the depth of scrutiny and thought invested in each stage of the synthesis. Meta-ethnography has great potential as a method of synthesis in qualitative health technology assessment, but it is still evolving and cannot, at present, be regarded as a standardised approach capable of application in a routinised way.
Funding
Funding for this study was provided by the Health Technology Assessment programme of the National Institute for Health Research.
Publication
- Fleeman N, Bagust A, Boland A, Dickson R, Dundar R, Moonan M, et al. Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research. Health Technol Assess 2011;15(43). [PubMed: 22176717]
NIHR Health Technology Assessment programme
The Health Technology Assessment (HTA) programme, part of the National Institute for Health Research (NIHR), was set up in 1993. It produces high-quality research information on the effectiveness, costs and broader impact of health technologies for those who use, manage and provide care in the NHS. ‘Health technologies’ are broadly defined as all interventions used to promote health, prevent and treat disease, and improve rehabilitation and long-term care.
The research findings from the HTA programme directly influence decision-making bodies such as the National Institute for Health and Clinical Excellence (NICE) and the National Screening Committee (NSC). HTA findings also help to improve the quality of clinical practice in the NHS indirectly in that they form a key component of the ‘National Knowledge Service’.
The HTA programme is needs led in that it fills gaps in the evidence needed by the NHS. There are three routes to the start of projects.
First is the commissioned route. Suggestions for research are actively sought from people working in the NHS, from the public and consumer groups and from professional bodies such as royal colleges and NHS trusts. These suggestions are carefully prioritised by panels of independent experts (including NHS service users). The HTA programme then commissions the research by competitive tender.
Second, the HTA programme provides grants for clinical trials for researchers who identify research questions. These are assessed for importance to patients and the NHS, and scientific rigour.
Third, through its Technology Assessment Report (TAR) call-off contract, the HTA programme commissions bespoke reports, principally for NICE, but also for other policy-makers. TARs bring together evidence on the value of specific technologies.
Some HTA research projects, including TARs, may take only months, others need several years. They can cost from as little as £40,000 to over £1 million, and may involve synthesising existing evidence, undertaking a trial, or other research collecting new data to answer a research problem.
The final reports from HTA projects are peer reviewed by a number of independent expert referees before publication in the widely read journal series Health Technology Assessment.
Criteria for inclusion in the HTA journal series
Reports are published in the HTA journal series if (1) they have resulted from work for the HTA programme, and (2) they are of a sufficiently high scientific quality as assessed by the referees and editors.
Reviews in Health Technology Assessment are termed ‘systematic’ when the account of the search, appraisal and synthesis methods (to minimise biases and random errors) would, in theory, permit the replication of the review by others.
The research reported in this issue of the journal was commissioned by the National Coordinating Centre for Research Methodology (NCCRM), and was formally transferred to the HTA programme in April 2007 under the newly established NIHR Methodology Panel. The HTA programme project number is 06/90/12. The contractual start date was in May 2002. The draft report began editorial review in November 2010 and was accepted for publication in July 2011. The commissioning brief was devised by the NCCRM who specified the research question and study design. The authors have been wholly responsible for all data collection, analysis and interpretation, and for writing up their work. The HTA editors and publisher have tried to ensure the accuracy of the authors’ report and would like to thank the referees for their constructive comments on the draft document. However, they do not accept liability for damages or losses arising from material published in this report.
The views expressed in this publication are those of the authors and not necessarily those of the HTA programme or the Department of Health.
Editor-in-Chief: Professor Tom Walley CBE
Series Editors: Dr Martin Ashton-Key, Professor Aileen Clarke, Dr Tom Marshall, Professor John Powell, Dr Rob Riemsma and Professor Ken Stein
Associate Editor: Dr Peter Davidson
- PubMedLinks to PubMed
- A methodological systematic review of meta-ethnography conduct to articulate the complex analytical phases.[BMC Med Res Methodol. 2019]A methodological systematic review of meta-ethnography conduct to articulate the complex analytical phases.France EF, Uny I, Ring N, Turley RL, Maxwell M, Duncan EAS, Jepson RG, Roberts RJ, Noyes J. BMC Med Res Methodol. 2019 Feb 18; 19(1):35. Epub 2019 Feb 18.
- A mega-ethnography of eleven qualitative evidence syntheses exploring the experience of living with chronic non-malignant pain.[BMC Med Res Methodol. 2017]A mega-ethnography of eleven qualitative evidence syntheses exploring the experience of living with chronic non-malignant pain.Toye F, Seers K, Hannink E, Barker K. BMC Med Res Methodol. 2017 Aug 1; 17(1):116. Epub 2017 Aug 1.
- Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care.[Soc Sci Med. 2003]Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care.Campbell R, Pound P, Pope C, Britten N, Pill R, Morgan M, Donovan J. Soc Sci Med. 2003 Feb; 56(4):671-84.
- Review Health professionals' experience of teamwork education in acute hospital settings: a systematic review of qualitative literature.[JBI Database System Rev Implem...]Review Health professionals' experience of teamwork education in acute hospital settings: a systematic review of qualitative literature.Eddy K, Jordan Z, Stephenson M. JBI Database System Rev Implement Rep. 2016 Apr; 14(4):96-137.
- Review A methodological systematic review of what's wrong with meta-ethnography reporting.[BMC Med Res Methodol. 2014]Review A methodological systematic review of what's wrong with meta-ethnography reporting.France EF, Ring N, Thomas R, Noyes J, Maxwell M, Jepson R. BMC Med Res Methodol. 2014 Nov 19; 14:119. Epub 2014 Nov 19.
- Evaluating meta-ethnography: systematic analysis and synthesis of qualitative re...Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research - NIHR Health Technology Assessment programme: Executive Summaries
Your browsing activity is empty.
Activity recording is turned off.
See more...