U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

National Collaborating Centre for Mental Health (UK). Bipolar Disorder: The NICE Guideline on the Assessment and Management of Bipolar Disorder in Adults, Children and Young People in Primary and Secondary Care. London: The British Psychological Society and The Royal College of Psychiatrists; 2014 Sep. (NICE Clinical Guidelines, No. 185.)

  • April 2018: Footnotes and cautions have been added and amended to link to the MHRA's latest advice and resources on sodium valproate. Sodium valproate must not be used in pregnancy, and only used in girls and women when there is no alternative and a pregnancy prevention plan is in place. This is because of the risk of malformations and developmental abnormalities in the baby. November 2017: Footnotes for some recommendations were updated with current UK marketing authorisations and MHRA advice. Links to other guidelines have also been updated. Some research recommendations have been stood down. See these changes in the short version of the guideline.

April 2018: Footnotes and cautions have been added and amended to link to the MHRA's latest advice and resources on sodium valproate. Sodium valproate must not be used in pregnancy, and only used in girls and women when there is no alternative and a pregnancy prevention plan is in place. This is because of the risk of malformations and developmental abnormalities in the baby. November 2017: Footnotes for some recommendations were updated with current UK marketing authorisations and MHRA advice. Links to other guidelines have also been updated. Some research recommendations have been stood down. See these changes in the short version of the guideline.

Cover of Bipolar Disorder

Bipolar Disorder: The NICE Guideline on the Assessment and Management of Bipolar Disorder in Adults, Children and Young People in Primary and Secondary Care.

Show details

APPENDIX 11Case Identification - Study Characteristics and Risk of Bias Tables

Abbreviations

ADHD

attention deficit hyperactivity disorder

BD

bipolar disorder

CABF

Child and Adolescent Bipolar Foundation

CMRS-P

Child Mania Rating Scale – Parent

DSM(-IV-R)

Diagnostic and Statistical Manual of Mental Disorders (4th edition revised)

GDG

Guideline Development Group

GOS

Geelong Osteoporosis Study

HC

healthy controls

ICD

International Classification of Diseases

MDD

major depressive disorder

MDQ

Mood Disorder Questionnaire

n/N

number of participants

NOS

not otherwise specified

NR

not reported

PDD

pervasive developmental disorder

QADAS

Quality Assessment of Diagnostic Accuracy Studies

SCID-I/NP

Structured Clinical Interview for DSM-IV Axis I Disorders (Non-patient edition)

WASH-U-KSADS

Washington University in St Louis Kiddie Schedule for Affective Disorders and Schizophrenia

1. Study Characteristics Table

StudyInstrumentNo. of itemsRange (cut-off)RecruitmentNFemale, n (%)AgeCountryPrevalenceSensitivitySpecificity
DODD2009MDQ13Yes/no (7)Community1,0661,066 (100%)51Australia2.3%0.250.99
HENRY2008CMRS-P104-point Likert scale. 4-40 (10)Community and psychiatric settings10045 (45%)10US50%0.920.82
HIRSCHFELD2003MDQ13Yes/no (7)Community (general population)695NR46US11.2%0.280.97
TILLMAN2005Conners’ Abbreviated Parent Questionnaire104 possible answers per question. 4-40 (9 for 78 years, 8 for 910 years, 6 for 1116 years)Community and psychiatric settings26489 (34%)11US34.9%0.730.86

2. Methodology Checklist: The Quadas-2 Tool for Studies of Diagnostic Test Accuracy

2.1. DODD2009

2.1.1. Phase 1: State the review question

Patients (setting, intended use of index test, presentation, prior testing):

Children and young people (aged 18 years and younger) and adults with suspected bipolar disorder

Index test(s):

Brief screening questionnaires (< 15 items) identified by the GDG

Reference standard and target condition:

DSM or ICD diagnosis of bipolar disorder

2.1.2. Phase 2: Draw a flow diagram for the primary study

Image app11f1

2.1.3. Phase 3: Risk of bias and applicability judgements

QUADAS-2 is structured so that four key domains are each rated in terms of the risk of bias and the concern regarding applicability to the review question (as stated in Phase 1). Each key domain has a set of signalling questions to help reach the judgements regarding bias and applicability.

Domain 1Patient selection

A. Risk of bias

Describe methods of patient selection:

‘Included data collected from women participating in the Geelong Osteoporosis Study (GOS), a large epidemiological study involving age-stratified community-based samples of women randomly recruited from the electoral roll for the region (Barwon Statistical Division, South-Eastern Australia). The initial sample was recruited between 1994 and 1997, with 1,494 women (median age = 54 years, interquartile range [IQR] 37-72) agreeing to participate [18]. A further cohort of 200 women aged 20-29 years was also recruited at the time of the 10-year follow-up.’

Was a consecutive or random sample of patients enrolled?Yes
Was a case-control design avoided?Yes
Did the study avoid inappropriate exclusions?Yes
Could the selection of patients have introduced bias?
Risk: Low
B. Concerns regarding applicability

Describe included patients (prior testing, presentation, intended use of index test and setting):

‘From a potential pool of 1117 women, enrolled in the GOS at the time of the study, 23 women who did not participate in the clinical interview and a further 28 who had not completed the MDQ were excluded from the analyses, resulting in a sample of 1,066 women (95%) aged 21-94 years eligible for inclusion.’

Is there concern that the included patients do not match the review question?

Concern: Low

Domain 2Index test(s)

A. Risk of bias

Describe the index test and how it was conducted and interpreted:

‘The MDQ is a self-report screening instrument for detecting previous mania and hypomania, characteristic of bipolar I and II disorders, respectively [6]. The MDQ includes 13 questions relating to manic or hypomanic symptoms derived from DSM-IV criteria plus a further two items assessing the temporal clustering of symptoms and functional impairment. This questionnaire has been used and validated in both primary care and community settings [1,7].’

Were the index test results interpreted without knowledge of the results of the reference standard?Yes
If a threshold was used, was it pre-specified?Yes

Could the conduct or interpretation of the index test have introduced bias?

Risk: Unclear

B. Concerns regarding applicability

Is there concern that the index test, its conduct, or interpretation differ from the review question?

Concern: High (women only)

Domain 3Reference standard

A. Risk of bias

Describe the reference standard and how it was conducted and interpreted:

‘Psychiatric status was assessed using the Structured Clinical Interview for DSM-IV-TR Research Version, Non-patient edition (SCID). The SCID-I/NP was used to identify those who had ever experienced a depressive disorder, including bipolar disorder (I, II and not otherwise specified or NOS), major depressive disorder, minor depression, dysthymia, mood disorder due to a general medical condition and substance-induced mood disorder and/or any anxiety disorder. All psychiatric interviews were conducted by trained personnel who were blind to the results from the MDQ screen.’

Is the reference standard likely to correctly classify the target condition?Yes
Were the reference standard results interpreted without knowledge of the results of the index test?Yes

Could the reference standard, its conduct, or its interpretation have introduced bias?

Risk: Low

B. Concerns regarding applicability

Is there concern that the target condition as defined by the reference standard does not match the review question?

Concern: Low

Domain 4Flow and timing

A. Risk of bias

Describe any patients who did not receive the index test(s) and/or reference standard or who were excluded from the 2 x 2 table (refer to flow diagram):

Describe the time interval and any interventions between index test(s) and reference standard:

Not described.

Was there an appropriate interval between index test(s) and reference standard?Unclear
Did all patients receive a reference standard?Yes
Did patients receive the same reference standard?Yes
Were all patients included in the analysis?Yes

Could the patient flow have introduced bias?

Risk: Low

2.2. HENRY2008

2.2.1. Phase 1: State the review question

Patients (setting, intended use of index test, presentation, prior testing):

Children and young people (aged 18 years and younger) and adults with suspected bipolar disorder

Index test(s):

Brief screening questionnaires (< 15 items) identified by the GDG

Reference standard and target condition:

DSM or ICD diagnosis of bipolar disorder

2.2.2. Phase 2: Draw a flow diagram for the primary study

Image app11f2

2.2.3. Phase 3: Risk of bias and applicability judgements

QUADAS-2 is structured so that four key domains are each rated in terms of the risk of bias and the concern regarding applicability to the review question (as stated in Phase 1). Each key domain has a set of signalling questions to help reach the judgements regarding bias and applicability.

Domain 1Patient selection

A. Risk of bias

Describe methods of patient selection:

‘Subjects were included in this sample if they were: between 5 and 17 years of age, inclusive; had been diagnosed with ADHD, BD I or II, or BD-NOS; or were healthy controls (HC) with no psychiatric symptoms, based on the WASH-U- KSADS (Geller, Zimerman et al., 2001) interview. Potential participants were excluded if they: suffered from head injury, epilepsy, a pervasive development disorder (PDD), or mental retardation; had significant medical illness; or were taking any medications or substances that could alter their moods. Patients currently under treatment were excluded as the purpose of the study was to screen for subjects at the intake phase, regardless of the severity of their disorders.’

‘Subjects with BD were recruited from among the community, pediatricians, child psychiatrists, the Child and Adolescent Bipolar Foundation (CABF), and our mood disorders clinic.’

Was a consecutive or random sample of patients enrolled?Unclear
Was a case-control design avoided?No
Did the study avoid inappropriate exclusions?Unclear

Could the selection of patients have introduced bias?

Risk: Unclear

B. Concerns regarding applicability

Describe included patients (prior testing, presentation, intended use of index test and setting):

‘The final sample consisted of 150 subjects (BD = 50; ADHD = 50; HC = 50).’

Is there concern that the included patients do not match the review question?

Concern: Low

Domain 2Index test(s)

A. Risk of bias

Describe the index test and how it was conducted and interpreted:

‘The research staff (n = 6) who administered the demographic and parent/self- report measures were different from those who conducted the diagnostic interviews (n = 4). The CMRS-P was administered prior to conducting the diagnostic interview to minimize bias and fatigue effects.’

‘To create a brief CMRS-P, we selected items that allowed us to cover the entire range of severe mania symptoms and were separated by relatively equal intervals.’

Were the index test results interpreted without knowledge of the results of the reference standard?Yes
If a threshold was used, was it pre-specified?No

Could the conduct or interpretation of the index test have introduced bias?

Risk: Low

B. Concerns regarding applicability

Is there concern that the index test, its conduct, or interpretation differ from the review question?

Concern: Unclear

Domain 3Reference standard

A. Risk of bias

Describe the reference standard and how it was conducted and interpreted:

‘The mania section of the WASH-U-KSADS is a semistructured diagnostic interview used to diagnose mania. Symptoms are rated on a continuous severity scale by interviewing parents and children (Geller, Zimerman et al., 2001). The WASH-U-KSADS includes specific questions about onset and offset of symptoms, ADHD assessment, and criteria for diagnosis of manic behavior or thinking. The WASH-U KSADS has demonstrated 100% interrater reliability (Geller, Zimerman et al., 2001).’

Is the reference standard likely to correctly classify the target condition?Yes
Were the reference standard results interpreted without knowledge of the results of the index test?Yes

Could the reference standard, its conduct, or its interpretation have introduced bias?

Risk: Low

B. Concerns regarding applicability

Is there concern that the target condition as defined by the reference standard does not match the review question?

Concern: Low

Domain 4Flow and timing

A. Risk of bias

Describe any patients who did not receive the index test(s) and/or reference standard or who were excluded from the 2 x 2 table (refer to flow diagram):

‘Six subjects were excluded due to primary diagnosis of pervasive developmental disorder (n = 53), medication for posttraumatic stress disorder (n = 51), aging-out at 18th birthday (n = 51), and father’s withdrawal of consent during a custody battle (n = 51).’

Describe the time interval and any interventions between index test(s) and reference standard:

Not described.

Was there an appropriate interval between index test(s) and reference standard?Unclear
Did all patients receive a reference standard?Yes
Did patients receive the same reference standard?Yes
Were all patients included in the analysis?Yes

Could the patient flow have introduced bias?

Risk: Low

2.3. HIRSCHFELD2003

2.3.1. Phase 1: State the review question

Patients (setting, intended use of index test, presentation, prior testing):

Children and young people (aged 18 years and younger) and adults with suspected bipolar disorder

Index test(s):

Brief screening questionnaires (< 15 items) identified by the GDG

Reference standard and target condition:

DSM or ICD diagnosis of bipolar disorder

2.3.2. Phase 2: Draw a flow diagram for the primary study

Image app11f3

2.3.3. Phase 3: Risk of bias and applicability judgements

QUADAS-2 is structured so that four key domains are each rated in terms of the risk of bias and the concern regarding applicability to the review question (as stated in Phase 1). Each key domain has a set of signalling questions to help reach the judgements regarding bias and applicability.

Domain 1Patient selection

A. Risk of bias

Describe methods of patient selection:

‘Subjects for this study were a subset of respondents in a large general population epidemiological study of bipolar I and II disorders (the “prevalence study”).

The target sample for the current study was 700 randomly selected subjects stratified by Mood Disorder Questionnaire score.

Approximately 40 subjects were selected for each Mood Disorder Questionnaire.’

Was a consecutive or random sample of patients enrolled?Yes
Was a case-control design avoided?Yes
Did the study avoid inappropriate exclusions?Yes

Could the selection of patients have introduced bias?

Risk: Low

B. Concerns regarding applicability

Describe included patients (prior testing, presentation, intended use of index test and setting):

‘The sample’s mean age was 46.1 years (weighted). A total of 95% (weighted) reported high school completion or the equivalent. A total of 89% (weighted) were white non-Hispanic, 5% were black non-Hispanic, 2.3% were Hispanic, and the remainder of subjects were of other ethnic back- grounds.’

Is there concern that the included patients do not match the review question?

Concern: Low

Domain 2Index test(s)

A. Risk of bias

Describe the index test and how it was conducted and interpreted:

‘The Mood Disorder Questionnaire is a self-report inventory that screens for bipolar I and II disorders with 13 yes/no items derived from both DSM-IV criteria and clinical experience (1). A positive screen requires that seven or more items be endorsed, that at least several of the items co-occurred, and that the symptoms caused at least moderate psychosocial impairment.’

Were the index test results interpreted without knowledge of the results of the reference standard?Yes
If a threshold was used, was it pre-specified?Yes

Could the conduct or interpretation of the index test have introduced bias?

Risk: Low

B. Concerns regarding applicability

Is there concern that the index test, its conduct, or interpretation differ from the review question?

Concern: Low

Domain 3Reference standard

A. Risk of bias

Describe the reference standard and how it was conducted and interpreted:

‘A team of 10 doctoral and two master’s-level clinical and psychiatric research interviewers were recruited and trained to administer an abbreviated lifetime version of the SCID for Axis I Disorders (4). Each subject was contacted by survey staff and scheduled for the SCID as a computer-aided telephone interview. The interviewers were blind to the results of the initial Mood Disorder Questionnaire.’

Is the reference standard likely to correctly classify the target condition?Yes
Were the reference standard results interpreted without knowledge of the results of the index test?Yes

Could the reference standard, its conduct, or its interpretation have introduced bias?

Risk: Low

B. Concerns regarding applicability

Is there concern that the target condition as defined by the reference standard does not match the review question?

Concern: Low

Domain 4Flow and timing

A. Risk of bias

Describe any patients who did not receive the index test(s) and/or reference standard or who were excluded from the 2 x 2 table (refer to flow diagram):

‘A total of 711 subjects were identified by National Family Opinion as meeting the study entry criteria. Of these, 12 refused the reinterview. An additional two had incomplete data and were not included in the analyses. A total of 695 subjects were left who completed the telephone research interview and whose data were complete for analyses.’

Describe the time interval and any interventions between index test(s) and reference standard:

Not described.

Was there an appropriate interval between index test(s) and reference standard?Unclear
Did all patients receive a reference standard?Yes
Did patients receive the same reference standard?Yes
Were all patients included in the analysis?No

Could the patient flow have introduced bias?

Risk: Low

2.4. TILLMAN2005

2.4.1. Phase 1: State the review question

Patients (setting, intended use of index test, presentation, prior testing):

Children and young people (aged 18 years and younger) and adults with suspected bipolar disorder

Index test(s):

Brief screening questionnaires (< 15 items) identified by the GDG

Reference standard and target condition:

DSM or ICD diagnosis of bipolar disorder

2.4.2. Phase 2: Draw a flow diagram for the primary study

Image app11f4

2.4.3. Phase 3: Risk of bias and applicability judgements

QUADAS-2 is structured so that four key domains are each rated in terms of the risk of bias and the concern regarding applicability to the review question (as stated in Phase 1). Each key domain has a set of signalling questions to help reach the judgements regarding bias and applicability.

Domain 1Patient selection

A. Risk of bias

Describe methods of patient selection:

‘To optimize generalization, subjects with a prepubertal and early adolescent bipolar disorder phenotype and subjects with ADHD were identified through consecutive new case ascertainment from outpatient child psychiatric and pediatric sites. The healthy comparison group was identified through a random survey that matched the comparison subjects to subjects with a prepubertal and early adolescent bipolar disorder phenotype by age, gender, socioeconomic status, ethnicity, and zip code.’

Was a consecutive or random sample of patients enrolled?Yes
Was a case-control design avoided?No
Did the study avoid inappropriate exclusions?Yes

Could the selection of patients have introduced bias?

Risk: Low

B. Concerns regarding applicability

Describe included patients (prior testing, presentation, intended use of index test and setting):

Participants had bipolar, ADHD or were healthy controls, 7-16 years old.

Is there concern that the included patients do not match the review question?

Concern: Low

Domain 2Index test(s)

A. Risk of bias

Describe the index test and how it was conducted and interpreted:

‘Parents completed the Conners’ Abbreviated Parent Questionnaire about their children before the WASH-U-KSADS interviews. The Conners’ Abbreviated Parent Questionnaire, an instrument for assessing ADHD in children and adolescents, has 10 items, each with four possible answers. Each item has a minimum score of 1 and a maximum score of 4.’

Were the index test results interpreted without knowledge of the results of the reference standard?Yes
If a threshold was used, was it pre-specified?No

Could the conduct or interpretation of the index test have introduced bias?

Risk: Low

B. Concerns regarding applicability

Is there concern that the index test, its conduct, or interpretation differ from the review question?

Concern: Low

Domain 3Reference standard

A. Risk of bias

Describe the reference standard and how it was conducted and interpreted:

‘The Washington University in St. Louis Kiddie Schedule for Affective Disorders and Schizophrenia (WASH-U-KSADS) (6), a semistructured interview, was administered by experienced re- search nurses separately to parents about their children and to children about themselves. The nurses were blind to the diagnostic group of the subjects.’

Is the reference standard likely to correctly classify the target condition?Yes
Were the reference standard results interpreted without knowledge of the results of the index test?Yes

Could the reference standard, its conduct, or its interpretation have introduced bias?

Risk: Low

B. Concerns regarding applicability

Is there concern that the target condition as defined by the reference standard does not match the review question?

Concern: Low

Domain 4Flow and timing

A. Risk of bias

Describe any patients who did not receive the index test(s) and/or reference standard or who were excluded from the 2 x 2 table (refer to flow diagram):

‘Subjects enrolled in the study included 93 with a prepubertal and early adolescent bipolar disorder phenotype, 81 with ADHD, and 94 healthy comparison subjects. Four subjects with missing values for the Conners’ Abbreviated Parent Questionnaire were excluded from the analysis, leaving 92 prepubertal and early adolescent bipolar disorder phenotype, 80 ADHD, and 92 healthy comparison subjects.’

Describe the time interval and any interventions between index test(s) and reference standard:

Not described

Was there an appropriate interval between index test(s) and reference standard?Unclear
Did all patients receive a reference standard?No
Did patients receive the same reference standard?Yes
Were all patients included in the analysis?No

Could the patient flow have introduced bias?

Risk: Unclear

© The British Psychological Society & The Royal College of Psychiatrists, 2014.

All rights reserved. No part of this guideline may be reprinted or reproduced or utilised in any form or by any electronic, mechanical, or other means, now known or hereafter invented, or in any information storage or retrieval system, without permission in writing from the National Collaborating Centre for Mental Health. Enquiries in this regard should be directed to the Centre Administrator: ku.ca.hcyspcr@nimdAHMCCN

Bookshelf ID: NBK545941

Views

  • PubReader
  • Print View
  • Cite this Page
  • PDF version of this page (270K)
  • PDF version of this title (6.2M)

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...