Assessment of Overall Risk of Bias for Individual Studies

There are three categories for describing the overall risk of bias for assessed studies: low risk of bias; moderate risk of bias; and high risk of bias.

References for Appendix C

1.

Perrin EC, Sheldrick RC, McMenamy JM, et al. Improving Parenting Skills for Families of Young Children in Pediatric Settings: A Randomized Clinical Trial. JAMA Pediatr. 2013 Nov 4 [PubMed: 24190691]

2.

Jones DJ, Forehand R, Cuellar J, et al. Technology-Enhanced Program for Child Disruptive Behavior Disorders: Development and Pilot Randomized Control Trial. J Clin Child Adolesc Psychol. 2013 Aug 7 [PMC free article: PMC3871925] [PubMed: 23924046]

3.

Somech LY, Elizur Y. Promoting self-regulation and cooperation in pre-kindergarten children with conduct problems: a randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2012 Apr;51(4):412–22. [PubMed: 22449647]

4.

Cummings JG, Wittenberg JV. Supportive expressive therapy--Parent child version: An exploratory study. Psychotherapy (Chic). 2008 Jun;45(2):148–64. [PubMed: 22122414]

5.

Lavigne JV, Lebailly SA, Gouze KR, et al. Treating oppositional defiant disorder in primary care: a comparison of three models. J Pediatr Psychol. 2008 Jun;33(5):449–61. [PubMed: 17956932]

6.

Hutchings J, Gardner F, Bywater T, et al. Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trial. BMJ. 2007 Mar 31;334(7595):678. [PMC free article: PMC1839187] [PubMed: 17350966]

7.

Markie-Dadds C, Sanders MR. A Controlled Evaluation of an Enhanced Self-Directed Behavioural Family Intervention for Parents of Children With Conduct Problems in Rural and Remote Areas. Behaviour Change. 2006;23(1):55–72.

8.

McGilloway S, Mhaille GN, Bywater T, et al. A parenting intervention for childhood behavioral problems: A randomized controlled trial in disadvantaged community-based settings. J Consult Clin Psychol. 2012;80(1):116–27. [PubMed: 22148879]

9.

Markie-Dadds C, Sanders MR. Self-Directed Triple P (Positive Parenting Program) for Mothers with Children at-Risk of Developing Conduct Problems. Behav Cogn Psychother. 2006;34(3):259–75.

10.

Sanders MR, Markie-Dadds C, Tully LA, et al. The triple P-positive parenting program: a comparison of enhanced, standard, and self-directed behavioral family intervention for parents of children with early onset conduct problems. J Consult Clin Psychol. 2000 Aug;68(4):624–40. [PubMed: 10965638]

11.

Connell S, Sanders MR, Markie-Dadds C. Self-directed behavioral family intervention for parents of oppositional children in rural and remote areas. Behav Modif. 1997 Oct;21(4):379–408. [PubMed: 9337598]

12.

Sanders MR, Baker S, Turner KM. A randomized controlled trial evaluating the efficacy of Triple P Online with parents of children with early-onset conduct problems. Behav Res Ther. 2012 Nov;50(11):675–84. [PubMed: 22982082]

13.

Jouriles EN, McDonald R, Spiller L, et al. Reducing conduct problems among children of battered women. J Consult Clin Psychol. 2001 Oct;69(5):774–85. [PubMed: 11680554]

14.

Bagner DM, Sheinkopf SJ, Vohr BR, et al. Parenting intervention for externalizing behavior problems in children born premature: an initial examination. J Dev Behav Pediatr. 2010 Apr;31(3):209–16. [PMC free article: PMC2866142] [PubMed: 20375736]

15.

McCabe K, Yeh M. Parent-child interaction therapy for Mexican Americans: a randomized clinical trial. J Clin Child Adolesc Psychol. 2009 Sep;38(5):753–9. [PubMed: 20183659]

16.

Schuhmann EM, Foote RC, Eyberg SM, et al. Efficacy of parent-child interaction therapy: interim report of a randomized trial with short-term maintenance. J Clin Child Psychol. 1998 Mar;27(1):34–45. [PubMed: 9561935]

17.

Eyberg SM, Boggs SR, Algina J. Parent-child interaction therapy: a psychosocial model for the treatment of young children with conduct problem behavior and their families. Psychopharmacol Bull. 1995;31(1):83–91. [PubMed: 7675994]

18.

Nixon RD, Sweeney L, Erickson DB, et al. Parent-child interaction therapy: a comparison of standard and abbreviated treatments for oppositional defiant preschoolers. J Consult Clin Psychol. 2003 Apr;71(2):251–60. [PubMed: 12699020]

19.

Sells SP, Early KW, Smith TE. Reducing Adolescent Oppositional and Conduct Disorders: An Experimental Design Using the Parenting with Love and Limits® Model. Professional Issues in Criminal Justice. 2011;6(3)

20.

Sanders MR, McFarland M. Treatment of depressed mothers with disruptive children: A controlled evaluation of cognitive behavioral family intervention. Behav Ther. 2000 Winter;31(1):89–112.

21.

Havighurst SS, Wilson KR, Harley AE, et al. “Tuning into Kids”: reducing young children's behavior problems using an emotion coaching parenting program. Child Psychiatry Hum Dev. 2013 Apr;44(2):247–64. [PubMed: 22820873]

22.

Nixon RDV. Changes in hyperactivity and temperament in behaviourally disturbed preschoolers after parent-child interaction therapy (PCIT). Behaviour Change. 2001;18(3):168–76.

23.

van Manen TG, Prins PJ, Emmelkamp PM. Reducing aggressive behavior in boys with a social cognitive group treatment: results of a randomized, controlled trial. J Am Acad Child Adolesc Psychiatry. 2004 Dec;43(12):1478–87. [PubMed: 15564817]

24.

Kjobli J, Ogden T. A randomized effectiveness trial of brief parent training in primary care settings. Prev Sci. 2012 Dec;13(6):616–26. [PubMed: 22956303]

25.

Axberg U, Broberg AG. Evaluation of “the incredible years” in Sweden: the transferability of an American parent-training program to Sweden. Scand J Psychol. 2012 Jun;53(3):224–32. [PubMed: 22621727]

26.

McGrath PJ, Lingley-Pottie P, Thurston C, et al. Telephone-based mental health interventions for child disruptive behavior or anxiety disorders: randomized trials and overall analysis. J Am Acad Child Adolesc Psychiatry. 2011 Nov;50(11):1162–72. [PubMed: 22024004]

27.

Kling A, Forster M, Sundell K, et al. A randomized controlled effectiveness trial of parent management training with varying degrees of therapist support. Behav Ther. 2010 Dec;41(4):530–42. [PubMed: 21035616]

28.

Ogden T, Hagen KA. Treatment effectiveness of Parent Management Training in Norway: a randomized controlled trial of children with conduct problems. J Consult Clin Psychol. 2008 Aug;76(4):607–21. [PubMed: 18665689]

29.

Gardner F, Burton J, Klimes I. Randomised controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: outcomes and mechanisms of change. J Child Psychol Psychiatry. 2006 Nov;47(11):1123–32. [PubMed: 17076751]

30.

Webster-Stratton C. Advancing videotape parent training: a comparison study. J Consult Clin Psychol. 1994 Jun;62(3):583–93. [PubMed: 8063985]

31.

Hutchings J, Appleton P, Smith M, et al. Evaluation of two treatments for children with severe behaviour problems: Child behaviour and maternal mental health outcomes. Behav Cogn Psychother. 2002 Jul;30(3):279–95.

32.

Scott S, Sylva K, Doolan M, et al. Randomised controlled trial of parent groups for child antisocial behaviour targeting multiple risk factors: the SPOKES project. J Child Psychol Psychiatry. 2010 Jan;51(1):48–57. [PubMed: 19732250]

33.

Larsson B, Fossum S, Clifford G, et al. Treatment of oppositional defiant and conduct problems in young Norwegian children : results of a randomized controlled trial. Eur Child Adolesc Psychiatry. 2009 Jan;18(1):42–52. [PubMed: 18563473]

34.

van de Wiel NM, Matthys W, Cohen-Kettenis PT, et al. The effectiveness of an experimental treatment when compared to care as usual depends on the type of care as usual. Behav Modif. 2007 May;31(3):298–312. [PubMed: 17438344]

35.

Drugli MB, Larsson B. Children aged 4-8 years treated with parent training and child therapy because of conduct problems: generalisation effects to day-care and school settings. Eur Child Adolesc Psychiatry. 2006 Oct;15(7):392–9. [PubMed: 16614786]

36.

Webster-Stratton C, Reid MJ, Hammond M. Treating children with early-onset conduct problems: intervention outcomes for parent, child, and teacher training. J Clin Child Adolesc Psychol. 2004 Mar;33(1):105–24. [PubMed: 15028546]

37.

Cabiya JJ, Padilla-Cotto L, González K, et al. Effectiveness of a cognitive-behavioral intervention for Puerto Rican children. Revista Interamericana de Psicología. 2008;42(2):195–202.

38.

Webster-Stratton C, Hammond M. Treating children with early-onset conduct problems: a comparison of child and parent training interventions. J Consult Clin Psychol. 1997 Feb;65(1):93–109. [PubMed: 9103739]

39.

Boylan K, Macpherson HA, Fristad MA. Examination of disruptive behavior outcomes and moderation in a randomized psychotherapy trial for mood disorders. J Am Acad Child Adolesc Psychiatry. 2013 Jul;52(7):699–708. [PMC free article: PMC4326010] [PubMed: 23800483]

40.

Augimeri LK, Farrington DP, Koegl CJ, et al. The SNAPTM Under 12 Outreach Project: Effects of a community based program for children with conduct problems. J Child Fam Stud. 2007;16(6):799–807.

41.

Kolko DJ. Efficacy of cognitive-behavioral treatment and fire safety education for children who set fires: initial and follow-up outcomes. J Child Psychol Psychiatry. 2001 Mar;42(3):359–69. [PubMed: 11321205]

42.

Kolko DJ, Campo JV, Kelleher K, et al. Improving access to care and clinical outcome for pediatric behavioral problems: a randomized trial of a nurse-administered intervention in primary care. J Dev Behav Pediatr. 2010 Jun;31(5):393–404. [PMC free article: PMC3057358] [PubMed: 20495474]

43.

Kolko DJ, Dorn LD, Bukstein OG, et al. Community vs. clinic-based modular treatment of children with early-onset ODD or CD: a clinical trial with 3-year follow-up. J Abnorm Child Psychol. 2009 Jul;37(5):591–609. [PMC free article: PMC4986609] [PubMed: 19221871]

44.

Greene RW, Ablon JS, Goring JC, et al. Effectiveness of collaborative problem solving in affectively dysregulated children with oppositional-defiant disorder: initial findings. J Consult Clin Psychol. 2004 Dec;72(6):1157–64. [PubMed: 15612861]

45.

Jouriles EN, McDonald R, Rosenfield D, et al. Reducing conduct problems among children exposed to intimate partner violence: a randomized clinical trial examining effects of Project Support. J Consult Clin Psychol. 2009 Aug;77(4):705–17. [PubMed: 19634963]

46.

Barrett P, Turner C, Rombouts S, et al. Reciprocal skills training in the treatment of externalising behaviour disorders in childhood: A preliminary investigation. Behaviour Change. 2000;17(4):221–34.

47.

Brestan EV, Eyberg SM, Boggs SR, et al. Parent–child interaction therapy: Parents' perceptions of untreated siblings. Child Fam Behav Ther. 1997;19(3):13–28.

48.

Rohde P, Clarke GN, Mace DE, et al. An efficacy/effectiveness study of cognitive-behavioral treatment for adolescents with comorbid major depression and conduct disorder. J Am Acad Child Adolesc Psychiatry. 2004 Jun;43(6):660–8. [PubMed: 15167082]

49.

Weiss B, Han S, Harris V, et al. An Independent Randomized Clinical Trial of Multisystemic Therapy With Non-Court-Referred Adolescents With Serious Conduct Problems. J Consult Clin Psychol. 2013 Aug 12 [PMC free article: PMC3830634] [PubMed: 23937347]

50.

Butler S, Baruch G, Hickey N, et al. A randomized controlled trial of multisystemic therapy and a statutory therapeutic intervention for young offenders. J Am Acad Child Adolesc Psychiatry. 2011 Dec;50(12):1220–35 e2. [PubMed: 22115143]

51.

Asscher JJ, Deković M, Manders WA, et al. A randomized controlled trial of the effectiveness of multisystemic therapy in the Netherlands: Post-treatment changes and moderator effects. J Exp Criminol. 2013;9(2):169–87.

52.

Borduin CM, Mann BJ, Cone LT, et al. Multisystemic treatment of serious juvenile offenders: long-term prevention of criminality and violence. J Consult Clin Psychol. 1995 Aug;63(4):569–78. [PubMed: 7673534]

53.

Sundell K, Hansson K, Lofholm CA, et al. The transportability of multisystemic therapy to Sweden: short-term results from a randomized trial of conduct-disordered youths. J Fam Psychol. 2008 Aug;22(4):550–60. [PubMed: 18729669]

54.

Shechtman Z, Birani-Nasaraladin D. Treating mothers of aggressive children: a research study. Int J Group Psychother. 2006 Jan;56(1):93–112. [PubMed: 16555426]

55.

Santisteban DA, Coatsworth JD, Perez-Vidal A, et al. Efficacy of brief strategic family therapy in modifying Hispanic adolescent behavior problems and substance use. J Fam Psychol. 2003 Mar;17(1):121–33. [PMC free article: PMC1480818] [PubMed: 12666468]

56.

Nickel M, Luley J, Krawczyk J, et al. Bullying girls - changes after brief strategic family therapy: a randomized, prospective, controlled trial with one-year follow-up. Psychother Psychosom. 2006;75(1):47–55. [PubMed: 16361874]

57.

Nickel MK, Krawczyk J, Nickel C, et al. Anger, interpersonal relationships, and health-related quality of life in bullying boys who are treated with outpatient family therapy: a randomized, prospective, controlled trial with 1 year of follow-up. Pediatrics. 2005 Aug;116(2):e247–54. [PubMed: 16061577]

58.

Nickel MK, Muehlbacher M, Kaplan P, et al. Influence of family therapy on bullying behaviour, cortisol secretion, anger, and quality of life in bullying male adolescents: A randomized, prospective, controlled study. Can J Psychiatry. 2006 May;51(6):355–62. [PubMed: 16786816]

59.

Azrin NH, Donohue B, Teichner GA, et al. A controlled evaluation and description of individual-cognitive problem solving and family-behavior therapies in dually-diagnosed conduct-disordered and substance-dependent youth. J Child Adolesc Subst Abuse. 2001;11(1):1–43.

60.

van der Put CE, Asscher JJ, Stams GJ, et al. Recidivism after treatment in a forensic youth-psychiatric setting: the effect of treatment characteristics. Int J Offender Ther Comp Criminol. 2013 Sep;57(9):1120–39. [PubMed: 22811475]

61.

Koegl CJ, Farrington DP, Augimeri LK, et al. Evaluation of a targeted cognitive-behavioral program for children with conduct problems--the SNAP Under 12 Outreach Project: service intensity, age and gender effects on short- and long-term outcomes. Clin Child Psychol Psychiatry. 2008 Jul;13(3):419–34. [PubMed: 18783124]

62.

Posthumus JA, Raaijmakers MA, Maassen GH, et al. Sustained effects of incredible years as a preventive intervention in preschool children with conduct problems. J Abnorm Child Psychol. 2012 May;40(4):487–500. [PMC free article: PMC3319886] [PubMed: 22006348]

63.

Lipman EL, Kenny M, Sniderman C, et al. Evaluation of a community-based program for young boys at-risk of antisocial behaviour: results and issues. J Can Acad Child Adolesc Psychiatry. 2008;17(1):12–9. [PMC free article: PMC2247441] [PubMed: 18392161]

64.

Costin J, Lichte C, Hill-Smith A, et al. Parent group treatments for children with Oppositional Defiant Disorder. AeJAMH (Australian e-Journal for the Advancement of Mental Health). 2004;3(1)

65.

Coughlin M, Sharry J, Fitzpatrick C, et al. A controlled clinical evaluation of the parents plus children's programme: a video-based programme for parents of children aged 6 to 11 with behavioural and developmental problems. Clin Child Psychol Psychiatry. 2009 Oct;14(4):541–58. [PubMed: 19759073]

66.

Shapiro JP, Youngstrom JK, Youngstrom EA, et al. Transporting a manualized treatment for children's disruptive behavior to a community clinic. Journal of Contemporary Psychotherapy. 2012;42(4):215–25.

67.

Foster EM, Olchowski AE, Webster-Stratton CH. Is stacking intervention components cost-effective? An analysis of the Incredible Years program. J Am Acad Child Adolesc Psychiatry. 2007 Nov;46(11):1414–24. [PubMed: 18049291]

68.

Masi G, Milone A, Paciello M, et al. Efficacy of a multimodal treatment for disruptive behavior disorders in children and adolescents: focus on internalizing problems. Psychiatry Res. 2014 Nov 30;219(3):617–24. [PubMed: 25060833]

69.

Dittmann RW, Schacht A, Helsberg K, et al. Atomoxetine versus placebo in children and adolescents with attention-deficit/hyperactivity disorder and comorbid oppositional defiant disorder: a double-blind, randomized, multicenter trial in Germany. J Child Adolesc Psychopharmacol. 2011 Apr;21(2):97–110. [PubMed: 21488751]

70.

Connor DF, Findling RL, Kollins SH, et al. Effects of guanfacine extended release on oppositional symptoms in children aged 6-12 years with attention-deficit hyperactivity disorder and oppositional symptoms: a randomized, double-blind, placebo-controlled trial. CNS Drugs. 2010 Sep;24(9):755–68. [PubMed: 20806988]

71.

Saxena K, Mora L, Torres E, et al. Divalproex sodium-ER in outpatients with disruptive behavior disorders: a three month open label study. Child Psychiatry Hum Dev. 2010 Jun;41(3):274–84. [PubMed: 20043204]

72.

Blader JC, Schooler NR, Jensen PS, et al. Adjunctive divalproex versus placebo for children with ADHD and aggression refractory to stimulant monotherapy. Am J Psychiatry. 2009 Dec;166(12):1392–401. [PMC free article: PMC2940237] [PubMed: 19884222]

73.

Dell'Agnello G, Maschietto D, Bravaccio C, et al. Atomoxetine hydrochloride in the treatment of children and adolescents with attention-deficit/hyperactivity disorder and comorbid oppositional defiant disorder: A placebo-controlled Italian study. Eur Neuropsychopharmacol. 2009 Nov;19(11):822–34. [PubMed: 19716683]

74.

Connor DF, McLaughlin TJ, Jeffers-Terry M. Randomized controlled pilot study of quetiapine in the treatment of adolescent conduct disorder. J Child Adolesc Psychopharmacol. 2008 Apr;18(2):140–56. [PubMed: 18439112]

75.

Armenteros JL, Lewis JE, Davalos M. Risperidone augmentation for treatment-resistant aggression in attention-deficit/hyperactivity disorder: a placebo-controlled pilot study. J Am Acad Child Adolesc Psychiatry. 2007 May;46(5):558–65. [PubMed: 17450046]

76.

Spencer TJ, Abikoff HB, Connor DF, et al. Efficacy and safety of mixed amphetamine salts extended release (adderall XR) in the management of oppositional defiant disorder with or without comorbid attention-deficit/hyperactivity disorder in school-aged children and adolescents: A 4-week, multicenter, randomized, double-blind, parallel-group, placebo-controlled, forced-dose-escalation study. Clin Ther. 2006 Mar;28(3):402–18. [PubMed: 16750455]

77.

Reyes M, Buitelaar J, Toren P, et al. A randomized, double-blind, placebo-controlled study of risperidone maintenance treatment in children and adolescents with disruptive behavior disorders. Am J Psychiatry. 2006 Mar;163(3):402–10. [PubMed: 16513860]

78.

Steiner H, Petersen ML, Saxena K, et al. Divalproex sodium for the treatment of conduct disorder: a randomized controlled clinical trial. J Clin Psychiatry. 2003 Oct;64(10):1183–91. [PubMed: 14658966]

79.

Donovan SJ, Stewart JW, Nunes EV, et al. Divalproex treatment for youth with explosive temper and mood lability: a double-blind, placebo-controlled crossover design. Am J Psychiatry. 2000 May;157(5):818–20. [PubMed: 10784478]

80.

Findling RL, McNamara NK, Branicky LA, et al. A double-blind pilot study of risperidone in the treatment of conduct disorder. J Am Acad Child Adolesc Psychiatry. 2000 Apr;39(4):509–16. [PubMed: 10761354]

81.

Klein RG, Abikoff H, Klass E, et al. Clinical efficacy of methylphenidate in conduct disorder with and without attention deficit hyperactivity disorder. Arch Gen Psychiatry. 1997 Dec;54(12):1073–80. [PubMed: 9400342]

82.

Bastiaens L. A non-randomized, open study with aripiprazole and ziprasidone for the treatment of aggressive behavior in youth in a community clinic. Community Ment Health J. 2009 Feb;45(1):73–7. [PubMed: 18597173]

83.

Connor DF, Spencer TJ. Short-term cardiovascular effects of mixed amphetamine salts extended release in children and adolescents with oppositional defiant disorder. CNS Spectr. 2005 Oct;10(10 Suppl 15):31–8.

84.

Ercan ES, Kutlu A, Cikoglu S, et al. Risperidone in children and adolescents with conduct disorder: A single-center, open-label study. Current Therapeutic Research - Clinical and Experimental. 2003 Jan 01;64(1):55–64. [PMC free article: PMC4053023] [PubMed: 24944356]

85.

Penzner JB, Dudas M, Saito E, et al. Lack of effect of stimulant combination with second-generation antipsychotics on weight gain, metabolic changes, prolactin levels, and sedation in youth with clinically relevant aggression or oppositionality. J Child Adolesc Psychopharmacol. 2009 Oct;19(5):563–73. [PMC free article: PMC2830212] [PubMed: 19877981]

86.

Pandina GJ, Zhu Y, Cornblatt B. Cognitive function with long-term risperidone in children and adolescents with disruptive behavior disorder. J Child Adolesc Psychopharmacol. 2009 Dec;19(6):749–56. [PubMed: 20035593]

87.

Loy JH, Merry SN, Hetrick SE, et al. Atypical antipsychotics for disruptive behaviour disorders in children and youths. Cochrane Database Syst Rev. 2012;9 CD008559. [PubMed: 22972123]

88.

Seida JC, Schouten JR, Mousavi SS, et al. First- and Second-Generation Antipsychotics for Children and Young Adults. Rockville, MD: Agency for Healthcare Research and Quality; Feb, 2012. (Comparative Effectiveness Review). AHRQ Publication No: 11(12)-EHC077-EF. http:​//effectivehealthcare​.ahrq.gov/search-for-guides-reviews-and-reports​/?pageaction​=displayproduct&productID​=835. [PubMed: 22439156]

89.

Pringsheim T, Lam D, Ching H, et al. Metabolic and neurological complications of second-generation antipsychotic use in children: a systematic review and meta-analysis of randomized controlled trials. Drug Saf. 2011 Aug 1;34(8):651–68. [PubMed: 21751826]