Validation of the brief version of the Recovery Self-Assessment (RSA-B) using Rasch measurement theory

Psychiatr Rehabil J. 2015 Dec;38(4):349-58. doi: 10.1037/prj0000139. Epub 2015 Jun 15.

Abstract

Objective: In psychiatry, the recovery paradigm is increasingly identified as the overarching framework for service provision. Currently, the Recovery Self-Assessment (RSA), a 36-item rating scale, is commonly used to assess the uptake of a recovery orientation in clinical services. However, the consumer version of the RSA has been found challenging to complete because of length and the reading level required. In response to this feedback, a brief 12-item version of the RSA was developed (RSA-B). This article describes the development of the modified instrument and the application of traditional psychometric analysis and Rasch Measurement Theory to test the psychometrics properties of the RSA-B.

Methods: Data from a multisite study of adults with serious mental illnesses (n = 1256) who were followed by assertive community treatment teams were examined for reliability, clinical meaning, targeting, response categories, model fit, reliability, dependency, and raw interval-level measurement. Analyses were performed using the Rasch Unidimensional Measurement Model (RUMM 2030).

Results: Adequate fit to the Rasch model was observed (χ2 = 112.46, df = 90, p = .06) and internal consistency was good (r = .86). However, Rasch analysis revealed limitations of the 12-item version, with items covering only 39% of the targeted theoretical continuum, 2 misfitting items, and strong evidence for the 5 option response categories not working as intended.

Conclusions: This study revealed areas for improvement in the shortened version of the 12-item RSA-B. A revisit of the conceptual model and original 36-item rating scale is encouraged to select items that will help practitioners and researchers measure the full range of recovery orientation.

Publication types

  • Research Support, Non-U.S. Gov't
  • Validation Study

MeSH terms

  • Adult
  • Brief Psychiatric Rating Scale / standards*
  • Canada
  • Female
  • Humans
  • Male
  • Mental Disorders* / diagnosis
  • Mental Disorders* / psychology
  • Mental Disorders* / rehabilitation
  • Mental Health Services / standards
  • Psychiatric Rehabilitation* / methods
  • Psychiatric Rehabilitation* / organization & administration
  • Psychometrics / methods
  • Quality Improvement
  • Quality of Life*
  • Reproducibility of Results
  • Self-Assessment
  • Treatment Outcome