U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Chambers D, Cantrell A, Johnson M, et al. Digital and online symptom checkers and assessment services for urgent care to inform a new digital platform: a systematic review. Southampton (UK): NIHR Journals Library; 2019 Aug. (Health Services and Delivery Research, No. 7.29.)

Cover of Digital and online symptom checkers and assessment services for urgent care to inform a new digital platform: a systematic review

Digital and online symptom checkers and assessment services for urgent care to inform a new digital platform: a systematic review.

Show details

Appendix 4Quality assessment tools

Quality assessment tool for observational/cross-sectional studies

  1. Was the research question clearly stated?
  2. Was the study population clearly specified and defined?
  3. Was the participation rate of eligible persons at least 50%?
  4. Were all the subjects selected or recruited from the same or similar populations (including the same time period)? Were inclusion and exclusion criteria prespecified and applied uniformly to all participants?
  5. Was a sample size justification, power description, or variance and effect estimate provided?
  6. For exposures that can vary in amount or level, did the study examine different levels of the exposure as related to the outcome?
  7. Were the exposure measures (independent variables) clearly defined, valid, reliable and implemented consistently across all study participants?
  8. Were the outcome measures (dependent variables) clearly defined, valid, reliable and implemented consistently across all study participants?
  9. Were the outcome assessors blinded to the exposure status of participants?
  10. Were key potential confounding variables measured and adjusted statistically for their impact on the relationship between exposure(s) and outcome(s)?

Quality assessment tool for diagnostic studies

  1. Was the spectrum of patients representative of the patients who will receive the test in practice? (Representative spectrum.)
  2. Is the reference standard likely to classify the target condition correctly? (Acceptable reference standard.)
  3. Is the time period between reference standard and index test short enough to be reasonably sure that the target condition did not change between the two tests? (Acceptable delay between tests.)
  4. Did the whole sample or a random selection of the sample receive verification using the intended reference standard? (Partial verification avoided.)
  5. Did patients receive the same reference standard irrespective of the index test result? (Differential verification avoided.)
  6. Was the reference standard independent of the index test (i.e. the index test did not form part of the reference standard)? (Incorporation avoided.)
  7. Were the reference standard results interpreted without knowledge of the results of the index test? (Index test results blinded.)
  8. Were the index test results interpreted without knowledge of the results of the reference standard? (Reference standard results blinded.)
  9. Were the same clinical data available when test results were interpreted as would be available when the test is used in practice? (Relevant clinical information.)
  10. Were uninterpretable/intermediate test results reported? (Uninterpretable results reported.)
  11. Were withdrawals from the study explained? (Withdrawals explained.)
  12. Comments.
Copyright © Queen’s Printer and Controller of HMSO 2019. This work was produced by Chambers et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.
Bookshelf ID: NBK545131

Views

  • PubReader
  • Print View
  • Cite this Page
  • PDF version of this title (2.3M)

Other titles in this collection

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...