U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Young J, Green J, Godfrey M, et al. The Prevention of Delirium system of care for older patients admitted to hospital for emergency care: the POD research programme including feasibility RCT. Southampton (UK): NIHR Journals Library; 2021 Mar. (Programme Grants for Applied Research, No. 9.4.)

Cover of The Prevention of Delirium system of care for older patients admitted to hospital for emergency care: the POD research programme including feasibility RCT

The Prevention of Delirium system of care for older patients admitted to hospital for emergency care: the POD research programme including feasibility RCT.

Show details

Project 3: a multicentre, pragmatic, cluster randomised controlled feasibility study of the Prevention of Delirium programme system of care

Aim

The aim was to conduct a pragmatic, multicentre, cluster randomised, controlled, feasibility study to explore the potential clinical effectiveness and cost-effectiveness of the PODv2, compared with standard care, among older patients at risk of developing delirium who are admitted to hospital for emergency care.

Primary objectives

  • Estimate recruitment and follow-up rates at both patient and cluster levels.
  • Assess fidelity of the POD system of care.
  • Assess the degree of contamination at ward level due to between-ward staff movements.
  • Assess the completeness of data collection.
  • Provide a preliminary estimate of the effectiveness of the POD system of care, compared with standard care, as measured by the incidence of new-onset delirium within 10 days of recruitment (anticipated primary outcome for a definitive trial).
  • Assess the variability in the incidence of delirium within 10 days of recruitment between the hospital sites.
  • Assess fulfilment of criteria for progression to a future definitive trial.
  • Investigate differences in financial costs and benefits between the POD system of care and standard practice.
  • Estimate the sample size for a future definitive trial.

Secondary objectives

The secondary objectives were to investigate the following: differences in the severity, duration and time to first episode of delirium (including persistent delirium); falls; length of stay in hospital; in-hospital mortality; destination at discharge; participant status at 30 days; health-related quality of life and health resource use; physical and social independence; anxiety and depression; poor outcome; and safety.

Methods

Parts of the following section have been reproduced from Young et al.54 This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Parts of this section have also been reproduced from Young et al.55 © The Author(s) 2020. Published by Oxford University Press on behalf of the British Geriatrics Society. This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Design and setting

We undertook a pragmatic, multicentre, cluster randomised, controlled feasibility study to investigate the potential effectiveness of the POD system of care, compared with standard care, in NHS hospitals in England and Wales. The study was reviewed and approved by the UK National Research Ethics Service (Research Ethics Committee reference number 13/YH/0400).

Recruitment

Hospitals and wards

We aimed to recruit 16 wards in eight NHS hospitals in England and Wales: one elderly care and one orthopaedic trauma ward in each hospital.

The inclusion criteria for ward participation were the demonstration of adequate ward nurse staffing, as assessed against national guidance,56,57 and the agreed involvement of a named ward manager, a senior nurse and a VSM (if local staff intended to use voluntary services as a component of the intervention). In addition, there was a requirement for the equivalent of 1 day per week per ward of dedicated time for 3–4 months from an experienced senior nurse to lead the implementation.

Wards were excluded if they had previously participated in the development of the POD system of care or if they intended to implement other delirium prevention initiatives during the trial.

Participants

As the POD system of care is a whole-ward intervention, all patients in the ward (regardless of eligibility and consent status) would have the potential to be exposed to the intervention. Patients were therefore recruited for completion of individual outcome assessments only.

Patients aged ≥ 65 years who were admitted to the study wards during the study period were eligible for participation.

Patients were excluded if they had prevalent delirium on admission to the ward; if discharge was planned within 48 hours of admission; if a delirium assessment had not been performed by a research assistant (RA) within 24 hours of admission (elderly care patients) or preoperatively (orthopaedic trauma patients); if consent had not been obtained with 48 hours of admission to the ward; if end-of-life care was being provided; and if they had transferred from another ward or were not under the care of the ward team. Participants were recruited for 6 months following the 6-month intervention implementation period.

Intervention

The PODv2 is a manualised, multicomponent intervention and systematic implementation process designed to secure changes in ward practice, potentially enhanced by the involvement of hospital volunteers. It comprises actions centred on 10 risk factors associated with the development of delirium: cognitive impairment and/or disorientation, dehydration and/or constipation, hypoxia, immobility or limited mobility, infection, multiple medications, pain, poor nutrition, sensory impairment, and sleep disturbance. The implementation process is supported through raising awareness and through the training of staff and volunteers in delirium prevention, including action-planning cycles of observation and audit of current practice to establish what needs to be put in place to introduce the POD system of care in a particular ward setting. These principles are embedded in the POD manual that comprises sections outlining the aims, an overview, the management of POD and the four core tasks (staff education, review of current practice, ward systems and involving volunteers), supplemented by resources including educational materials, example documents, volunteer materials and guidance.

Assessments

Primary outcome

We assessed for differences in new-onset delirium within 10 days of recruitment between patients in the intervention group (POD programme) and patients in the control group (usual care), as this is the expected primary outcome for a definitive trial. Delirium was assessed using the four-item Confusion Assessment Method (CAM)58,59 (Table 8).

TABLE 8

TABLE 8

Structured assessment process to complete the CAM

Secondary outcomes

Physical and social independence were measured by the RAs at baseline and at 3 months (postal questionnaire) using the Nottingham Extended Activities of Daily Living (NEADL) scale;62 anxiety and depression were measured by the RA using the Clinical Anxiety Scale63 and the Geriatric Depression Scale Short Form,64 respectively, at 30 days.

Research assistant Confusion Assessment Method training

A CAM training and monitoring process was developed that followed recommended practices.65 We developed a three-stage training process. Stage 1 was central or local classroom teaching about delirium, trial research procedures and the administration of outcome measurement instruments, including the CAM. Stage 2 was specific to the CAM and involved local experiential learning consisting of (1) one-to-one practice sessions, (2) pilot interviews with patients and (3) within-site inter-rater reliability assessments. Stage 3 was a further within-site inter-rater CAM reliability performance check conducted at the local sites.59

Data collection

Data collection was undertaken by locally based RAs who were trained in study procedures and outcome measures.

Screening data

Screening data, including demographic characteristics and admission details, were obtained by the RAs in consultation with the attending ward staff for all patients aged ≥ 65 years admitted to a study ward.

Baseline assessments

Baseline assessment by the RAs for patients providing consent comprised an initial CAM; the Charlson Comorbidity Index;66 and recording of existing hearing and or visual impairments, current medications, illness severity using the National Early Warning Score (NEWS) or equivalent,67 history of dementia and Abbreviated Mental Test Score (AMTS),60 living arrangements, and the EuroQol-5 Dimensions (EQ-5D) score.68 Participants also completed a questionnaire relating to physical and social independence (the NEADL scale).62

Primary outcome

The RAs performed cognitive assessments [AMTS and months of the year backwards (MotYB) test] and the CAM daily for up to 10 days post recruitment (or until discharge, if sooner) to detect the presence of new delirium. Each CAM item was assessed and recorded on a clinical research form that was dated and signed. This document was stored digitally and accessed at a later date to investigate achievement of the completeness of the CAM assessments.

Discharge assessment

At the point of discharge, the RAs recorded the date of discharge (or date of death), episodes of falls in hospital and discharge destination (living alone, living with another person, residential care home, nursing home, other).

Thirty-day assessment

At 30 days post recruitment, the RAs performed a cognitive assessment (AMTS and MotYB test) and the CAM, and asked the patient to complete a questionnaire about health-related quality of life using the EQ-5D,68 about anxiety using the Clinical Anxiety Scale,63 about depression using the Geriatric Depression Scale Short Form64 and about patient experience using selected questions from the patient-reported experience measure from the National Audit of Intermediate Care.69

Three-month assessment

At 3 months post recruitment, postal questionnaires were used to provide information on physical and social independence (NEADL scale),62 health-related quality of life (EQ-5D),68 and health and social care resource use and living arrangements. Proxy completion of the questionnaires was permitted.

Sample size

A formal power calculation was not appropriate for this feasibility study. Assuming an average length of stay of 14 days and 25-bed wards, 50% of patients at risk of delirium, 30% of whom would provide consent (or a consultee declaration),70,71 we proposed that a recruitment target of 720 patients in 6 months was achievable.

Randomisation

The POD system of care is a ward-based intervention that aims to affect staff skills, knowledge and clinical practice. Cluster randomisation was therefore chosen to reduce between-group contamination. There remained a possibility of between-ward contamination because of staff movement. This was investigated by randomising four of the hospitals to the POD system of care or control at the hospital level, and randomising four of the hospitals at the ward level. Randomisation was stratified by ward type (elderly care medicine and orthopaedic trauma) and was a two-stage process, and was performed centrally by the statistician at the Clinical Trials Research Unit (CTRU). Sites were first randomised 1 : 1 between hospital-level allocation (both wards in the hospital received the same treatment allocation), and ward-level allocation (each ward in the hospital received a different intervention). Those sites selected for hospital-level allocation were then further randomised 1 : 1 for both of their wards to receive either the POD system of care or control. Wards in those sites selected for ward-level allocation were randomised 1 : 1 to receive either the POD system of care or control (Figure 3).54,55

FIGURE 3. Randomisation overview.

FIGURE 3

Randomisation overview.

Implementation

Wards randomised to the intervention received the PODv2 manual. The first step was to form local implementation teams that included a study-specific ward nurse (1 day per week). An intervention overview meeting was provided by the trial co-ordinating centre (one meeting for each ward). This was followed by a 6-month implementation period to allow the intervention to be embedded in ward practice before patient recruitment to the trial occurred. Progress on implementation was monitored by regular site visits and telephone and e-mail contact, and was tracked through completion of an internal milestone checklist embedded in the POD system of care manual.

Usual-care group

Wards randomised to the usual care control group continued to deliver care as determined by local policies and practices. Any new delirium prevention measures or care processes adopted during the study period were recorded by the central trial team, following a request for information from the sites.

Blinding

The RAs administering and collecting outcome measures had no role in the intervention. It was unrealistic for RAs visiting the wards daily to conduct delirium assessments to remain blind to treatment allocation.

Assessment of intervention fidelity

We identified 21 tasks that were essential for the successful implementation and delivery of the POD system of care and grouped them in four domains based on the Conceptual Framework for Implementation method:72 (1) installation (five items; maximum score = 5), (2) delivery (12 items; maximum score = 48), (3) coverage (three items; maximum score = 16) and (4) duration of delivery (one item; maximum score = 1).73

Data collection to inform the fidelity domains involved (1) non-participant observations, (2) extraction of standardised information from the medical and nursing records and (3) inspection of the intervention installation checklists contained in the POD system of care manual.

We used these data to populate tables of evidence for each ward relating to the four fidelity domains and their associated content items. We developed, piloted and modified a scoring system to quantify intervention fidelity and to facilitate consistency of assessor judgements. Once evidence tables had been completed, assessors were asked to provide an overall fidelity score (low compliance, ≤ 50%; medium compliance, 51–79%; high compliance, ≥ 80%) based on their judgement of the extent of completion of the essential tasks.74

Statistical methods

All analyses and data summaries were conducted on the intention-to-treat population, defined as all participants registered, regardless of non-compliance with the protocol or withdrawal from the study. The analysis focused on descriptive statistics and confidence interval (CI) estimation, rather than on formal hypothesis testing.

Estimation of recruitment rates

We recorded the number of sites expressing an interest in participating in the trial and reasons for non-progression. To assess the feasibility of recruiting participants for a definitive trial, we calculated the number of patients screened, eligible, assessed for delirium, with prevalent delirium, with capacity to consent and for whom consent for trial participation was obtained. Baseline descriptors of the screened and recruited populations were obtained (see Characteristics of the screened and registered participants: generalisability) and compared between the groups to assess for imbalance.

Estimates of completeness of data collection and follow-up rates

The reliable calculation of delirium incidence rates requires close adherence to a predetermined delirium detection process. We therefore recorded the number of in-hospital delirium assessments and 30-day delirium assessments conducted, and calculated the missing observations. We also recorded the number and timing of participant withdrawals from follow-up data collection and the reasons for withdrawal (including deaths), and the number of participants with missing self-reported outcome questionnaires at each time point.

Assessment of between-ward intervention contamination

The number of staff moving on and off study wards within sites was collected for a sample period of 1 week. The number of participants moving wards during their hospital stay was tabulated. Incidence rates of new-onset delirium at the sites that were randomised at the hospital level were calculated and compared with those from sites that were randomised at the ward level, to assess possible between-ward contamination. Incidence rates of new-onset delirium were calculated for participants recruited within the first 3 months of sites opening to recruitment, and for participants recruited between 3 and 6 months of sites opening to recruitment to determine if the intervention delivery was sustained when more time had elapsed since initial training. Service improvements introduced on participating wards during the study period were recorded.

Estimation of a sample size for a future definitive randomised controlled trial

To inform the sample size calculation for a possible definitive trial, we calculated the incidence of new-onset delirium within 10 days of admission by ward type, by study arm and overall, together with corresponding 95% CIs. We used multilevel logistic regression that adjusted for demographic characteristics (age and sex), delirium risk factors (medications associated with delirium, e.g. benzodiazepines, opiates, H1 antihistamines),75 sensory impairment (hearing impaired, use of hearing aid or sight impaired), cognitive impairment and/or dementia, Charlson Comorbidity Index,66 NEWS67 category and ward type. In the regression model, ward type was fitted as a random effect. The number of new patients admitted per ward during the recruitment period was used to estimate cluster size. The intracluster correlation coefficient (ICC) and associated 95% CI were calculated using the covariance parameter estimate from a multilevel logistic regression without adjustment for participant or ward characteristics.

Criteria for continuation to a future definitive randomised controlled trial

A priori criteria for progression to a definitive randomised controlled trial were defined as a minimum of six of the eight wards (75%) completing the POD manual milestone checklist (to provide assurance that the POD implementation was successful) and an overall recruitment rate of at least 10% of the potential recruitment pool. The criteria did not include thresholds for projected clinical effectiveness or cost-effectiveness.

Health economics study

Model development

To estimate the cost-effectiveness of an integrated delirium prevention intervention in the context of the trial, a decision-analytic model was used. The model was developed after consultation with the research team (including clinical experts) and the parameter values were identified following targeted searches of the literature. The working report describing the model development and results is included in Appendix 4.

Cost-effectiveness study

The aim of the economic study was to establish the feasibility of conducting an economic evaluation of the POD system of care and to determine preliminary estimates of its cost-effectiveness. Specific objectives were to:

  • determine the feasibility of collecting the assessments needed (quality of life and health-care resource use) for an economic evaluation in this patient group
  • determine the number of missing data in assessments
  • determine the validity and responsiveness of quality-of-life assessments in this group
  • determine the feasibility of collecting and of using/interpreting proxy-completed assessments
  • estimate the cost of the POD intervention
  • provide estimates of the cost-effectiveness of POD, compared with usual care
  • compare these estimates with those from the earlier evaluation based on decision modelling.

Quality of life was assessed using the EQ-5D68 at baseline and at 1 and 3 months. Health-care resource use was captured using a specially designed questionnaire completed by patients (and/or proxies) at 3 months. Costs were calculated from the perspective of health services and Personal Social Services. The cost of the POD intervention was estimated to include material costs (e.g. printing of manuals), the time to deliver and receive the training and also the time to provide support during POD delivery. This information was provided by the POD research team, which kept a contemporaneous diary of visits and travel. The feasibility of data collection was determined by observing the extent of missing data.

The primary economic evaluation adopted the NICE-preferred approach of a cost–utility analysis comparing the costs and benefits of POD and usual care.76 The analysis time horizon was 3 months, based on the trial follow-up. The main analysis result was the incremental cost-effectiveness ratio (ICER) per quality-adjusted life-year (QALY). ICERs below the range of £20,000–30,000 indicate that POD would be considered cost-effective. Non-parametric bootstrapping was employed to determine the level of sampling uncertainty. No discounting of costs or effects was conducted.

See Appendix 5 for full details of the methods.

Parts of this section have also been reproduced from Young et al.55 © The Author(s) 2020. Published by Oxford University Press on behalf of the British Geriatrics Society. This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Copyright © Queen’s Printer and Controller of HMSO 2021. This work was produced by Young et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.

Results

Parts of the following section have been reproduced Young et al.55 © The Author(s) 2020. Published by Oxford University Press on behalf of the British Geriatrics Society. This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Objective 1: estimate recruitment and follow-up rates

Hospitals and wards

Twenty hospitals expressed interest. Twelve hospitals subsequently completed and returned site survey forms, and eight of these were recruited. Among the four hospitals not recruited, two withdrew (one because of poor staffing and one was unable to identify a suitable ward), one did not respond to the request for a site visit to progress towards recruitment and, for one, regulatory approvals came after the other requisite number of POD sites had gained approval. Of the 16 recruited wards, nine were elderly care medicine and seven were surgical/trauma orthopaedic. Seven of the eight hospitals registered had one elderly care ward and one orthopaedic trauma ward. The remaining hospital site had two elderly care wards registered.

None of the wards/hospitals withdrew from the study.

Patient screening and recruitment rates

Screening and recruitment took place between August 2014 and February 2015. A total of 4449 patients admitted to the 16 wards were screened for eligibility, 3274 (73.6%) of whom were considered eligible. The most common reasons for exclusion at screening of the remaining 1175 patients were as follows: 538 (45.8%; 12.1% of those screened) had a recorded diagnosis of delirium on admission, 352 (30.0%; 7.9% of those screened) had an expected duration of stay of < 48 hours, 139 (11.8%; 3.1% of those screened) were not under the care of the ward medical team and 105 (8.9%; 2.4% of those screened) were receiving end-of-life care (Figure 4).

FIGURE 4. The Consolidated Standards of Reporting Trials flow diagram.

FIGURE 4

The Consolidated Standards of Reporting Trials flow diagram. a, Withdrawals here are from researcher questionnaires; b, withdrawals here are from postal questionnaires; one patient in the POD arm withdrew from researcher visits at 30 days, but not from (more...)

Delirium assessment was performed by the RAs on 1537 (34.5% of screened) of the 3274 eligible patients. The remaining 1737 (39.0% of screened) patients did not have a delirium assessment. The most common reasons for not performing a CAM assessment were as follows: research staff missed patient [691 (39.8% of those excluded)], ward staff advised not to approach [374 (21.5%)], patient unavailable [283 (16.3%)] and patient refused [246 (14.2%)].

Of the 1537 patients who were screened for delirium, 1418 (31.9% of screened) were assessed as not having prevalent delirium. The remaining 119 were excluded: 113 had prevalent delirium, and the reasons are unknown for six.

Of the 1418 patients assessed as not having delirium, 1340 (30.1% screened) either had capacity (n = 1182) or a consultee had been identified (n = 158); these were approached for participation. The remaining 78 patients were excluded as they were without capacity and a consultee had not been identified. Of the 1340 patients approached for participation, 626 were excluded. The most common reasons for exclusion were as follows: 459 (73.3% of those excluded) patients refused; 59 (9.4%) were discharged before consent was obtained; 29 (4.6%) were missed by the researcher; and, for 26 (4.2%), the consultee refused. Consent was obtained for 714 (16.0% of screened) patients, and 713 were registered to the study (one patient was discharged before registration): 343 were registered to the POD system of care and 370 were registered to control (see Figure 4). Figure 5 is the recruitment graph. Patient accruals to the study between the sites ranged from 65 to 105 (see Appendix 6, Table 50).

FIGURE 5. Recruitment graph.

FIGURE 5

Recruitment graph.

Eligibility violations

A total of 13 (1.8%) participants were identified as not fulfilling the eligibility criteria: five (1.5%) in the POD arm and eight (2.2%) in the control arm. The main criteria violated were as follows: the delirium assessment (CAM) was not performed (n = 1 in the POD arm and n = 6 in the control arm), and the participant had prevalent delirium on admission (n = 3 in POD and the POD arm and n = 2 in the control arm) (see Appendix 6, Table 51). Patients identified as breaching an eligibility criterion were included in all analyses.

Final follow-up

Thirty-three (4.6%) participants withdrew during the study period [15 (4.4%) from the POD arm and 18 (4.9%) from the control arm] (see Appendix 6, Table 52). Of these, 19 (57.6%) withdrew within 10 days of recruitment.

Characteristics of the screened and registered participants: generalisability

The characteristics of the screened and registered participants were similar with respect to age, sex and ethnicity (Table 9). In the screened and registered populations, the mean overall ages were 83.1 years [standard deviation (SD) 8.05 years] and 82.7 years (SD 7.84 years) respectively; female patients accounted, respectively, for 67.2% and 68.3% of the populations; and 89.3% and 91.7%, respectively, of the populations were of white ethnicity. Participant age and ethnicity were broadly similar across sites: the mean overall age varied between 79.0 years (SD 7.34 years) and 85.1 years (SD 7.58 years), and between 83.8% and 97.6% of participants were of white ethnicity (small differences due to more missing data for some sites). Some differences between sites were noted with respect to sex; female participants accounted for between 49.2% and 100.0% of participants (see Appendix 6, Table 53).

TABLE 9

TABLE 9

Characteristics of the screened and registered participants by arm

Baseline characteristics

The two arms were well balanced with respect to residence, hearing aid use, benzodiazepines use and comorbidities, although some imbalance between groups was evident for all other characteristics, namely reason for admission, ward type, cognitive impairment and/or dementia, highest NEWS category within 48 hours of admission, visual impairment, hearing impairment, and opiates and antihistamines prescribed (Table 10). Residence and hearing impairment were balanced across sites; however, some imbalance between sites was apparent for all other characteristics (see Appendix 6, Table 54).

TABLE 10

TABLE 10

Demographic characteristics and NICE risk factors by arm

Objective 2: assessment of intervention implementation

All of the eight wards allocated to the intervention group completed the milestone checklist, were deemed competent and went on to deliver the POD system of care intervention and recruit patients (Table 11). Only three wards elected to involve volunteers in the system of care. All of the sites progressed through the implementation milestones and none of the sites withdrew during either the implementation or delivery phases.

TABLE 11

TABLE 11

Overall summary of length of time (weeks) taken to complete each core task of POD delivery

The mean time taken to implement the POD system of care was 21.4 (SD 7.32) weeks (see Table 11), although this figure is skewed by site 8, which took 38.4 weeks, as it was temporarily located on an alternative ward owing to building works (see Appendix 6, Table 55). The median time taken to implement the POD system of care was 18.6 weeks.

Intervention fidelity

Ten health-care professionals with experience in older people’s care assessed fidelity. The mean score for each domain was as follows: installation, 4.5 points (range 3.5–5.0 points); delivery, 32.6 points (range 27.3–38.3 points); coverage, 7.9 points (range 4.2–10.1 points); and duration, 0.38 points (range 0–1.0 points).73 Of the 10 delirium risk factors, infection, nutrition, hypoxia and pain were the most consistently addressed, and cognitive impairment, sensory impairment and multiple medications were the least consistently addressed.73 Overall fidelity to the intervention was assessed as being high (≥ 80%) in two wards, medium (51–79%) in five wards and low (≤ 50%) in one ward.

Objective 3: assessment of between-ward intervention contamination

Staff

Contamination data were received from all sites [two sites (sites 2 and 4) provided data by telephone or e-mail only]. Site 2 stated that staff were never moved to other wards from the trauma ward and no staff were brought onto the ward. No data were provided for the elderly care ward at this site. Site 4 stated that wards did not keep any records of staff movement.

During the 1-week data collection period, there were 216 reports of staff moving into the 12 study wards that were providing data: 115 on elderly care wards and 101 on orthopaedic trauma wards, most commonly health-care assistants (51.9%) (see Appendix 6, Table 56).

Only 13 staff moves off the ward were recorded during the 1-week data collection period: four from elderly care wards and nine from orthopaedic trauma wards (see Appendix 6, Table 56).

Delirium incidence rates

The incidence rates of new-onset delirium were similar between arms at the sites randomised at the hospital level and at those randomised at the ward level (see Appendix 6, Table 57). However, incidence rates were lower when ward-level randomisation was used.

Incidence rates of new-onset delirium were similar between arms for participants recruited during the first 3 months of sites opening to recruitment and for participants recruited between 3 and 6 months of sites opening to recruitment, although incidence rates were lower during the later 3 months of recruitment (see Appendix 6, Table 58).

Patients

During their hospital stays, 135 (18.9%) participants moved wards: 58 (16.9%) in the POD group and 77 (20.8%) in the control group (see Appendix 6, Table 59). Among the sites, the percentage of participants moving wards ranged from 10.0% to 25.8% (see Appendix 6, Table 60).

Wards

No ward reported any new multicomponent delirium prevention measures during the study period. Four POD wards introduced service improvements consisting of dementia training; observations using electronic handheld devices; attempts to decrease noise levels; and identification of patients at risk of delirium with education on hearing aids, nutrition and hydration. One control ward introduced a new rounding chart.

Objective 4: completeness of data collection

Confusion Assessment Method assessments

Taking into account the length of stay and excluding the assessments not expected as a result of death, withdrawal or discharge, of an expected 5645 CAM assessments, 5065 (89.7%) were completed during the first 10 days of recruitment (Table 12).

TABLE 12

TABLE 12

Number of in-hospital CAMs performed out of number expected (based on length of stay) by randomised arm

Non-completion rates in sites ranged from 3.5% to 14.8%.59 The main reasons for non-completion of the CAM were participants were too ill [n = 186 (32.1%)] or participant refusal [n = 163 (28.1%)] (see Appendix 6, Table 61).

Of the 5065 CAM assessments, six (0.1%) had missing responses to CAM questions, two (0.04%) omitted the AMTS and 25 (0.5%) omitted the MotYB test (see Appendix 6, Table 62).

At 30 days, out of an expected 629 CAM assessments, 513 (81.6%) were completed (Table 13).

TABLE 13

TABLE 13

Number of 30-day CAMs performed out of number expected (excluding deaths and withdrawals) by randomised arm

Non-completion rates of the 30-day CAM in sites ranged from 2.8% to 30.6% (see Appendix 6, Table 63). More 30-day CAM assessments were not performed for participants in the POD group (n = 78) than for those in the control group (n = 38). Similar reasons for non-completion of the CAM were evident across the groups, although some differences between groups were noted for participant refusal (POD arm, 29.5%; control arm, 15.8%) and participants moving out of the area (POD arm, 12.8%; control arm, 21.1%) (see Appendix 6, Table 64).

Questionnaire return rates

Return rates of the questionnaire booklets to the CTRU were as follows: at baseline, 699 (98.0% of 713 registered participants); at 30 days, 511 (81.8% of 625 expected); and, at 3 months, 400 (70.5% of 567 expected) (see Appendix 6, Table 65). Participant age, sex, ethnicity and residence were broadly similar between those who did and those who did not complete the 30-day researcher questionnaire (see Appendix 6, Table 66).

The most common reasons for non-completion of the 30-day and 3-month questionnaire booklets were as follows: could not contact participant [27 (23.7%) and 92 (55.1%) for the 30-day and 3-month questionnaire booklets, respectively] and participant refused to complete them [26 (22.8%) and 31 (18.6%) for the 30-day and 3-month questionnaire booklets, respectively] (see Appendix 6, Tables 67 and 68).

Questionnaire compliance

Of the 511 30-day follow-ups, 313 (61.3%) were undertaken within ± 2 days of the due date [mean 28.9 (SD 4.93) days]. Of the 400 3-month follow-ups, 259 (64.8%) were undertaken within ± 2 weeks of the due date [mean 102.4 (SD 19.39) days].

Objective 5: estimation of effectiveness

Primary outcome

Fifty-seven (8.0%) of the 713 participants developed new-onset delirium within 10 days of recruitment: 24 (7.0%) of the 343 participants registered to wards delivering the POD system of care and 33 (8.9%) of the 370 participants registered to the control wards. New-onset delirium was slightly higher in orthopaedic trauma wards than in elderly care wards (10.0% vs. 6.4%).

Multilevel logistic regression analysis (adjusting for participant characteristics collected at registration and for ward type) was used to explore the between-group differences in delirium incidence. Although there was evidence that participants in the POD arm had lower odds of developing delirium, this result was not statistically significant (odds ratio 0.68, 95% CI 0.37 to 1.26; p-value = 0.2225) (Table 14). An unadjusted analysis confirmed this finding (odds ratio 0.77, 95% CI 0.44 to 1.33).

TABLE 14

TABLE 14

Multilevel logistic regression analysis (adjusted for participant characteristics collected at registration and for ward type) for the effect of POD on delirium occurrence (within 10 days of recruitment)

Objective 6: assessment of the variability in the incidence of delirium incidence

Delirium incidence in the eight hospital sites ranged between 4.6% and 12.9% (Table 15) (see Appendix 6, Tables 57 and 58).

TABLE 15

TABLE 15

New-onset delirium within 10 days of hospital admission by site

Objective 7: criteria for continuation to the definitive randomised controlled trial

We aimed to recruit 16 wards from eight hospitals and expected that eight of these wards would successfully implement the POD intervention. To proceed to a definitive trial, it was determined that the feasibility study should show that a minimum of six wards (75%) completed the implementation milestone checklist, were deemed competent and went on to deliver the POD intervention and recruit patients. All eight (100%) wards completed the implementation milestones. The overall recruitment rate to the POD trial was 16.0% (713/4449). This exceeded the pre-stated criterion of recruitment of at least 10% of the total recruitment pool.

Objective 8: cost-effectiveness analysis

For a full description of the cost-effectiveness analysis, see Appendix 5.

Missing data

The return rate of the EQ-5D was 98.6%, 77.5% and 65.3% at baseline, 1 month and 3 months, respectively (94–98% fully completed) (see Appendix 5, Table 34). The completion rate of the resource use questionnaire was lower at 48.7%. Participants with cognitive impairment at baseline were less likely to return the questionnaire than individuals with no cognitive impairment (see Appendix 5, Table 35).

Baseline imbalance

There was some baseline imbalance between the groups, and adjustment was required. QALYs were adjusted using baseline EQ-5D, age, ward type (orthopaedic vs. general), sex and cognitive impairment status (yes vs. no).

Validity of patient outcome assessments

A significant, positive correlation existed between the EQ-5D and NEADL scale scores at 3 months (r = 0.66), indicating that they measure similar constructs in this patient group (see Appendix 5, Figure 18). The trial sample had lower EQ-5D scores at baseline than UK age-matched population norm averages (reported in Kind et al.77) (see Appendix 5, Table 37). Patients who experienced delirium had a lower average baseline EQ-5D score than those who did not (0.09, compared with 0.26), and this difference was maintained across the different time points (1 month: 0.28, compared with 0.50; and 3 months: 0.15, compared with 0.43) (see Appendix 5, Table 38).

Validity of proxy outcomes assessments

At baseline, proxy-completed EQ-5D values were similar to self-completed (by participants) EQ-5D values, but, at 1 and 3 months, proxy-completed (or aided) EQ-5D completion underestimated quality of life (see Appendix 5, Table 39).

Costs

The POD group participants had higher average resource use for every health-care resource except general practitioner (GP) surgery visits and psychiatrist, psychologist or counsellor visits (see Appendix 5, Table 41). Participants in the POD group had, on average, 2.2 more overnight days in hospital and 1 more day in nursing/residential homes. Overall, the hospital inpatient stay appeared to be driving costs: mean costs were £4965 for the POD group and £4365 for the control group (see Appendix 5, Table 42). The average cost of the POD intervention was estimated as £10.98 per patient (see Appendix 5, Table 40).

Quality-adjusted life-years

The EQ-5D scores at baseline were slightly higher for the POD group than for the control group [mean 0.261 (SD 0.393) for the POD group vs. 0.234 (SD 0.347) for the control group]. Despite the fewer cases of delirium in the POD group, there were negligible between-group differences in QALYs, although, in all analyses, these were in favour of the control arm.

Cost-effectiveness

The trial-based ICER was dominated by standard care (see Appendix 5, Table 43). That is, the POD intervention resulted in higher costs and lower QALYs, albeit the QALY differential was negligible. The difference in cost varied from £920 in the complete-case group to £1127 for the complete-case and imputed items group. The difference in QALY varied from –0.01 in both imputation groups to –0.02 in the complete-case analysis (see Appendix 5, Table 43). NHS total cost and QALYs were replicated 10,000 times in a Monte Carlo simulation (see Appendix 5, Figures 2022). Using a £20,000 per QALY threshold, the probability that the POD intervention was cost-effective was 0.01 (1% chance) in a simulation using adjusted QALYs and complete-case and imputed items. This chance increased to 10% when using unadjusted QALYs and complete-case data only. The findings were robust to sensitivity analyses.

The health economics model (see Model development) was updated using information from the trial. There were differences between some parameter values used in the original model and those observed in the trial: lower delirium incidence, lower delirium rate reduction and much lower utility values. As POD appeared to result in additional resource use (a difference of £419), a sensitivity analysis was run in which this was added to the POD cost; see Appendix 5, Table 47, for the updated model parameters and assumptions. The updated model showed that the POD system of care had an incremental cost and QALY of £1775 and 0.11, respectively, resulting in an ICER of £16,133, which indicated that the POD intervention was cost-effective (see Appendix 5, Table 48). The probabilistic sensitivity analyses yielded mean incremental costs and QALYs of £1774 and 0.11, respectively, and an ICER of £15,454. The cost-effectiveness acceptability curve with a ‘willingness to pay’ of £20,000 showed that POD had a 100% chance of being cost-effective (see Appendix 5, Figure 23). The results of the trial and model-based analyses were conflicted, and thus limit the confidence we can place on the economic evaluation results. It is unclear why this divergence occurred. Clearly, the model time horizon was much greater than that for the trial analysis and it is possible that the (albeit small) differential in delirium occurrence, when extrapolated over a lifetime, fully reflected the costs and benefits of the intervention, and thus explains to some degree the contrast between trial and model outcomes. The model also fixes the assumed relationship between delirium incidence and outcomes (length of stay, mortality and health-related quality of life), whereas, in the trial, we assessed the relationships directly; it could be that there was an unexpected or lower relationship between these factors than anticipated or that data quality led to bias.

There were significant issues relating to data quality (e.g. missing data and reliance on proxy reports); future research should seek to identify the optimal strategy for data collection in this population.

Objective 9: estimation of a sample size for a definitive randomised controlled trial

The unadjusted ICC was calculated as 0.0002 (95% CI –0.21 to 0.21). Assuming a significance level of 5%, a study power of 90% and a delirium incidence reduction of 30% (consistent with previous studies and our own); incorporating the observed control group incidence rate of 8.9%; allowing for 15% loss to follow-up; and using the unadjusted ICC value of 0.0002, the trial would need to recruit 5200 patients in 26 hospital clusters (200 patients per cluster). As the data to inform this calculation were obtained from the feasibility study, the estimates of delirium incidence and ICC should be treated with caution.78 Table 16 presents a range of possible sample sizes for a future trial, with varying delirium incidence rates and ICCs (which are assumed to be low given the naturally large cluster size planned).

TABLE 16

TABLE 16

Sample size estimation for future definitive randomised controlled trial

Secondary objectives

Delirium

Severity of delirium episodes, duration of delirium episodes and time to first episode of delirium (including persistent delirium) were similar between the two groups (see Appendix 6, Tables 6974).

Falls

Nineteen falls were reported in wards receiving the POD system of care and 20 falls were reported in wards receiving control, with mean falls rates of 1.6 (SD 1.00) for the intervention group and 1.3 (SD 0.39) for the control group.

Length of hospital stay

The length of stay for patients who were discharged or who died while in hospital was similar between the groups: a mean of 9.7 days (SD 7.12 days) among those patients registered to POD and a mean of 9.8 days (SD 6.91 days) among those patients registered to the control.

Deaths

A total of 104 patient deaths were reported within 3 months of recruitment (14.6% of all registered patients): 56 (16.3% of patients registered) in the POD group and 48 (13.0% of patients registered) in the control group. Of these, 28 (26.9%) deaths occurred within 10 days of patient recruitment (see Appendix 6, Table 75). The number of deaths between the sites ranged from 5 (7.7%) to 22 (21.2%).

Discharge destination

Of those patients discharged, a larger proportion of patients registered to the POD group [176/248 (71.0%)] than patients registered to the control group [194/288 (67.4%)] were discharged home (Table 17).

TABLE 17

TABLE 17

Discharge location by randomised arm

Of the 536 patients discharged, 118 (22.0%) had a change in discharge destination from independent to institutionalised accommodation: 47 out of 248 (19.0%) in the intervention arm and 71 out of 288 (24.7%) in the control arm (Table 18).

TABLE 18

TABLE 18

Change between baseline and discharge location by randomised arm

Patient-reported outcomes

Raw (unadjusted) scores for the NEADL scale, Clinical Anxiety Scale and the Geriatric Depression Scale score showed little between-group differences, although control scores appeared very slightly higher for the NEADL at both baseline and 3 months (see Appendix 6, Tables 7679).

Poor outcome

Poor outcome (defined as death, persistent delirium or change in accommodation at hospital discharge from home to residential care/nursing home or from residential home to nursing home) was similar: 80 out of 343 (23.3%) in the POD group and 72 out of 370 (19.5%) in the control group (see Appendix 6, Table 80).

Safety

There were no unexpected serious adverse events reported that were clearly attributable to the POD intervention.

Parts of the following section have been reproduced Young et al.55 © The Author(s) 2020. Published by Oxford University Press on behalf of the British Geriatrics Society. This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Copyright © Queen’s Printer and Controller of HMSO 2021. This work was produced by Young et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.

Summary

Recruitment

We recruited the target number of 16 wards and we recruited 714 participants (99% of our target of 720) of the 4449 patients admitted to the 16 study wards, a recruitment rate of 16.0%. There was imbalance in the number of elderly care and orthopaedic trauma wards recruited and the number of participants recruited to those ward types between arms. The characteristics of the screened and registered participants were similar and showed that the populations and arms were similar with respect to age, sex and ethnicity.

Follow-up

There were few losses to follow-up [33 (4.6%) participants withdrew] and the rate of data collection was high: 89.7% of expected in-hospital CAM assessments (primary outcome) and 81.6% of the 30-day CAM assessments were undertaken as planned by the RAs.

Missing data

The return rate of the postal questionnaire booklets at 3 months was 70.5%.

Intervention implementation

All eight wards randomised to deliver the POD intervention completed the preparation for implementation and delivered the system of care. The optional volunteer element was included by only three of the eight wards. None of the sites withdrew.

Contamination

There was little evidence of contamination between the study wards, although not all wards routinely collected data on staff moves.

Health economic study

Early in the research work (project 1), and in the absence of observed data, a decision-analytic model was developed to determine the potential for the POD system of care to be cost-effective. The model made assumptions about delirium incidence, POD effectiveness, costs, survival and quality of life. It concluded, with a high degree of certainty, that POD would be cost-effective. This model was updated to include information from the trial, including POD costs, delirium rates and POD effectiveness, and the estimates of cost-effectiveness were updated. This analysis allowed us to test our previous assumptions, and also to estimate the cost-effectiveness, taking into account a longer time horizon.

The POD system of care led to fewer cases of delirium, but this did not translate to lower costs or more QALYs, regardless of the data adjustment, imputation method and Monte Carlo simulation used. Hence, POD did not appear to represent value for money in the cost–utility framework over a 3-month period. The updated decision model yielded expected costs and benefits, which were both higher for POD than for usual care. The ICER for the analysis (deterministic and probabilistic) indicated that the POD system of care was cost-effective. At a willingness-to-pay threshold of £20,000 per QALY gained, POD was cost-effective in 100% of the Monte Carlo simulations.

Image RP-PG-0108-10037-fig18
Image RP-PG-0108-10037-fig20
Image RP-PG-0108-10037-fig22
Image RP-PG-0108-10037-fig23
Parts of the following section have been reproduced from Young et al.54 This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Copyright © Queen’s Printer and Controller of HMSO 2021. This work was produced by Young et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.
Bookshelf ID: NBK569186

Views

  • PubReader
  • Print View
  • Cite this Page
  • PDF version of this title (2.7M)

Other titles in this collection

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...