U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Wildman MJ, O’Cathain A, Hind D, et al. An intervention to support adherence to inhaled medication in adults with cystic fibrosis: the ACtiF research programme including RCT. Southampton (UK): NIHR Journals Library; 2021 Oct. (Programme Grants for Applied Research, No. 9.11.)

Cover of An intervention to support adherence to inhaled medication in adults with cystic fibrosis: the ACtiF research programme including RCT

An intervention to support adherence to inhaled medication in adults with cystic fibrosis: the ACtiF research programme including RCT.

Show details

Appendix 11Work package 3.3: process evaluation triangulation table

TABLE 22

Process evaluation triangulation table

Type/source of dataQualitativeQuantitativeAcceptability questions in RCT intervention arm (n/N = 257/305)/usual-care surveys (n/N = 19/19)/CONSORT RCT monitoring (N = 305)Convergence, complementary, disagree, silence (meta-inferences)
Interventionist and MDT interviewsPWCF in intervention arm of RCT interviewsMediation analysisFidelity
Implementation
Fidelity: domains of fidelity
  • Completing action plans was described as a box-ticking exercise sometimes
  • Tension between taking a motivational interviewing-informed approach and getting patients to do things they were supposed to do to hit fidelity targets, specifically action plans
  • There was evidence that patients received the intervention and that some patients enacted some of the behaviours such as action plans
  • Receipt – both intervention sessions and CFHealthHub were a source of information and education
  • Intervention sessions helped to identify individual barriers and facilitators – also helped people link treatments to aspects of daily routine
  • Preference for different aspects of intervention – mainly the interventionist knowing more about them
  • Enactment – successes in establishing new routine and habits. Using cues and triggers was popular but did not always work
  • High levels of fidelity for all RCT sites except one. Information was based on recorded consultations as well as clicks on CFHealthHub
  • Fidelity was high
Adaptations
  • Interventionists adapted timing of visits around patient availability
  • Sometimes wanted patients to have more visits than patients wanted
  • Some did not stick to scripts and tools but adapted them
  • Some interventionists showed the CFHealthHub videos during visits
  • Patients appreciated intervention sessions being arranged, or rearranged, to suit them – adapting the flow of visits
Access to intervention
  • Technical issues
  • Patients were generally not put off by technical issues as long as they could be explained
  1. CFHealthHub went down for 5 weeks near the end of the RCT, affecting a subset of patients
  2. Four new interventionists recruited
  • Need to address loss of CFHealthHub in sensitivity analysis for RCT
Dose
  • Some patients were hard to get hold of and may not have had the expected number of visits
  • Interventionists sometimes used the flow chart of visits in a flexible way but generally stuck to the overall flow of intervention visits
  • Patients spoke about having to rearrange appointments and so there was longer between sessions than there should have been, or visits were missed
  • No one mentioned that they would have liked more sessions
  • Fidelity to minimum sessions was high
  • Dose was as expected
Feasibility
  • The intervention was feasible to deliver by the interventionists and by the sites in the RCT
  • The intervention was feasible
  • Feasible
Reach
  • Self-selecting sample of people who are happy to be monitored?
  • CF centres had preferences for nebulisers, which influenced reach
  • Some interventionists approached patients who they thought would sign up (at least initially). Some interventionists had patients with learning disabilities who found the written aspects of the intervention difficult. Some interventionists reported hard to reach populations with no fixed abode, nowhere to plug a hub in
  • Better for ‘middle’ adherers – people who are not ill enough to see team regularly but are not high-level adherers with established routine
  • Good for some but ‘not for me’ (very low-level baseline adherers)
  • Good for people who are online quite often, for people who need more knowledge; reassurance for high-level adherers
  1. 1581/3510 (45% of eligible)
  2. 607/1581 (38% of eligible recruited to RCT)
  3. 125 unwilling to change nebuliser (8% of eligible)
  • Further work looking at differences between CF population register and RCT participants needed
Mechanisms of action/impact
Acceptability of interventionists
  1. Relationship with interventionists highly valued. Patients seemed to prefer home visits but not allowed in some RCT sites
  2. Creating long-term continuity of care in relationship important
  3. Having time to build and maintain relationships
  4. Difficulties contacting some patients
  1. Relationship with interventionists highly valued
  2. Patients liked choice of venue for meetings
  3. Preferred face-to-face visits than telephone visits but if away from CF centre, telephone visits could also work
  1. 60% found interventionist support very helpful and 7% unhelpful, so a largely acceptable component
  2. 287/305 (94%) got first intervention visit. A total of 77% patients found first meeting very helpful. No one not finding it helpful, so a universally acceptable component. But note that only 257 out of 305 people completed this item owing to loss to follow-up
  3. For follow-up telephone and facet-to-face visits, 59% and 67%, respectively, found very helpful, again with few finding it unhelpful
  4. Helpfulness ratings of interventionists differed by site with three sites having higher levels of dissatisfaction/saying not helpful (24–33%)
  • Majority of patients found interventionists and meetings helpful. Qualitative explains why – emphasis on relationship building. Likely to be a key mechanism of action but not tested in mediation analysis
Acceptability of adherence feedback graphs
  1. Useful for interventionists and MDT
  2. Technical problems, sometimes data different from patient experience
  3. Proof of adherence or proof of non-adherence
  1. Key mechanisms of self-monitoring and self-regulation
  2. Patients used this part of the intervention outside visits
  3. Liked traffic light aspect
  4. Main aspect of CFHealthHub that was looked at or used by PWCF as proof, reward and motivation
  • Adherence calibration between subjective and objective adherence explained increases in adherence rates
  • 68% of patients found graphs very helpful and only 4% not helpful, so universally acceptable component
  • Agreement from a number of sources that this was a key mechanism of action
My toolkit
  • Used more by some interventionists, where tools were actually used with patients. Some interventionists merely put them on to CFHealthHub for patients rather than engaging actively with tools with patients
  • Not often used outside meetings
  • 44% found toolkit very helpful, 16% not helpful, so not helping every one
  • Could be a useful part of the intervention
Action plans/coping plans
  1. Some people doing actions plans
  2. Need to revisit and tweak plans, so not a one-off exercise
  3. It is sometimes a box-ticking exercise in terms of completing actions plans
  4. Difficult to set them and encourage people to do it themselves
  5. Happening informally in that patients do not want to put them down on paper
  6. Day and party planner not used independently by patients
  7. Interventionists struggled to understand coping plans and use them with patients. Easier when renamed as backup plans and further training from research team
  1. If action plans do not work at first, some were reluctant to try again, whereas others did try again
  2. Difficult to formulate plans on CFHealthHub
  3. Some patients found these worked straightaway, whereas others tweaked them to make them work and others just struggled with them
  1. 216 participants with push notifications enabled
  2. 227 participants made action plans
  3. 118 participants made coping plans
  4. 39% very helpful and 20% not helpful
  • Action plans were used and found to be very helpful by some patients, but used more informally than formally. One-fifth of patients did not find these helpful
Treatment videos
  • Helped to increase knowledge
  1. Patients understood better how treatments worked even if they already thought they knew
  2. Thought they would be good to share with others (e.g. family)
  • 38% found them very helpful and 26% not, so helping some not others
  • Treatment videos helpful for some patients
‘Talking head’ videos
  1. Patients either loved or hated them
  2. Some interventionists showed them during visits rather than leaving patients to look at them alone after visits
  • Some patients liked to see people in similar circumstances (i.e. with children) and some did not want the reminder that they had CF
  • 29% very helpful and 34% not helpful. The love-it-or-hate-it aspect is not obvious here because other components had this distribution
  • Talking head videos helpful for some patients
My treatment
  • 48% very helpful and 11% not helpful
  • My treatment part of CFHealthHub helpful for some patients
Problem-solving
  • Could be picked up during conversation to address an issue (e.g. going on holiday or cleaning nebulisers)
  • Not looked at much by patients in this sample but described as a useful source of information if they had an issue before contacting interventionist
  • 33% very helpful and 19% not helpful
  • Problem-solving helpful for some patients
App
  1. Preferred way to access CFHealthHub
  2. Not everything was accessible on the app and tricky to see some aspects of the graphs
  3. Could not see times on app but quick and easy
  • 224/305 (78%) using app
  • Accessing CFHealthHub through the app was appreciated by patients
Interaction with MDT
  1. Some difficulties if MDT gave different advice to patients
  2. Engagement of MDT varied across RCT sites
  3. Concerns that others in MDT would use graphs information in the wrong way
  1. Key mechanism of action was that others were monitoring, including MDT and interventionists
  2. Feeling of not being believed by MDT in the past but objective data could offer proof of adherence
  3. Mechanism of praise from MDT for adherence improvement, completing the feedback loop
  • Potentially important part of intervention but varied by RCT site
Training in delivering the intervention
  • Training was well received. Some gap between training and delivering the intervention. Some issues around the way the intervention is delivered in terms of MI-informed approach. More could have been done around that
    • Excellent support from CTRU
    • Excellent support from CTRU
  • Good training in delivering intervention
Value/perceived benefits of intervention
  1. Reported examples of improvements: reductions in exacerbations, put on weight, doing exercise, family have noticed
  2. Only of benefit to some patients? Depends on baseline adherence level. Or is it different benefits for each group?
  3. Videos increase knowledge of patients, and family and friends
  4. Can change identity of patient to MDT if patient had been known as a low-level adherer but the objective data showed they were a high-level adherer
  5. Interventionists found that the approach to communicating with people stimulated reflection on their own practice even if they had had MI training in the past
  1. Reported examples of improvements: increase in FEV1, less hospital visits, cough stopping
  2. Able to show proof to MDT and family that they were doing their treatment
  3. High-level adherers already had habit formation, so no improvements there, but could see patterns and check, use monitoring for reassurance
  4. Some patients liked routine and habit forming, and others disliked it, so resisted habit forming
  5. Appreciated the more in-depth relationships with interventionists – felt they were known better by health-care professionals
  • Perceived benefits
Unexpected pathways and consequences/safety
  1. Monitoring objective adherence data was worrying to some patients because they fixated on the data and withdrew owing to felling the pressure to improve
  2. If there was no praise from the MDT, patients could be demotivated to increase adherence
  3. CTRU monitoring of action plan completion may have contributed to some interventionists setting inappropriate action plans or with patients who were not sufficiently motivated
  • The intervention was successful for some patients when it was at the ‘right time’ (e.g. moving house/less travelling, leaving university or starting work)
  • No adverse events
  • Mainly positive unexpected pathways
Context
Differences between PWCF
  1. Baseline adherence rate is very important in terms of how patients use the intervention and benefit from it
  2. Adherence can be inconsistent owing to life events
  3. Needs to be the right time for someone for them to engage fully with intervention
  1. Chaotic lives hindered habit formation
  2. Low levels of literacy or dyslexia could prohibit writing action plans
  • Need to consider changes in adherence rates and other outcomes by baseline adherence rate
Usual care in RCT sites
  1. Usual-care arm feel monitored in the RCT, so may increase their adherence rates so not just receiving usual care
  2. Differences between RCT sites in how much adherence and MI communication style was embedded in usual care
  1. Intervention seen by patients as opportunity for interventionists to get more insight into their lives than usual care – opportunity to discuss more things, and in more depth, as had longer time with interventionists than usually have with MDT
  2. Differences between sites in how intervention was delivered (in a clinic or at home)
  3. Variation in how integrated the intervention was perceived to be with usual care
  1. Sites tended not to use MPR to understand adherence during consultations, but this increased over time, and did not use bespoke graphs of I-neb plots, but some used Insight Online. Majority said they used some objective adherence measurement but in an ad hoc way
  2. A minority of sites tended to reduce the target prescription and this increased over time (21% then 37% always/often), and tended not to use I-neb data to inform consultations (21% then 25%)
  3. Majority asked about adherence and thought adherence support important
  4. 63% used MI at baseline and a further five sites used it at follow-up
  5. On average, encouraging airway clearance was considered the most important and encouraging exercise was considered the least important
  1. There did not seem to be a high level of action similar to the intervention at play in usual care
  2. Usual care varied by RCT site
  3. The intervention appeared to be offering new actions over and above usual care
  4. Not much changed in usual care over the time of the RCT
  5. If monitoring is an important mechanism then some controls may wrongly believe that the MDT were monitoring them and this could have increased adherence
Nebuliser type
  1. Patients had preferences that influenced participation in RCT and withdrawal from RCT
  2. CF centres had preferences for nebulisers, which influenced reach
  1. Some found the new nebuliser issued in the RCT quicker, quieter, smaller and more effective
  2. Others found it harder to use because they had to use it at different times from their old nebuliser and they had to change established systems/habits
  • 4 people withdrew from the RCT owing to preference for another nebuliser
  • The types of nebulisers offered as usual care at RCT sites may have affected effectiveness of intervention
RCT sites/CF centres
  • There are differences between RCT sites in terms of implementation, context, interventionists, who joined the RCT, and engagement from MDT. Differences included whether interventionists could make home visits or had to see patients at a clinic, the organisation of the interventionist’s role, organisation of care (e.g. patient notes), culture of the CF centre, how the CF centre reacted to the CQUIN that paid treatment costs for the intervention, types of nebulisers usually used, drugs prescribed, links to MDT, and interventionist skills/background
  • There may be differences in implementation between RCT sites
RCT
  1. Some usual-care arm patients believed that the interventionist could see their data. Usual-care arm participants feel monitored, so may increase their adherence rates
  2. Disappointment in usual-arm participants
  3. Motivation questions on RCT questionnaire did not pick up who was not motivated to do treatment. This could be picked up by the interventionist in their first meeting
  4. Paperwork and data collection burden
  5. The site principal investigator was more involved in the RCT in some sites
  6. CTRU monitoring of sites influenced which aspects of the intervention were focused on
  • Lots of questionnaires to answer – sometimes confusing as to what rating to give as could not remember how they had rated things last time and thought this might cause problems
  • May see increase in adherence in the usual-care arm

This grid was created to facilitate analysis and is presented here as part of the audit trail for the conclusions drawn in the main body of the report.

Copyright © 2021 Wildman et al. This work was produced by Wildman et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction and adaption in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited.
Bookshelf ID: NBK574639

Views

  • PubReader
  • Print View
  • Cite this Page
  • PDF version of this title (7.1M)

Other titles in this collection

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...