Four open label studies that were not included in the systematic review are summarized in this section (). Two studies enrolled patients with T1D (B001 and B002) and two studies were performed using mannequins instead of patients (IGBM and AMG111).
Non-Randomized Studies of Intranasal Glucagon Use in a Community Setting
The studies included in the systematic review do not provide evidence on symptom resolution following intranasal glucagon administration or use of the intranasal delivery device during real-world hypoglycemia. Two manufacturer-sponsored studies assessing the use of intranasal glucagon 3 mg to treat real-life events of hypoglycemia were conducted, one in pediatric patients (Study B00123,26) and one in adult patients (Study B00224,27).
Methods
The B001 and B002 studies were multi-centre, single-arm, open label studies. Study B001 was conducted in 2015 at three centres in the US, and Study B002 was conducted from 2014 to 2015 at three centres in the US and six centres in Canada. In both studies, one centre was excluded from efficacy analyses due to non-compliance with good clinical practice (GCP). Study B002 was paused due to an issue with powder aggregation and resulting underdosing in some patients. An evaluation period of approximately six months was expected for both studies to reach the required sample size of evaluable events. Patients continued in the study until one or more hypoglycemic events occurred or the study was complete, whichever occurred first. Patients (and caregivers in Study B001) attended study visits two and four months following enrolment, as well as at the end of the study.
Populations
Patients in both studies were required to have had T1D for more than one year and be in good general health to be included. Patients in Study B001 were at least four years of age and under 18 years of age and living with at least one caregiver. Patients in Study B002 were adults of 75 years of age or younger, had a body mass index between 18.5 and 35.0 kg/m2, and were living with or in frequent contact with at least one caregiver. Patients in both studies were excluded if they had pheochromocytoma or insulinoma, or were using systemic beta blockers, indomethacin, warfarin, or anticholinergic drugs.
Patients in the efficacy analysis population (EAP) of Study B001 (see the statistical analysis section below for definitions) had a mean age of 10.2 years and a mean duration of diabetes of 6.3 years (). Most patients used an insulin pump as their primary insulin modality. In this population, 42.9% of patients had never experienced a severe hypoglycemic event and 21.4% had reduced hypoglycemia awareness according to the Clark Unawareness Score. For those patients who had experienced a severe hypoglycemic event in the past year, all patients had experienced it within the last 90 days.
Summary of Baseline Characteristics (B001 and B002 Studies).
Patients in the Study B002 safety population (see the statistical analysis section below for definitions) had a mean age of 46.2 years and a mean duration of diabetes of 26.3 years (). Approximately half used an insulin pump and half used insulin injection as their primary insulin modality. In this population, 9.5% of patients had never experienced a severe hypoglycemic event and 40.6% had reduced hypoglycemia awareness. A severe hypoglycemic event had occurred in the past year in 58.2% of patients.
Interventions
In both studies, each patient was dispensed four doses of intranasal glucagon 3 mg and patients and caregivers were trained in its use. Patients and caregivers were also encouraged to keep one dose and one set of questionnaires with them at all times and the other doses and questionnaires in convenient locations. Patients in Study B001 were limited to four doses while patients in Study B002 could be dispensed additional doses.
Evaluable Events
Both moderate and severe hypoglycemic events were to be treated with intranasal glucagon and the definitions of each differed between the two studies. For hypoglycemic events to be considered evaluable, patients had to refrain from ingesting carbohydrates or injecting glucagon before responding or within 30 minutes of intranasal glucagon administration and not require external professional medical assistance. Events from centres with GCP non-compliance or occurring during the study pause in Study B002 were not considered evaluable events.
In Study B001, severe hypoglycemia was defined as the patient having severe neuroglycopenia (described as “usually resulting in coma or seizure”) requiring treatment with parenteral glucagon or IV glucose. In Study B002, severe hypoglycemia was defined as clinical incapacitation of the patient (i.e., unconscious, convulsing, or with severe mental disorientation) to the point where they required third-party assistance to treat the hypoglycemia.
Moderate hypoglycemic events in Study B001 were those in which the patient had signs and/or symptoms of neuroglycopenia and a blood glucose level of 70 mg/dL (equivalent to 3.9 mmol/L) or less at or near the time of treatment. The definition was similar in Study B002, except that the blood glucose level threshold was “approximately” 60 mg/dL (3.3 mmol/L) or less and did not appear to be strictly enforced.
Outcomes
The primary end point in both studies was originally the proportion of patients awaking or returning to a normal status within 30 minutes following study drug administration. The end point was amended to the proportion of hypoglycemic events rather than the proportion of patients.
Secondary end points in both studies included time to administer study drug, caregiver degree of satisfaction, and delivery method preference assessed with a hypoglycemia episode questionnaire completed by the caregiver. A set of pre-specified treatment-emergent AEs was assessed in the hypoglycemia episode questionnaire and could be recorded up to five hours post-administration in Study B002. More targeted AEs were assessed using a nasal score questionnaire, which was completed by caregivers in Study B001 and patients in Study B002. A tertiary end point of change in blood glucose level from time of study drug administration to 15, 30, and 45 minutes following administration was reported.
Statistical Analysis
No statistical tests were performed on the data. Efficacy end points were evaluated in the EAP, defined as enrolled patients who received at least one dose of study drug in an evaluable event and with evaluable information on treatment response. Questionnaire-based outcomes were reported for the EAP in Study B001 and for the main safety analysis population (MSAP) in Study B002, which was defined as enrolled patients who received at least one dose of study drug and experienced at least one hypoglycemic event (patients from GCP non-compliant sites and those underdosed during the pause in Study B002 were excluded). A sensitivity safety analysis population (SSAP) was also defined, which consisted of all enrolled patients who received at least one dose of study drug.
Study B001 was designed to include approximately 20 events of severe or moderate hypoglycemia. Study B002 targeted a sample size of 129 events of severe or moderate hypoglycemia, assuming that 75% of events would involve a successful response. The sample size was selected to yield a 95% CI for the primary end point with a width of 15%.
Patient Disposition
Details on patient disposition in the studies are provided in . Since patients could have experienced hypoglycemic events prior to discontinuation, early discontinuation did not necessarily exclude patients from efficacy analyses.
Patient Disposition (B001 and B002 Studies).
Outside of the GCP non-compliant centre, there were no protocol deviations in Study B001 that were considered by the sponsor as likely to have affected the results or conclusions. In Study B002, seven severe hypoglycemic events were excluded from the EAP due to: dose administration before the study pause (n = 1); consumption of oral carbohydrates (n = 2); not fully depressing the device plunger (n = 2); and GCP non-compliance (n = 2). In the total pool of hypoglycemic events, 22 events were excluded from the EAP for the above reasons, including seven events during which the device plunger was not fully depressed. Other reasons for exclusion were primary outcome data missing; patient was found to be ineligible; and device was triggered in the air (n = 1).
Treatment Exposure
▬▬▬▬▬
Treatment Exposure (B001 and B002 Studies — Safety Population).
Efficacy
Response To Study Drug Administration
Results for the primary end point and time to response in evaluable hypoglycemic events are presented in . In Study B001, there were 33 evaluable events (all of them moderate hypoglycemia) in 14 patients. Blood glucose recorded at the time of glucagon administration ranged from 2.3 to 3.9 mmol/L. In all events, the patient returned to normal status within 30 minutes of study drug administration.
Summary of Hypoglycemic Events and Resolution (B001 and B002 Studies).
In Study B002, there were 157 evaluable events of moderate or severe hypoglycemia in 69 patients and the patient awoke (in cases of unconsciousness or convulsion) or returned to normal status in 96.2% of the events. In 3.4% of events, the patient returned to normal status after more than 30 minutes had elapsed following study drug administration, and in one event (0.7%) the patient did not return to normal status due to extreme headache. Blood glucose recorded at the time of glucagon administration ranged from 1.2 to 4.1 mmol/L. There were 12 events of severe hypoglycemia in seven patients (with one patient experiencing six of these events) and in all of these events the patients awoke or returned to normal status within 15 minutes of study drug administration, regardless of whether they were conscious at the time of administration.
Time To Administer Study Drug
According to the hypoglycemia episode questionnaire in Study B001, the time to administer the study drug (starting from when the device canister was opened) was less than two minutes in all evaluable events, with 60.6% of administration times being less than 30 seconds (). In Study B002, the time to administer the study drug was less than five minutes in all hypoglycemic events in the MSAP, with 70.4% of events having an administration time of less than 30 seconds.
Selected Results From the User-Friendliness Questionnaire (B001 and B002 Studies).
User Satisfaction and Device Preference
The hypoglycemia episode questionnaire in both studies also collected data from users on their satisfaction with use of the intranasal glucagon device and preference compared with needle-based glucagon delivery (). After most events, users found their overall experience in administering the study drug to be “very easy” (66.7% in Study B001 and 70.9% in Study B002) or “easy” (24.2% in Study B001 and 22.9% in Study B002). The remaining responses were either “average” or “relatively easy.” After most events, users strongly agreed (75.8% in Study B001 and 73.2% in Study B002) or agreed (6.1% in Study B001 and 16.2% in Study B002) that intranasal delivery of glucagon is preferable over needle-based delivery of glucagon for the treatment of severe hypoglycemia.
Harms
The SSAP consisted of enrolled patients who received at least one dose of study drug, regardless of study site or, in Study B002, whether they were underdosed prior to the study pause. In Study B001, no patients in the SSAP (N = 22) reported a SAE and there were no deaths. In Study B002, one patient in the SSAP (N = 87) discontinued treatment due to an AE and there was one death from Klebsiella pneumoniae infection. Spontaneous AEs were not collected in either study.
Caregivers reported at least one AE in the hypoglycemia episode questionnaire for all patients in the EAP in Study B001 and 87.8% of patients in the MSAP in Study B002 (). The most commonly reported AEs were nasal discomfort/irritation (82.4% to 92.9%), watery eyes (85.7% in Study B001), and headache (54.1% to 71.4%). At least one AE that lasted for more than an hour was reported for half of the patients in Study B002.
Summary of Questionnaire-Solicited Adverse Events (B001 and B002 Studies).
All caregivers for patients in the EAP in Study B001 and 72.4% of patients in the MSAP in Study B002 reported at least one AE in the nasal score questionnaire (). The most commonly reported AEs were runny nose (64.3% to 66.2%), watery eyes (55.4% to 78.6%), nasal congestion (36.5% to 50.0%), sneezing (33.8% to 50.0%), and nasal itching (28.6% to 56.8%).
Critical Appraisal
Overall, the B001 and B002 studies provide insight into the efficacy and harms of intranasal glucagon treatment in real-life events of moderate and severe hypoglycemia. The primary end point was assessed during real-life events as opposed to induced events of hypoglycemia. However, the results may overestimate the effectiveness of intranasal glucagon under real-world conditions due to the following factors: reporting of outcomes on a per-event basis rather than a per-patient basis, the more recent training of patients and caregivers in administering glucagon than would be expected in the real world, and the exclusion in Study B002 of events during which a full dose was not administered due to user error.
Internal Validity
All of the results in the studies come from questionnaires filled out by caregivers (and patients in Study B002) and reliability of the reporting is unknown. While the use of caregiver reporting likely did not affect the results for the primary end point (though the reliability of timing of patient recovery remains uncertain), reporting of AEs by caregivers in the questionnaires was likely subjective.
▬▬▬▬▬
▬▬▬▬▬
Results were reported on a per-event basis (as opposed to a per-patient or -caregiver basis) for the time for administration, ease of use, and device preference. The outcomes for multiple events within a patient cannot be considered independent of one another. It is possible that caregivers found ease of use to increase with recurring events and time to administer the study drug could have decreased with recurring events. Therefore, results for these outcomes cannot be interpreted as being representative of first-time users and the potential clustering of effects within patients could have led to more favourable results.
The lack of a comparator in these studies means that comparative evidence is not available for real-life hypoglycemic events and that the device preference results should be interpreted with this consideration. Since 42.9% of the pediatric patients and 9.5% of the adult patients had not previously experienced an event of severe hypoglycemia, a significant proportion of caregivers may have had no previous experience with administering injectable glucagon. While caregivers would possess the relevant skills due to experience with administering insulin, the lack of experience with injectable glucagon precludes a fair comparison with intranasal glucagon in terms of preference.
While a validated tool was not used to assess device preference, the clinical expert consulted for this review considered the results for this outcome to be meaningful.
External Validity
The primary end point results should be interpreted as being in the context of successful administration of intranasal glucagon. Time to administer study drug and ease of use may have been more favourable in the studies than they would be in a real-world cohort since evaluable events occurred within six months of all patients and caregivers being instructed in the use of intranasal glucagon. According to the clinical expert consulted for this review, caregivers may go for years without reviewing the technique for administering the currently available injectable glucagon if they do not commonly encounter severe hypoglycemia.
While the sample size and number of centres were limited in Study B001 and only patients with T1D were included, the populations in both studies were generally representative of patients who would be dispensed glucagon in Canadian practice. The patient samples had a wide range in age and duration of diabetes and represented a mixture in the categories of hypoglycemia awareness and history of severe hypoglycemia.
While only 12 severe hypoglycemic events in seven adult patients were evaluable among the two studies, this reflects the rarity of these types of events. Severe hypoglycemic events did not occur in Study B001, though the definition for severe hypoglycemia used in the pediatric population was more restrictive than the one used in the adult population.
Studies Comparing Modes of Glucagon Administration in Simulated Emergency Scenarios (Mannequins)
While ease of use of the intranasal mode of delivery may offer a benefit over currently available comparators for the drug under review, ease of use and device preference were not assessed in the included randomized controlled trials (RCTs). Two published manufacturer-sponsored studies (unpublished Study IGBM28 and published Study AMG11125,29) comparing administration success, time to administration, and usability between intranasal and injectable glucagon during simulated severe hypoglycemia events using mannequins may address this gap in evidence.
Methods
The IGBM and AMG111 studies were randomized, crossover, single-centre studies conducted in the US. Each study was conducted in two cohorts — caregiver-patient dyads, and acquaintance participants (APs) who were meant to represent non-caregiver bystanders. Details of the studies are provided in .
Caregiver-patient dyads attended three separate sessions spaced one week (Study AMG111) or at least one week (Study IGBM) apart. In the first session, patients received training on one glucagon device (randomized to injectable or intranasal) in the first session and subsequently trained their caregivers in the use of that device. In the second session, caregivers used the device in a simulated emergency situation, and patients received training in the other device and subsequently trained their caregivers in the use of the second device. In the third session, caregivers used the second device in a simulated emergency severe hypoglycemic event.
In these studies, APs attended either one session (Study AMG111) or two sessions spaced at least one week apart (Study IGBM). They were shown one glucagon device (randomized to injectable or intranasal) and then used it in a simulated emergency severe hypoglycemic event. This was repeated with the second device in the same session or in the second session.
Populations
Each caregiver participant (CP) in Study IGBM was a close friend, relative, or caregiver of the PWD and had not previously administered injectable glucagon or another rescue medication. In Study AMG111, CPs were the primary caregivers for the PWDs and had not previously used injectable glucagon and had not received recent training in the use of glucagon. The median age of CPs was 51 years (range of 18 to 75 years) in Study IGBM and 54 years (range of 20 to 69 years) in Study AMG111 ().
Summary of Baseline Characteristics (Simulation Studies).
Most PWDs had T2D and the median duration of diabetes was 16 years in Study IGBM and 15 years in Study AMG111. In Study IGBM, PWDs were permitted to have been previously trained in the use of injectable glucagon, but not in the two years prior to the study. In Study AMG111, none of the PWDs had ever seen or received training on a glucagon device previously and none owned one at the time of the study.
APs were those who stated that they would try to help if an acquaintance experience a severe hypoglycemic event, and had no caregiving responsibilities to a PWD (Study IGBM) or had no experience with glucagon and diabetes (Study AMG111). The median age of APs was younger than those of CPs, being 41 years in Study IGBM and 40 years in Study AMG111.
Glucagon Administration Training
For each glucagon delivery device, PWDs in Study IGBM were trained for a maximum of 30 minutes by study personnel who reviewed the instructions for use and demonstrated the use of the device. PWDs were then given the device to verbalize and demonstrate understanding of the instructions. They also opened a new device and demonstrated the steps for administration, with study personnel correcting errors, reteaching missed steps, and answering questions on use of the device. After an hour-long break that included a distractor task for the PWD, the PWD relayed the device instructions to their caregiver and were allowed to show but not actuate a new glucagon delivery device (the intranasal device had to remain in its shrink-wrapped tube).
For each glucagon delivery device in Study AMG111, study personnel read the instructions for use to the PWDs and demonstrated the administration procedure without actuating the device. PWDs could handle the device but not actuate it. After a 10- to 30- minute break which included distractor tasks, PWDs then discussed how to use the device with their CPs. The intranasal device was not available for demonstration.
In both studies, APs received no training on the glucagon delivery devices. In Study IGBM they were given basic information about severe hypoglycemia, and in both studies APs were shown each device.
Simulated Severe Hypoglycemic Events
In both studies, CPs and APs participated in videotaped simulated severe hypoglycemic events in which they had to find a glucagon device (injectable or intranasal) and administer glucagon to a mannequin representing the person experiencing severe hypoglycemia. Device order for the sessions was randomized in Study IGBM, while device order in Study AMG111 appeared to be assigned according to whether the participant’s identification number in the study was odd or even.
In Study IGBM, the medical mannequin was clothed and had simulating breathing, blinking, pulse, heart sounds, and perspiration. Prior to starting the simulation, participants were informed that they would find a mannequin in the room that represented their associated PWD (for CPs) or a fictional co-worker (for APs). Participants were informed that the person had passed out due to hypoglycemia, and the importance of administering rescue medication was emphasized. They were also informed that their performance was being timed and recorded on video, that the glucagon rescue device would in the bedroom drawer (for CPs) or the mannequin’s backpack (for APs), and that the ambulance would not arrive for 15 minutes. Alongside the glucagon rescue device were other items, including diabetes supplies. For CP simulations, there was a television playing and a cell phone alarm sound. For AP simulations, there was a computer that was on and a cell phone alarm sound.
In Study AMG111, the mannequin was clothed. Prior to starting the simulation, participants were informed that the mannequin was in severe hypoglycemia and that they needed to find the glucagon rescue device in the mannequin’s backpack (which also contained diabetes supplies) and administer glucagon to the mannequin as quickly as possible.
In the first session, participants were told that they were being recorded on video and that the video was being streamed live over the internet and could appear in future educational and promotional material. They were also told that a team of experts was watching and evaluating them from behind a one-way mirror and the importance of administering rescue medication was emphasized. During the scenario, someone knocked loudly on the door and stated that they would make sure the ambulance was on its way once the participant found the glucagon device.
In the second session, participants were reminded of the situation and distractions were more frequent than in the first session. A loud beeping sound at one beep per second played throughout the simulation and increased in speed and intensity while study personnel made statements meant to simulate those of a distressed bystander if they deemed the participant was not engaging in the scenario. There were also distractions when the participants opened the glucagon packaging and at 30 seconds after the glucagon was found.
Outcomes
The primary end point in Study IGBM was the percentage of CPs who successfully administered a complete dose of glucagon, defined as at least 90% of glucagon drug solution for the injectable glucagon kit and the device plunger being fully depressed for the intranasal glucagon device, and completed all critical steps for the administration. The critical steps for the intranasal device were removing the device from packaging (which included shrink-wrap); not testing before use; inserting the device tip into one of the mannequin’s nostrils; and pushing the plunger (keeping the tip inside the nostril) until the green line no longer showed. The critical steps for the injectable glucagon kit were removing the device from packaging; injecting the diluent from the syringe into the vial containing drug powder; ensuring the drug powder was dissolved (by shaking and/or swirling); drawing the dissolved drug into the syringe; and injecting the drug into the mannequin at an appropriate site for intramuscular administration (thigh, buttock, or upper arm). The percentage of APs who successfully administered a complete dose of glucagon was a secondary end point. No primary end point was defined in Study AMG111, though the percentages of CPs and APs successfully administering a full dose of glucagon were reported, as well as the percentages of CPs and APs administering a partial dose of injectable glucagon. Partial dose administration was not possible with intranasal glucagon because the actuation mechanism ensured the entire dose was expelled.
Time to complete administration, starting from when the participant found the glucagon device and ending when the dose was administered, was measured in both studies. In Study IGBM, the simulation timer was stopped when the participant administered a dose of glucagon or after 15 minutes had elapsed.
Device preference was assessed using questionnaires in both studies for CPs, APs, and PWDs. Participants and PWDs in Study IGBM rated strength of preference on a 5-point Likert scale for the respective items. In Study AMG111, PWDs were asked to indicate which device they preferred and CPs and APs were asked to indicate the preferred device, with an option for no preference. Satisfaction was also assessed in Study IGBM.
Statistical Analysis
▬▬▬▬▬
Sample size considerations were not described for Study IGBM. In Study AMG111, sample sizes were based on the expected numbers of CPs and APs needed for 95% power to detect a within-subject difference of at least 40 seconds (with a standard deviation of 40 seconds) in time to administer study drug (intranasal versus injectable glucagon) at a significance level of 0.05. However, the sample size of 16 for each cohort was not reached due to many of the CPs and APs not completing administration of glucagon for both devices.
Patient and Participant Disposition
▬▬▬▬▬ In Study AMG111, 19 dyads and 20 APs were recruited. Of these, two dyads withdrew for personal reasons, one CP did not attempt the emergency simulations, and five APs either did not show up to sessions or withdrew from the study.
Patient and Participant Disposition (Simulation Studies).
Efficacy
Drug Administration Success
Intranasal glucagon was consistently associated with higher rates of successful administration compared with injectable glucagon in CPs and APs in both studies (). In Study IGBM, a significantly greater percentage of CPs successfully administered intranasal glucagon versus injectable glucagon (90.3% versus 15.6%; P < 0.0001). In Study AMG111, a full dose was successfully administered by 94% of CPs for intranasal glucagon and 13% of CPs for injectable glucagon, while a partial dose of injectable glucagon was successfully administered by 38% of CPs.
Drug Administration Success and Time to Administer Study Drug (Simulation Studies).
In Study IGBM, 90.9% of APs successfully administered intranasal glucagon and no APs successfully administered a full or partial dose of injectable glucagon (). In Study AMG111, 93% of APs successfully administered intranasal glucagon, no APs successfully administered a full dose of injectable glucagon, and 20% of acquaintance patients successfully administered a partial dose of injectable glucagon.
In Study AMG111, partial rather than full doses of injectable glucagon were administered by some participants due to failure to draw up all the solution into the syringe and/or failure to entirely depress the plunger.
Time To Administer Study Drug
Time to administer study drug was assessed for all successful administrations of glucagon (including partial or full dose in Study AMG111). In Study IGBM, the median time for CPs to administer glucagon was 30 seconds (range of 10 to 237 seconds; N = 28) for intranasal glucagon and 73 seconds (range of 62 to 105 seconds; N = 5) for injectable glucagon (). In Study AMG111, the median time for CPs to administer glucagon was 12 seconds (range of 2 to 56 seconds; N = 15) for intranasal glucagon and 108 seconds (range of 78 to 165 seconds; N = 8) for injectable glucagon.
In Study IGBM, the median time for APs to administer intranasal glucagon was 29.5 seconds (range of 10 to 243 seconds; N = 30). In Study AMG111, the median time for APs to administer glucagon was 29 seconds (range of 10 to 47 seconds; N = 15) for intranasal glucagon and 120 seconds (range of 78 to 236 seconds; N = 3) for injectable glucagon.
Device Preference
In both studies, most CPs, PWDs, and APs expressed a preference for the intranasal glucagon device over the injectable glucagon kit (). In Study IGBM, 80.6% of CPs strongly preferred or preferred intranasal glucagon and 13.0% of CPs strongly preferred or preferred injectable glucagon. In terms of overall satisfaction, 74.2% of CPs strongly preferred or preferred intranasal glucagon and 9.7% preferred injectable glucagon. In Study AMG111, 87% of CPs preferred intranasal delivery of glucagon and 13% of CPs preferred needle-based delivery of glucagon for treating severe hypoglycemia.
Selected Results From the Preference Questionnaire (Study IGBM).
In Study IGBM, 90.3% of PWDs strongly preferred or preferred intranasal glucagon in terms of feeling safe during a severe hypoglycemic event and 6.5% strongly preferred injectable glucagon. In Study AMG111, 69% of PWDs preferred intranasal delivery of glucagon and 19% preferred needle-based delivery of glucagon for the treatment of severe hypoglycemia by a third party.
In Study IGBM, 93.5% of APs strongly preferred or preferred intranasal glucagon and 3.2% strongly preferred injectable glucagon. In terms of overall satisfaction, 87.1% of APs strongly preferred or preferred intranasal glucagon and 3.2% strongly preferred injectable glucagon. In Study AMG111, all APs indicated that they would recommend that PWDs carry intranasal glucagon for the APs to treat them with (as opposed to injectable glucagon or neither device).
Critical Appraisal
While the differences in administration success and time to administration were pronounced and consistent between intranasal and intramuscular delivery in both studies, the generalizability of the results to the Canadian population of potential glucagon users is less clear.
Internal Validity
Statistical testing of time to administer study drug in Study AMG111 was not performed because the planned sample size was not reached due to the low proportions of CPs and APs successfully administering glucagon with both devices. Interpretation of the results for time to administer study drug was limited in both studies due to low sample sizes.
In both studies, there were significant proportions of participants who did not complete the study after enrolment, and it is unclear whether there was any bias in the results from this.
There were notable differences between the two studies in time for drug administration which may be partly explained by differences in study design. Training of CPs was more thorough and mannequins were more realistic in Study IGBM. Planned distractions also differed between the studies. The clinical study report for Study IGBM specifically mentioned that intranasal glucagon was supplied in shrink-wrapped packages while there was no such description in the report for Study AMG111. If there was no shrink-wrap for the intranasal device in Study AMG111, this could explain the longer drug administration times in Study IGBM for intranasal glucagon.
External Validity
There are a number of issues that likely affect the generalizability of the success rates and administration times observed in the studies. A major limitation common to both studies is the fact that they were small, single-centre studies and they therefore do not reflect the potentially large amount of variation in caregiver and acquaintance ability to administer glucagon. In Study AMG111, none of the CPs or PWDs indicated during screening that they had owned a glucagon device or seen one. While this may resemble some Canadian patients with diabetes who should have glucagon but do not, it does not reflect the population of patients who receive the injectable glucagon that is currently available. As well, there were no pediatric PWDs in either study and it is likely that primary caregivers of pediatric patients would be more aware of glucagon injection technique and more experienced in administering subcutaneous insulin injections than caregivers of adult patients. Overall, there are likely to be caregivers in the greater population with more awareness of, and possibly experience with, glucagon administration than those included in the two mannequin studies.
It is difficult to predict to what degree the simulated nature of the hypoglycemic events impacted the differences between intranasal glucagon and injectable glucagon in terms of drug administration success rates, drug administration times, and device preference. CPs in the studies had recent training on the device and CPs and APs had advance knowledge of when they would have to respond to a hypoglycemic emergency. Therefore, participants were likely better prepared to administer glucagon in the simulations than caregivers or acquaintances would be in real life. As mentioned previously, caregivers of patients with diabetes who have not experienced severe hypoglycemia may not review the technique for administering injectable glucagon for years. According to the clinical expert consulted for this review, those administering glucagon during actual severe hypoglycemic events may experience greater stress than during the simulations, leading to more delays and errors in administration of glucagon. As well, glucagon would be much more challenging to administer in a patient having a tonic-clonic seizure or in a resistant patient (as described in one of the patient input submissions), which are situations that could not be replicated in the study mannequins. In the clinical expert’s opinion, intranasal glucagon would be easier to administer than intramuscular glucagon during a seizure.
Overall, it would appear that successful administration rates may be lower and administration times may be longer for both intranasal and injectable glucagon in real-life hypoglycemic events compared with the simulations. It is also possible that in at least some real-life events the differences between intranasal and injectable glucagon may be more pronounced than in the simulation studies. However, there is no evidence available comparing intranasal and injectable glucagon administration in real-life versus simulated severe hypoglycemic events.