Reporting
The objectives and the main study outcomes of each of the four non-randomized studies were clearly defined, and the non-manual disinfection techniques being evaluated were specified.1,3,5,11 All the studies reported percentage reductions in the specific incidence of hospital-acquired infections they had pre-specified as outcome of interest. Although they also indicated degree of statistical significance with P-values, because the confidence intervals (CI) were not reported the level of certainty of the reported outcomes in these studies is unknown. However, one of the studies11 also reported rate ratios with corresponding 95% CI. Only two studies1,3 provided any information on patient characteristics, making it difficult to evaluate the potential for confounding. One study1 reported some demographic and medical conditions of the hospitalized patients before and during the intervention, and another study3 reported the demographic profile of NICU and high-risk cohort. One study3 reported procedure and outcome determination in sufficient detail to facilitate replicability. Another study5 reported trends in rates of antimicrobial and proton pump inhibitor (PPI) use, which are known to be risk factors for infections, in both the pre-intervention and the intervention phases of the study. Overall there was similarity between hospitalized patients groups in the two study periods, with respect to the use these medications.
External validity
Each of the non-randomized studies was conducted in a single hospital, or hospital department. This may limit the extent to which the findings of the study can be generalizable. The hospitals where each of the studies took place provided specialized services or had logistics and staff that may not be commonly found is other health care facilities.
The study that evaluated the pulsed xenon UVD11 took place in a tertiary care hospital that offers full services to adult and pediatric patients including specialized services for trauma, burn, neurosurgery, cardiothoracic surgery, transplant, and oncology. The broad scope of patients and services suggests commonality with many healthcare facilities. However, all pediatric rooms were single occupancy, while most adult patient rooms outside of the intensive care units were double occupancy. Patients with MDROs or C. difficile received care in a private room or semiprivate room with the other bed blocked from occupancy, or they may have been cohorted with another patient who harbored the same organism.11 It is reasonable to expect that such measures could contribute to minimizing dissemination of pathogens and spread of infection in the hospital. Thus, it is uncertain whether the same extent of success with UVD could be replicated in hospitals without sufficient room to allow this sort of occupancy arrangement.
One study1 was conducted in a severe head injury long-term care ward and it is unclear whether its findings would be generalizable to other health care settings. One study3 was conducted in the NICU of a university-affiliated regional perinatal center, and the study benefited from environmental sample collection services provided by a research-based company. Another study5 was conducted in a university-affiliated hospital and focused on a particular strain of C. difficile which has enhanced virulence properties – the North American pulsed-field (NAPI) strain. Therefore, the generalizability of findings of these studies is unknown.
Internal validity
The adequacy of sample sizes to detect differences in effect of the interventions was not discussed in any of the studies. However, the non-manual room disinfection methods were used over at least 6 months and/or repeatedly for many cycles to allow sufficient data to be collected for analysis. The pre- and post-intervention comparisons used by all the non-randomized studies1,3,5,11 are subject to possible clinical care and/or environmental changes over time, and there is no way of evaluating the extent to which such variations, if they occurred, influenced the reported outcomes of the studies. In all the studies,1,3,5,11 it was not reported whether or not cleaning staff were aware of the use of the non-manual room disinfection procedures. It is reasonable to expect that knowledge of the investigation could influence behavioral change among housekeeping staff to increased or decreased intensity of cleaning which could impact the outcomes of the studies.
In one study,11 the UVD system was used a high number of times (11,389 times) following discharge cleaning of contact precautions rooms and other high-risk area during the study period. This reduced the probability that the results were due to chance, although the study was conducted in a single institution. However, in this study,11 the UVD was used exclusively at a setting recommended to inactivate C. difficile spores which is higher than the setting require for vegetative forms of C. difficile. Thus, we are unable to tell how effective the UVD would be against vegetative form of C. difficile using the appropriate recommended setting. However, this may not be problematic since disinfection against the transmission C. difficile associated disease usually targets both the spores and vegetative forms. Although there were several initiatives to optimize environmental disinfection during both the UVD and pre-intervention periods of the study,11 they were not adjusted for in the analysis despite being potential confounding factors. On the other hand, although investigators indicated the use of a more sensitive diagnostic test (a change from C. difficile cytotoxin A + B enzyme immunoassay to polymerase chain reaction) increased overall test positivity from 10% to 13% during the study,11
C. difficile infection rates decreased during UVD which supports the effectiveness of the intervention for this purpose.
In another study,1 data from parallel periods before and after the intervention were analyzed using rigorous statistical methods to compare the differences between the two populations in terms of patient medical characteristics, treatments, and nosocomial infections.1 The period before the non-manual room disinfection was introduced had more patients with pressure sores or who were using steroidal treatments. Pressure sores may suggest very ill patients on admission for a prolonged period, who may be more susceptible to infection by reason of longer exposure and/or reduced immunity. Steroid use has also been liked to reduced immunity and infections. However, the effect of possible potential cofounders, such as patient age, gender, mobility, presence of sores, steroid administration, tracheostomy, urinary catheter, and inhalation treatments, on the differences found in fever days, use of antibiotics, and rates of hospital-acquired infections, was analyzed and accounted for using multivariate analysis of covariance (ANCOVA). According to the authors, the study was designed to use parallel periods to minimize seasonal variations between the study periods. However, no mechanisms were described to show how variations would be detected if they occurred. Thus, it is unknown if seasonal changes affected the reported outcomes and to what extent. Furthermore, although the study used data from two 6-month parallel periods, the number of patients who were hospitalized before and during the intervention was relatively low (57 and 51, respectively). It is therefore, uncertain whether the sample size was enough to detect clinically relevant differences between the two periods.
In one of the studies,3 the periods before and after intervention were neither parallel or equal in length. Data was collected for the 6-month period before the installation of the non-manual room disinfection intervention, and for four 6-month periods after the intervention was installed. Therefore, although the data from the duration of the intervention show reduced VAP gains compared to the 6 months before the intervention, the influence of seasonal variations and changes in clinical care over time on the reported findings cannot be ruled out.
In another study,5 the incidence of nosocomial CDAD was investigated hospital-wide and in five high-incidence wards before and after HPV decontamination. Patient groups hospitalized during the two study periods had similar levels of treatment with antibiotics and PPIs (both of which are known to be risk factors for C. difficile transmission) without statistically significant differences which could influence the reported HAIs. Although an analysis to examine the effects of antimicrobial medication and PPI use on outcomes was done, details about patient characteristics, medical history and other potential confounding factors were not provided. To distinguish between patients with hospital-acquired CDAD and patients who were infected before hospital admission, nosocomial CDAD case diagnosis was limited to patients with a positive C. difficile toxin test result for a test obtained more than 72 hours after admission.