Hostname: page-component-78c5997874-fbnjt Total loading time: 0 Render date: 2024-11-03T02:41:34.380Z Has data issue: false hasContentIssue false

Healthcare staff perceptions of an electronic hand hygiene monitoring system within a large university system

Published online by Cambridge University Press:  26 July 2024

Rachel Elliott
Affiliation:
Department of Public Health and Preventive Medicine, State University of New York Upstate Medical University, Syracuse, NY, USA
Emina Fetibegovic
Affiliation:
Department of Public Health and Preventive Medicine, State University of New York Upstate Medical University, Syracuse, NY, USA
Julie Briggs
Affiliation:
Department of Patient Safety and Quality, State University of New York Upstate Medical University, Syracuse, NY, USA
Jana Shaw
Affiliation:
Department of Pediatrics, Department of Public Health and Preventive Medicine, State University of New York Upstate Medical University, Syracuse, NY, USA
Paul Suits
Affiliation:
Department of Infection Prevention, State University of New York Upstate Medical University, Syracuse, NY, USA
Roger Wong
Affiliation:
Department of Public Health and Preventive Medicine, State University of New York Upstate Medical University, Syracuse, NY, USA
Telisa Stewart*
Affiliation:
Department of Public Health and Preventive Medicine, State University of New York Upstate Medical University, Syracuse, NY, USA
*
Corresponding author: Telisa Stewart; Email: [email protected]

Abstract

Objective:

The acceptability of an electronic HH monitoring system (EHHMS) was evaluated among hospital staff members.

Design:

An electronic HH monitoring system was implemented in June 2020 at a large, academic medical center. An interdisciplinary team developed a cross-sectional survey to gather staff perceptions of the EHHMS.

Setting:

The survey was conducted at a public, tertiary acute care hospital.

Participants:

The survey included current employees and staff. 1,273 participants responded. The mean age was 44.9 years (SD = 13.5). Most of the samples were female (71%) and non-Hispanic white (83%).

Methods:

A survey was conducted between June and July 2021. Responses were analyzed using Stata statistical software. Multiple logistic regression models were constructed to examine factors associated with negative perceptions of the EHHMS and its radiofrequency identification (RFID) badge. Supporting qualitative analyses were performed using Atlas.ti version 9.

Results:

Three-quarters (75%) of respondents reported neutral to negative perceptions of the EHHMS and its associated badge. Respondents reported limited influence on HH practices. Age, campus location, length of employment, job role, and opinion on data sharing were associated with negative perceptions of the EHHMS and RFID badge. Position in a direct patient care role was associated with negative perceptions of the RFID badge.

Conclusions:

Perceptions of the EHHMS aligned with previous research. Identified associations provide opportunities for targeted education, outreach, and intervention to increase acceptability and uptake. Lack of acceptance is explained by poorly perceived ease of use and usefulness, as well as challenges in implementation.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

Introduction

Hand hygiene (HH) is accepted as the primary mechanism to reduce the spread of hospital-acquired infections. Reference Haque, McKimm and Sartelli13 Although the behavior of hand washing is well-supported by clinical research, compliance among healthcare workers has remained low. Reference Ragusa, Marranzano, Lombardo, Quattrocchi, Bellia and Lupo4Reference Laher, van Rooyen, Jawa, Enyuma and Swartzberg6 To obtain accurate measures of HH compliance, hospitals have turned to electronic HH monitoring systems (EHHMS). The acceptability of EHHMS is an ongoing topic of investigation. Reference Dyson and Madeo7Reference Druckerman, Appelbaum and Armstrong-Novak11

The EHHMS was implemented across the institution in 2020. The institution operates 2 hospital campuses; campus A is a large academic teaching hospital and level 1 trauma center with 438 certified beds. Hospital campus B is a community-based hospital with 314 certified beds. The EHHMS is used to monitor HH compliance and complete contact tracing. The system calculates HH compliance in rooms defined as patient space by plug-in sensors. Designated hospital staff are required to wear a personally identifiable radiofrequency identification (RFID) badge that interfaces with soap and alcohol-based hand rub dispensers to detect if HH is performed. HH is expected on entry and exit from patient spaces. The RFID badge is distinct from staff identification badges and weighs 27 g.

Infection prevention and the quality department were selected to manage the EHHMS. Devices were installed on all inpatient units, excluding psychiatric units, by the technology parent company. Devices were installed in emergency departments for contact tracing purposes only. HCW badges were distributed by employee supervisors. Only infection prevention, unit managers, and employee supervisors were granted access to the performance dashboard. The system does not provide immediate feedback on HH performance.

The purpose of the current mixed-methods study was to gauge staff acceptance of the EHHMS 1 year after implementation. We conducted an institution-wide survey to determine factors associated with negative perceptions of the EHHMS. There are few similar studies assessing staff perceptions of EHHMS at this scale, especially during the coronavirus disease 2019 (COVID-19) pandemic. The identification of personal and population characteristics associated with negative perceptions of EHHMS offers opportunities for targeted intervention to improve uptake among hospital staff.

Methods

A voluntary survey was conducted between June 14 and July 30, 2021, to assess employee’s knowledge and attitudes surrounding the EHHMS. The survey was distributed to all staff electronically (REDCap), and paper copies were provided to employees of departments who did not access the computer network. No incentives were offered for participation.

The survey consisted of 33 questions including demographic information, multiple choice, and written response questions divided into 2 sections: (1) general HH practices and (2) use and perceptions of the EHHMS. Incomplete survey responses were excluded from the analysis.

Quantitative responses were analyzed using REDCap web features and Stata statistical software version 16 with 2-tailed tests and a 0.05 significance level. Specifically, 2 separate multiple logistic regression models were constructed to examine factors associated with negative perceptions of the EHHMS and negative perceptions of wearing the system’s RFID badge; responses were collected using a 5-point Likert scale.

Supporting qualitative analysis was performed using Atlas.ti version 9. Investigators (RE, EF, TS) independently reviewed and coded participant responses. Emerging themes were identified. One hundred percent intercoder agreement was achieved.

This project was reviewed by the Upstate Medical University Institutional Review Board (IRB). The IRB determined it did not meet the definition of human subject research under project number 1775739-1.

Results

A total of 2,087 survey responses were received. Eight hundred fourteen incomplete responses were excluded from the analysis (n = 1,273). The survey response rate was 13.5% based on the total number of employees within the institution at the time of the survey. 12

Characteristics of survey respondents

The mean age of respondents was 44.9 years (SD = 13.5). Most of the sample were female (71%) and non-Hispanic white (83%). A total of 679 respondents (53%) reported they provide direct patient care. Most respondents were registered nurses (24%), ancillary support staff (23%), administration and management (14%), and scientists or physicians (10%). Additional demographic information is presented in Table 1.

Table 1. Sociodemographic and employment characteristics of survey respondents

General HH practices

Most respondents (77%) reported performing HH at all appropriate times. Overall, staff were confident in their HH skills (98%) and felt that HH was very important (99%). The majority (86%) reported being extremely well-informed about the institution’s HH policies. Respondents were asked how HH fits into their daily work routine; over half (59%) reported HH fit extremely well.

Electronic HH monitoring system (EHHMS)

Half of the included respondents worked in a unit or department where the electronic monitoring system was used (n = 632). The RFID badge was worn by 46% of total respondents for at least some of their working hours (n = 584). Familiarity with the system was limited (38% good; 21% moderate; 41% little). Most respondents who reported not wearing an RFID badge worked in excluded units or departments or nonhospital settings. Those working in units or departments that used the system, who elected not to wear the badge, reported that the badge was too heavy (4%), disrupted their workflow (3%), or was not a part of their daily routine (16%).

Staff perceptions of the system (EHHMS) and of wearing the RFID badge

Respondents who worked in a unit or department that utilized the system or wore a badge for at least some of their working hours (n = 669) expressed neutral (38%) to negative (37%) sentiments toward the system. The same was true for respondents’ sentiments toward wearing the RFID badge. Nearly half (48%) did not feel the system captured HH events accurately. Respondents were concerned about the impact of system error, user error, use of dispensers without EHHMS sensors, and additional time and effort required to ensure accurate data capture.

HH feedback and system impact

Most respondents who worked in a unit or department that used the system or wore a badge for at least some of their working hours reported it had little to no influence on their HH habits (54%). There was a strong desire to better understand how EHHMS data was used by the institution. Respondents reported neutral opinions about individual HH data being shared with colleagues.

Less than half of those who worked in a unit or department that used the EHHMS had received feedback on their HH performance from their manager or supervisor (43%). Supporting qualitative analysis among those who received feedback on their EHHMS HH performance indicated that the system brought HH to the forefront of thought processes and conversations, created positive and negative behavior changes, generated negative feelings, and caused concerns about data accuracy.

System strengths and weaknesses

Respondents who worked in a unit or department that utilized the system or who wore a badge for at least some of their working hours were asked to identify the strengths and weaknesses of the EHHMS. Four hundred nine responses were received to a question about the strengths of the EHHMS. Sixteen responses were removed because they were not codable (n = 393). Strengths identified included infectious disease control and contact tracing abilities (9.4%), as well as documentation (8.7%), accountability (7.9%), and prompts (6.1%) for HH practice. Many perceived that the system increased the mindfulness of HH (27%) (Table 2).

Table 2. Perceived strengths of the electronic HH monitoring system as reported by survey respondents

Note. HH, hand hygiene.

Four hundred thirty-eight participants responded when asked about the weaknesses of the EHHMS. Twenty-six responses were removed because they were not codable (n = 412). The main system weakness identified was the perceived inaccuracy of data (37.4%). Other weaknesses included the potential to monitor staff location (12.9%) and technological problems with the RFID badge (12.4%). The presence of inactive or broken sensors was identified as a system limitation (10.4%). Some participants felt the system generated negative behaviors and feelings, and staff expressed interest in improved feedback and resource allocation decisions (Table 3).

Table 3. Perceived weaknesses of the electronic HH monitoring system as reported by survey respondents

Note. HH, hand hygiene; RFID, radiofrequency identification.

Factors associated with negative perceptions of the EHHMS

A multiple logistic regression model was constructed to determine factors associated with negative perceptions of the EHHMS among those who worked in a unit or department that utilized the EHHMS (n = 577). Respondents of older age had more positive perceptions of the EHHMS than those who were younger (OR = .95, 95% CI .92, .97, P < .001). Other major demographic characteristics were not significantly associated with system perceptions (Table 4).

Table 4. Multiple logistic regression results for factors associated with negative perceptions of the EHHM system

Note. EHHM, electronic HH monitoring; OR, odds ratio; CI; confidence interval; HH, hand hygiene.

Individuals working at campus B had significantly greater odds of having a negative perception of the EHHMS than those who worked primarily at campus A (OR = 2.72, 95% CI 1.65, 4.47, P < .01). Job role was strongly associated, especially among individuals employed in roles outside of administration and management. Registered nurses (OR = 16.80, 95% CI 2.02, 139.93, P = .01), scientists and physicians (OR = 16.17, 95%CI 1.69, 154.55, P = .02), and masters’ level clinicians (OR = 11.40, 95% CI 1.27, 102.12, P = .03) had the greatest odds of expressing negative perceptions of the EHHMS. In addition, those who reported employment at the institution for greater than 1 year had much higher odds of negative perceptions than those employed for less than 1 year (Table 4).

To assess the contribution of HH knowledge and familiarity with institutional policy, these factors were included in the multiple logistic regression model. Compared with those who were not familiar with the institution’s HH policies, the odds of negative perceptions were significantly greater among those who were familiar with the policies (OR = 1.93, 95% CI 1.21, 3.08, P = .02). Opinion of data sharing was included as well. Those who expressed more positive opinions about individual HH data being shared with colleagues had lower odds of perceiving the system negatively than those who were strongly against the sharing of data (Table 4).

Factors associated with negative perceptions of wearing the EHHMS RFID badge

A second multiple logistic regression model was constructed to determine factors associated with negative perceptions of wearing the EHHMS RFID badge. This analysis included only those who reported wearing a badge for at least some of their working hours (n = 542). Self-identification of race as ‘Other’ was significantly associated with negative perceptions of wearing the badge (OR = 6.82, 95% CI 1.29, 36.04, P = .02). The remaining demographic results were similar to those reported above for system perceptions; older respondents remained more likely to perceive the system positively than younger respondents (OR = .97, 95% CI .95, .10, P = .02).

Job role and primary work location were associated with negative perceptions of wearing the RFID badge as well. Respondents working at campus B had nearly 2 times the odds of perceiving badge wearing negatively, compared with those working primarily at campus A (OR = 1.88, 95% CI 1.15, 3.05, P = .01). Those employed as registered nurses, scientists or physicians, and masters’ level clinicians continued to have the greatest odds of negative perceptions (Table 5). The odds of negative badge perceptions also increased with longer terms of employment; odds were greatest among those employed between 6 and 10 years (OR = 4.55, 95% CI 2.05, 10.06, P < .001) and those employed greater than 10 years (OR = 3.63, 95% CI 1.58, 8.35, P < .001). Respondents with negative perceptions of data sharing were also more likely to have negative perceptions of wearing the RFID badge, compared to those who reported neutral (OR = .32, 95% CI .16, .62, P = .001), positive (OR=.05, 95% CI .12, .17, P < .001), or very positive (OR = .02, 95% CI .00, .21, P = 0.001) opinions on sharing of HH compliance with colleagues.

Table 5. Multiple logistic regression results for factors associated with negative perceptions of wearing the EHHM RFID badge

Note. EHHM, electronic HH monitoring; RFID, radiofrequency identification; OR, odds ratio; CI; confidence interval; HH, hand hygiene.

Provision of direct patient care was also included in the badge-wearing model because all currently badged employees are heavily integrated into the patient environment. Notably, the odds of a negative perception of wearing the RFID badge were nearly 3 times greater among those who reported providing direct patient care (OR = 2.67, 1.28, 5.52, P = .01).

Supporting staff who use the EHHMS

Feedback was collected at the conclusion of the survey on how the institution could better support staff whose unit or department utilizes the EHHMS. Responses focused on improving system function and accuracy, improving communication, or removing the system all together. Technological improvements, improved accuracy, open acknowledgment of system limitations, and improving access to data were discussed in open-ended responses. It was also reported that providing generalized support to staff would support the use of the EHHMS.

Discussion

Staff perceptions of the system (EHHMS) and staff perceptions of wearing the RFID badge indicate that there is room for improvement in the acceptance of the EHHMS. The neutral and negative opinions reported echo existing literature on EHHMS. Reference Ellingson, Polgreen and Schneider9,Reference McKinley, Phillips, Stampfli, Matteson and Crnich10 The concerns and weaknesses identified by hospital staff align with those previously described. Reference Dyson and Madeo7,Reference Boscart and Holliday8,Reference Al Salman, Hani, de Marcellis-Warin and Fatima Isa13 Overall, lower levels of acceptance are likely a result of challenges faced while implementing the EHHMS at the height of the COVID-19 pandemic.

The institution’s intent was to implement the system quickly, with minimal disruption to staff, while providing a basic understanding of EHHMS and ensuring compliance with established HH protocols. Respondent’s limited familiarity with the system indicates that this basic understanding was not widely accomplished prior to system installation. This provided a breeding ground for the establishment of negative perceptions and behaviors. Without a thorough understanding of the EHHMS function and how data was utilized by the institution, some staff opted to forego wearing the RFID badge. Staff also adopted negative behaviors associated with the EHHMS, including the removal and relocation of sensors defining patient space. These factors reduced data capture abilities and affected system accuracy. Increased communication and improved education during the pre-implementation and implementation periods would likely have decreased the establishment and tenacity of negative perceptions among staff. Reference Al Salman, Hani, de Marcellis-Warin and Fatima Isa13Reference Knepper, Miller and Young15

Based on our results, we hypothesize that acceptance of EHHMS aligns with the technology acceptance model. Reference Tsai, Lin, Chang, Change and Lee16 In our sample, variables separate from the EHHMS, including demographic and employment characteristics (ie, age, job role, length of employment), influenced staff perceptions of how useful the system was. Early challenges with system management negatively influenced perceived ease of use. This bolstered initial negative attitudes toward EHHMS and further reduced system use and acceptance. This model helps to account for the variation observed in negative perception by job role, as those in leadership and management may be more likely to perceive administrative benefits of using EHHMS. Leaders and managers also have less frequent daily interactions with the EHHMS, reducing the burden of behavior change compared to staff providing direct patient care.

Further investigation is needed to determine the best methods to address negative perceptions of EHHMS; however, our analyses offer a unique identification of factors associated with EHHMS technology acceptance. Negative behaviors and concerns reported by respondents identify opportunities for targeted outreach, education, and intervention that the institution plans to operationalize. Data acquired as part of this assessment is likely useful in the development of behavioral interventions to address perceptions and use of EHHMS, as well as in the identification of high-priority groups to be addressed during future implementation efforts.

This assessment does have several limitations. First, only 46% of respondents reported actively wearing an RFID badge for at least some of their working hours. This was addressed by constructing individual multiple logistic regression models among appropriate subpopulations; however, responses from those working outside of areas with the EHHMS may have influenced levels of overall awareness and knowledge. The use of a convenience sample may also introduce self-selection and nonresponse bias. We believe this stems from several factors, including increased participation among those with particularly negative perceptions of the EHHMS and increased likelihood of participation from staff highly motivated to increase HH compliance, who are more likely to participate in a monitoring program. Generalizability of the assessment is limited secondary to the large, university setting in which data was collected as well; results may not be applicable to differing environments or staff populations. Lastly, further validation of the associations discovered with age, race, job role and location, term of employment, policy knowledge, opinion of data sharing, and provision of direct patient care is required to support the novel conclusions reached.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/ash.2024.76.

Acknowledgments

None reported.

Author contribution

None reported.

Financial support

None reported.

Competing interests

All authors report no conflicts of interest relevant to this article.

Research transparency and reproducibility

Data is not publicly available.

Footnotes

This material was presented in a poster session at the Society for Healthcare Epidemiology of America Spring 2022 in Colorado Springs, CO. The associated abstract is available through ASHE (DOI: 10.1017/ash.2022.146).

References

Haque, M, McKimm, J, Sartelli, M, et al. Strategies to prevent healthcare-associated infections: a narrative overview. Risk Manag Healthc Policy 2020; 13:17651780. doi: 10.2147/RMHP.S269315 CrossRefGoogle ScholarPubMed
Centers for Disease Control and Prevention. Guideline for Hand Hygiene in Health-Care Settings: Recommendations of the Healthcare Infection Control Practices Advisory Committee and the HICPAC/SHEA/APIC/IDSA Hand Hygiene Task Force. Vol 51; 2002.Google Scholar
World Health Organization. WHO Guidelines on Hand Hygiene in Health Care: First Global Patient Safety Challenge Clean Care Is Safer Care. World Health Organization; 2009.Google Scholar
Ragusa, R, Marranzano, M, Lombardo, A, Quattrocchi, R, Bellia, MA, Lupo, L. Has the covid 19 virus changed adherence to hand washing among healthcare workers? Behav Sci 2021;11:53. doi:10.3390/bs11040053 CrossRefGoogle ScholarPubMed
Musu, M, Lai, A, Mereu, NM, et al. Assessing hand hygiene compliance among healthcare workers in six Intensive Care Units. J Prev Med Hyg 2017;58:E231E237. https://pubmed.ncbi.nlm.nih.gov/29123370 Google ScholarPubMed
Laher, AE, van Rooyen, LR, Jawa, A, Enyuma, CO, Swartzberg, KM. Compliance with hygiene practices among healthcare workers at an academic hospital emergency department. Afr J Emerg Med 2021;11: 352355. doi:10.1016/j.afjem.2021.05.002 CrossRefGoogle ScholarPubMed
Dyson, J, Madeo, M. Investigating the use of an electronic hand hygiene monitoring and prompt device: influence and acceptability. J Infect Prev 2017;18:278. doi:10.1177/1757177417714045 CrossRefGoogle ScholarPubMed
Boscart, VM, Holliday, PJ. Acceptability of a wearable hand wash device with monitoring capabilities System integration for chronic disease and frailty management View project We-Thrive View project. J. Hosp Infect 2008; 70:216222. doi:10.1016/j.jhin.2008.07.008 CrossRefGoogle Scholar
Ellingson, K, Polgreen, PM, Schneider, A, et al. Healthcare personnel perceptions of hand hygiene monitoring technology. Infect Control Hosp Epidemiol 2011;32:10911096. doi: 10.1086/662179 CrossRefGoogle ScholarPubMed
McKinley, L, Phillips, L, Stampfli, C, Matteson, K, Crnich, C. 463. Healthcare Workers Perceptions Regarding the Use of an Electronic Hand Hygiene Monitoring System at a VA Hospital. Open Forum Infect Dis 2018;5:S174S174. doi:10.1093/ofid/ofy210.472 CrossRefGoogle Scholar
Druckerman, DG, Appelbaum, N, Armstrong-Novak, JD, et al. Healthcare worker perceptions of hand hygiene monitoring technologies: Does technology performance matter? Infect Control Hosp Epidemiol 2021;42:15191520. doi:10.1017/ice.2021.286 CrossRefGoogle ScholarPubMed
SUNY Upstate Medical University. About upstate, 2023. https://www.upstate.edu/about/index.php.Google Scholar
Al Salman, JM, Hani, S, de Marcellis-Warin, N, Fatima Isa, S. Effectiveness of an electronic hand hygiene monitoring system on healthcare workers’ compliance to guidelines. J Infect Public Health 2015;8:117126. https://doi.org/10.1016/j.jiph.2014.07.019 CrossRefGoogle ScholarPubMed
McMullen, K, Diesel, G, Gibbs, E, et al. Implementation of an electronic hand hygiene monitoring system: Learnings on how to maximize the investment. Am J Infect Control 2023;51:847851.CrossRefGoogle ScholarPubMed
Knepper, BC, Miller, AM, Young, HL. Impact of an automated hand hygiene monitoring system combined with a performance improvement intervention on hospital-acquired infections. Infect Control Hosp Epidemiol 2020;41:931937. https://doi.org/10.1017/ice.2020.182 CrossRefGoogle ScholarPubMed
Tsai, TH, Lin, WY, Chang, YS, Change, PC, Lee, MY. Technology anxiety and resistance to change behavioral study of a wearable cardiac warning system using an extended TAM for older adults. PLoS One 2020;15:e0227270.CrossRefGoogle Scholar
Figure 0

Table 1. Sociodemographic and employment characteristics of survey respondents

Figure 1

Table 2. Perceived strengths of the electronic HH monitoring system as reported by survey respondents

Figure 2

Table 3. Perceived weaknesses of the electronic HH monitoring system as reported by survey respondents

Figure 3

Table 4. Multiple logistic regression results for factors associated with negative perceptions of the EHHM system

Figure 4

Table 5. Multiple logistic regression results for factors associated with negative perceptions of wearing the EHHM RFID badge

Supplementary material: File

Elliott et al. supplementary material

Elliott et al. supplementary material
Download Elliott et al. supplementary material(File)
File 102 KB