Qualitative fit testing provides the ability to ensure acceptable fit of a sealing face mask such as an N95 or FFP3. Unfortunately, during the coronavirus disease 2019 (COVID-19) pandemic, a dramatic increase in the demand and use of protective equipment and fit testing equipment, coupled with severe supply shortages, has forced many institutions to abandon fit testing.Reference Campbell1
Fit is a primary factor in determining whether a mask is capable of reducing the spread and inhalation of fine particles. Previous studies have noted that, even if the materials of a mask have high filtration efficiency, the effectiveness of the mask is hampered by an imperfect seal. A study by Huff et al., using nebulized radioactive technetium, found that an ineffective seal is the principal cause of airborne contamination among those wearing respirators.Reference Huff, Horwitz and Klash2 This finding is supported by the findings of Cooper et al., who found that leakage around masks accounted for one-third of the airflow across the mask for surgical masks and one-sixth of the flow for respirators.Reference Cooper, Hinds and Price3
Qualitative testing is most commonly adopted to assess the fit of half-face respirators such as N95 and FPP3 masks4 as it is less expensive, more accessible, faster, and less demanding of staff time than the alternative of quantitative fit testing.4 Qualitative testing is widely used in hospitals, where a high throughput rate is critical for facility performance.5
Under normal circumstances, the equipment required for qualitative fit testing is affordable and accessible. The tests usually require 3 items: a wearable testing hood; a testing solution aerosolizer; and an aerosolized test solution. Unfortunately, disruption to supply chains and a surge in demand has limited their availability. Those seeking to purchase such equipment currently face out of stock notices or wait times, in the United States, of up to and over 8 wk.
Solving the fit testing supply crisis is critical to enable hospitals and businesses to properly protect their workers. Prior studies have already shown the feasibility of making a homemade fit testing solution.Reference Fakherpour, Jahangiri and Yousefinejad6,Reference Davies, Thompson and Giri7 This initial exploratory study aims to assess the effectiveness of alternatives to the mechanical elements of the qualitative fit test: the fit testing hood and nebulizer.
METHODS
Testing and Verification
Three testers underwent quantitative fit tests to assess the fit of the masks on their face before assessing qualitative fit methods. Quantitative fit testing, which measures the number of particles inside and outside of a face mask, is a highly accurate means of measuring fit and is more accurate than qualitative fit testing.Reference Fakherpour, Jahangiri and Yousefinejad6,Reference Hardis, Cadena and Carlson8 Results from the quantitative fit tests were used to determine what sensation (taste vs no taste) would be considered the correct response in the qualitative fit testing. Quantitative fit tests were conducted with a Portacount 8038+ using OSHA protocol 29CFR1910.134 and the settings that allow the testing of N95 masks.
One member of the team performed initial testing. Additional testers were brought in to confirm and assess promising devices. More information can be found in the online Supplemental Data.
Testing Solution
Fakherpour et al. and Mitchell et al. have developed effective sodium saccharin testing formulas which can easily be made at home.Reference Fakherpour, Jahangiri and Yousefinejad6,Reference Mitchell, Wells and McGregor9 Our formula was based on these studies. The testing solution consists of 830-mg sodium saccharin to 100-mL distilled water. Our sensitivity/threshold solution contained a sodium saccharin concentration between the threshold solution of Fakherpour et al. and Mitchel et al., using 415-mg sodium saccharin per 100 mL. A commercial fit test nebulizer was used to ensure each test subject could detect the saccharin solution.
Devices
Four devices were tested for their ability to replace the bulb nebulizer used for qualitative test kits. These included an ultrasonic mist maker (from AGPTEK, headquarters Guangdong, China), a spray bottle, a miniature wand humidifier (from JISULIFE, headquarters Guangdong, China), and an essential oil diffuser (from VicTsing, headquarters Sunnyvale, CA). Flow rate information was not available for the spray bottle or miniature humidifier. The mini humidifier by JISULIFE packaging stated a diffusion rate of 25-40 mL/h. The ultrasonic mist maker by AGPTEK claims to produce at least 400 mL/h.
Devices were run for 60 s, or in the case of the spray bottle, for up to 10 sprays. If no taste could be detected within that period, the test condition was judged as “no taste”.
Testing Enclosures
In qualitative testing, a hood with a small circular opening for ventilation and insertion of the squeeze nebulizer is used to concentrate the testing mist. Like the rest of the testing equipment, these hoods are expensive and, under these pandemic conditions, difficult to obtain. We tested 2 alternative testing enclosures to replace the hood: a clear storage cube measuring 11.81 inches square and a sturdy 2-gallon plastic bag. We also tested the devices with a commercial fit test hood. When testing the hood, which is designed for a horizontally discharging aerosolizing device, we used a piece of curved PVC fit to the hole in the testing hood to help direct the mist from the vertically discharging devices.
Mask
Two different masks were worn during testing, an N95 mask manufactured by 3M and a KN95 mask from a Chinese manufacturer.
To assess the ability of the device and enclosure to accurately predict fit issues, 5 tests were conducted in different fit states. Tests were performed with the unmodified N95 and KN95. The wearer then performed 3 additional tests with the N95 while intentionally causing a fit gap. For 1 test, they placed the tip of their finger between the mask and the skin beneath their eye, causing a gap in the nose area. For the other test, they placed the tip of their finger between the bottom of the mask and their chin area, causing a chin gap. Finally, they placed the tip of their finger between the cheeks and edge of the mask. These 3 tests enabled us to assess how well the testing setup could detect specific fit issues.
RESULTS
Aerosolization Devices
The testers were able to taste the sensitivity solution with 3 of the devices used (see Figure 1). The wand humidifier proved difficult to use and did not produce a clear taste sensation. The mist maker and spray bottle produced a taste sensation but had undesirable side effects such as causing the mask to become wet. The aroma diffuser produced accurate responses. The accuracy using this aroma diffuser was in line with the reported accuracy of commercial qualitative fit testing kits.Reference Fakherpour, Jahangiri and Yousefinejad6
FIGURE 1 A Chart of the Fit Test Results With Various Diffusers and Enclosures.
A checkmark indicates the correct response to the testing condition, while an x indicates an incorrect response to the test condition. Multiple members of the team tested the aroma diffuser, and their individual results are listed and factored into the accuracy ratings.
Testing Enclosures
Smaller testing enclosures allowed for faster detection of the testing solution in some, but not all, devices. The spray bottle did not function well in the hood and was unable to fit into the 2-gallon bag.
The smaller testing enclosures benefited both the accuracy and the detection speed when using the aroma diffuser and ultrasonic mist maker. The smallest enclosure, the plastic bag, produced the fewest inaccurate results and allowed for correct detection in the shortest period of time. Larger testing enclosures incurred greater inaccuracy and longer times to detection.
DISCUSSION
Summary of Key Findings
Our results indicate that qualitative fit testing can be conducted effectively using inexpensive homemade testing solutions and household testing devices. Moreover, a simple, quick, and easily replicated at-home or work setup may enable users to test for proper fit of sealing face masks (see Figure 2). We found that aroma diffusers and zipper storage bags were the most accurate alternatives to typical solution nebulizers and testing hoods, respectively. The degree of success, reliability, and ease of set up for our homemade testing apparatus exceeded our expectations and suggests that alternative testing enclosures and nebulizers may prove useful where conventional apparatus is unavailable or unaffordable. However, it must be emphasized that this research is preliminary. The method proposed is not National Institute for Occupational Safety and Health (NIOSH) compliant. We cannot be sure if this method of qualitative testing is as effective or safe as standard NIOSH testing methods using commercially available equipment. Repurposing equipment for qualitative fit testing may come with risks to the wearer. We advise anyone who intends to use this method to proceed with caution and at their own risk.
FIGURE 2 The Procedure Followed to Perform Qualitative Fit Testing With the Aroma Diffuser.
In step 1, the essential equipment was gathered. The required 830 mg of sodium saccharin proved to fill slightly less than ¼ tsp. In step 2, 100 mL of distilled water was mixed with ¼ tsp of sodium saccharin. Half of this mixture was separated and a further 50 mL of water added to make up the sensitivity solution. In step 3, the participant donned the enclosure and breathed as instructed in qualitative fit testing instructions, with the mouth partly open and tongue placed toward the front of the mouth. If the sensitivity solution could be tasted, the sensitivity test was passed. In step 4, the participant donned the mask and performed each fit test procedure for 60 s, taking breaks in between tests for additional safety.
Poorly Functioning Devices and Enclosures
We do not recommend the use of the spray bottle or the ultrasonic mist maker for fit testing as both made the mask visibly wet and consequently compromised the future use of the mask.
Our results indicate that humidifiers may not be fit for quantitative testing. While it is possible that the wand humidifier we tested provided an insufficient flow rate and that a more powerful humidifier might be adequate, it is likely that filters included with most humidifiers removed enough of the sodium saccharin to prevent the device from working as a fit testing device. The aroma diffuser was effective at testing masks without an enclosure but improved with a smaller space. Passing the aroma diffuser around the face so that the fog comes in contact with the mask improves the accuracy when no enclosure is used. The box we used provided little benefit over no enclosure. It was not small enough nor airtight enough to create a concentration of aerosolized sodium saccharin around the mask area. A smaller or more airtight box might be more effective.
Successful Devices and Enclosures
Commercial aroma diffusers proved highly effective in aerosolizing the testing solution.
Small enclosures, or those most similar to the conventional testing hood, produced the fastest and most accurate results when using an aroma diffuser.
If a testing hood is not available, we recommend using a robust freezer zipper storage bag with at least a 2-gallon capacity. A large freezer plastic bag, kept open and placed over the head, proved an inexpensive and highly effective option. Due to the possible risk of suffocation, it is vital that extra caution is taken while using a plastic bag in this manner. This type of enclosure should only be used by risk-aware adults who are able to quickly and safely maneuver the bag on and off. Only plastic bags with heavier structure, such as Ziplock freezer bags (from SC Johnson, headquarters in Racine, WI), should be used. Their more rigid form and heavy plastic zipper resists deforming and blocking the air flow, nose, or mouth. Bags should never be sealed around the neck. The entirety of the bottom of the bag should be left open to promote airflow. The weight and structure also help prevent the bag from becoming tangled with the testing equipment or closing around the tester’s neck. Light, poorly structured bags, such as plastic takeout or grocery bags, garbage bags, or product packaging bags should never, under any circumstances, be used as these bags have a higher chance of causing suffocation. Bags should always be large enough to provide at least 2 inches in front of the mask when worn. For safety, a second adult should be present and aware at all times the bag is worn and able to quickly remove the bag in case of any issue. Testing with any enclosure not approved for qualitative fit testing may be hazardous and is undertaken at the risk of the user.
CONCLUSIONS
Despite being less accurate than quantitative fit testing, qualitative testing remains a vital tool to ensure mask-wearers are protected by assessing mask fit. It is currently more important than ever that people have access to inexpensive fit-testing protocols so that they can protect themselves as well as others.
Our initial tests indicate that replacing the expensive test kit nebulizer with an aroma diffuser may be feasible. The accuracy of our tests were in line with, and often exceeded, the accuracy of qualitative fit tests performed with commercial solutions and equipment.Reference Fakherpour, Jahangiri and Yousefinejad6 This new qualitative testing method shows promise but requires additional research to ensure its effectiveness and safety. Given the growing risk the SARS-CoV-2 poses around the world, some may judge the potential risk of using this unproven testing method less severe than the risk of wearing a respirator whose poor fit does not protect the wearer. However, although the results presented in this study appear promising, the methods should not be interpreted as being a substitutable for conventional certified testing procedures and they must not be used in high-risk environments, such as health-care facilities. Future work is needed to assess the safety and efficacy of using alternative methods, as well as their ability to function with other testing solutions including bitter solutions and alterative testing solutions, such as aloe vera.Reference Fakherpour, Jahangiri and Yousefinejad10
Acknowledgments
We give special thanks to Dr Ming Jeffrey Kao, who introduced us to the problem that motivated this study. We also thank Corinne O’Kelly for making this research possible.
SUPPLEMENTARY MATERIAL
To view supplementary material for this article, please visit https://doi.org/10.1017/dmp.2020.352
Open access
