Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-23T05:09:56.821Z Has data issue: false hasContentIssue false

Recruitment strategies and retention rates for five National Dental PBRN studies

Published online by Cambridge University Press:  22 March 2024

Rahma Mungia*
Affiliation:
Department of Periodontics, School of Dentistry, The University of Texas Health San Antonio, San Antonio, TX, USA
Ellen Funkhouser
Affiliation:
Division of Preventive Medicine, School of Medicine, University of Alabama at Birmingham, Birmingham, AL, USA
David L. Cochran
Affiliation:
Department of Periodontics, School of Dentistry, The University of Texas Health San Antonio, San Antonio, TX, USA
Joana Cunha-Cruz
Affiliation:
Department of Clinical and Community Sciences, School of Dentistry, University of Alabama at Birmingham, Birmingham, AL, USA
Valeria V. Gordan
Affiliation:
Director of Practice-based Research and Associate Dean for Research, University of Florida, College of Dentistry, Gainesville, FL, USA
Donald B. Rindal
Affiliation:
Associate Dental Director for Research, HealthPartners Dental Group, HealthPartners Institute, Minneapolis, MN, USA
Cyril Meyerowitz
Affiliation:
Eastman Institute for Oral Health, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
Veerasathpurush Allareddy
Affiliation:
Brodie Craniofacial Endowed Chair, and Head of Department of Orthodontics, University of Illinois Chicago College of Dentistry, Chicago, IL, USA
Jeffrey L. Fellows
Affiliation:
Kaiser Permanente Center for Health Research, Portland, OR, USA
Gregg H. Gilbert
Affiliation:
Department of Clinical & Community Sciences, Distinguished Professor and the James R. Rosen Chair of Dental Research Chair, School of Dentistry, University of Alabama at Birmingham, Birmingham, AL, USA
*
Corresponding author: Rahma. Mungia, BDS, MSc, DDPHRCS, Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background:

We describe a retrospective assessment of practitioner and patient recruitment strategies, patient retention strategies, and rates for five clinical studies conducted in the National Dental Practice-Based Research Network between 2012 and 2019, and practitioner and patient characteristics associated with retention.

Methods:

Similar recruitment strategies were adopted in the studies. The characteristics of the practitioners and patients are described. The proportion of patients who either attended a follow-up (FU) assessment or completed an online assessment was calculated. For studies with multiple FU visits or questionnaire assessments, rates for completing each FU were calculated, as were the rates for completing any and for completing all FU assessments. The associations of practitioner and patient characteristics with all clinic FU visits, and with the completion of all assessments for a study were ascertained.

Results:

Overall, 591 practitioners and 12,159 patients were included. FU rates by patients for any assessment varied from 91% to 96.5%, and rates for participating in all assessments ranged from 68% to 87%. The mean total number of patients each practitioner recruited was 21 (sd = 15); the mean number per study was 13 (sd = 7). For practitioners, practice type and patient enrollment were associated with greater clinic retention, while only race was associated with their patients completing post-visit online assessments. For patients, age was associated with clinic retention, while female gender, age, race, and education were all associated with greater completion of post-visit online assessments.

Conclusion:

The Network efficiently recruited practitioners and patients and achieved high patient retention rates for the five studies.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of Association for Clinical and Translational Science

Introduction

Recruiting and retaining community-based clinicians and patient participants in clinical research are critical challenges that can cause long delays to a clinical study, shorten the study intervention’s duration, or require additional funds [Reference Adams, Steel, Moore, Amorin-Woods and Sibbritt1Reference Spears, Tsoh and Potter5]. High retention is important in evaluating any longitudinal study. Poor retention leads to questions of validity. Even small differences in retention in the outcome of interest can bias the findings of a study [Reference Dumville, Torgerson and Hewitt6Reference Walsh, Devereaux and Sackett8]. Reviews of retention strategies [Reference Abshire, Dinglas, Cajita, Eakin, Needham and Himmelfarb9Reference Robinson, Dinglas and Sukrithan11] show that the more retention strategies employed, the better the retention. Incentives, both monetary and nonmonetary, improve retention the most consistently; reminder calls and letters also consistently improve retention, but to a lesser degree [Reference Abshire, Dinglas, Cajita, Eakin, Needham and Himmelfarb9].

Practice-based research networks (PBRNs) accelerate science and support the translation of research into routine clinical practice [Reference Westfall, Mold and Fagnan12]. However, PBRNs have constraints not faced in other research settings; specifically, studies can only require a modest amount of the patients’ and practitioners’ time and cannot unduly disrupt patient flow [Reference Loskutova, Smail, Ajayi, Pace and Fox13Reference Mungia, Funkhouser and Makhija15]. The National Dental PBRN Network (Network) has operated since 2005 and was integrated as a fully national Network in 2012; the Network is funded through the National Institutes of Health [Reference Gilbert, Fellows and Allareddy16]. The goal of the Network has been to enroll a broad range of practitioners and practice types to optimize generalizability [Reference Mungia, Funkhouser and Buchberg Trejo14Reference Gilbert, Fellows and Allareddy16]. It has achieved this by developing a robust National infrastructure to support high rates of sustained participation among enrolled members [Reference Mungia, Funkhouser and Buchberg Trejo14Reference Gilbert, Fellows and Allareddy16].

The Network has adopted a broad range of approaches to recruit practitioners into the Network and its studies, including tailoring recruitment materials, advertising in Network and Association newsletters, postal and electronic mailing utilizing state licensing board member lists, snowballing (existing network members reach out to prospective members), conducting informational outreach events such as hosting informational webinars, seminars, symposiums, and exhibit booths at conferences, Quick Polls (short surveys) and contacting clinical and research leaders of societies, associations, and organizations [Reference Mungia, Funkhouser and Makhija15]. Furthermore, the Network has also used various activities to engage practitioner members. These include providing continuing education credits for attending study training, webinars, seminars, symposiums, and annual meetings, engaging in presentations, publications, and Quick Polls [Reference Mungia, Funkhouser and Makhija15]. These activities effectively sustained a high level of practitioner engagement in clinical research and its relevance to everyday clinical practice [Reference Mungia, Funkhouser and Makhija15].

The structure of the Network has been described for the 2012–2019 period [Reference Gilbert, Williams and Korelitz17]. Briefly, the central administrative base is at the University of Alabama at Birmingham. The Coordinating Center (CC), based at Westat in Rockville, MD, provided expertise in study design and statistical support and developed and maintained databases. The network comprises six geographic regions, each with a regional director and coordinator (RC) for administrative purposes. The RCs provide context about office flow, operations, and conducting a study in a busy dental practice venue. They coordinate recruitment by gauging practitioner interest in the study. They also help standardize activities (training, data collection, practice monitoring, and study closeout) and communication across regions. Most importantly, they recruit and train practitioners on study procedures and monitor the procedures performed by practitioners and office staff. They also perform quality management activities, monitor practitioners and office staff, study procedure execution, and respond to data queries.

This report describes the following for the five national prospective clinical studies conducted in the Network between 2012 and 2019: (1) practitioner and patient recruitment strategies; (2) patient retention rates; (3) strategies used to achieve these patient retention rates; and (4) practitioner and patient characteristics associated with patient retention [Reference Ferracane, Hilton and Funkhouser18Reference Velly, Anderson and Look23]. The 2012–2019 period was chosen because it was the first fully national funding cycle, and it represents a time period when the same recruitment and retention strategies were used for all studies. By providing examples of proven effective methods in the Network, the over-arching goal of this report is to inform the clinical research community regarding planning and maximizing recruitment and retention of community-based practices for clinical research.

Methods

Practitioner recruitment and retention strategies

Participation in the Network and its studies is a phased process. Initial recruitment into the Network happens when dentists (and practice personnel) enroll in the Network by completing a Network Enrollment Questionnaire (EQ), which is required for network membership. The EQ queries practitioner characteristics such as the practitioner’s gender, race, year graduated from dental school, type of practice, specialty training, type and frequency of dental procedures performed, and administrative/geographic region of practice. The Network tracks EQ enrollment nationally/regionally through a database. The RC coordinates and monitors all study-related activities within the region, including research-ready (tasks that need to be completed to participate in any clinical Network study) and study-ready tasks (tasks that need to be completed to participate in a specific clinical study) (Table 1). The database allows RCs to record research study readiness tasks and use the continuously updated Network practitioner database that organizes and verifies the most up-to-date personal and practice information of Network members to help identify members for a clinical study.

Table 1. Tasks required by the practitioner, and some staff, to complete before participating in any study and then for specific studies

* IIA- A mechanism by which a practitioner can affiliate with an IRB.

** MSA- A contract in which the parties agree to a statement of work, payment requirements, work performance regulations, liability, and related matters.

Similar Network recruitment strategies were adopted for recruiting practitioners/patient participants for the five clinical studies. Live events, such as professional meetings, conference booths, or the Network regional annual practitioner meetings, were used. As a result, RCs have the opportunity to discuss clinical studies in detail with potential candidates face-to-face. Moreover, results of past/current studies are presented and discussed in break-out sessions at annual practitioner meetings, which engages members and creates enthusiasm to participate in upcoming clinical studies. Furthermore, webinars and symposium events cultivated practitioner snowballing, where existing members reach out to prospective members.

Telephone calls (typically by RCs, whom the office staff and practitioner know) to dental practices were used to speak directly with practitioners and encourage them to participate in a study of potential interest. Based on conversations with practitioners and RCs, calling between 8 am and 9 am was the most responsive time to reach practitioners, successfully increasing interactions with the practitioner and practitioner recruitment into a study. The postal mailing was adopted widely to recruit new members and invite them to participate in ongoing studies. Emails have effectively explained ongoing studies and provided pertinent information without disrupting practitioners’ daily lives. Additionally, a weekly or biweekly follow-up email was sent to practitioners, including updates on clinical study enrollment status. Monthly newsletters were also emailed, including information about the clinical study and practitioners’ testimonials to entice practitioners to join the clinical studies.

Upon practitioners’ expression of interest in a study, RCs email instructions on completing the study’s prerequisites (Table 1), including the human subjects training. Once the requirements were complete, practitioners were trained on study procedure implementation, including enrollment and consenting eligible patients. The Network retention strategies and tactics were designed to keep practitioner and patient participants from discontinuing the clinical study. The RCs maintain strong, positive relationships with the practitioners and have intermittent contact as necessary throughout the study to ensure their continued engagement. A continuously updated Network practitioner database allowed investigators and RCs to communicate effectively with practitioners, collect data, and receive datasets for all clinical study protocols. In addition, study training manuals are developed, and coordinators are trained to anticipate problems early to enhance practitioner adherence to the study’s protocols and prevent them from withdrawing from ongoing research.

Patient recruitment and retention strategies

In optimizing patient recruitment for National Dental PBRN studies, dental practitioners employ a range of diverse strategies. Patient recruitment flyers strategically placed within the dental office serve as informative tools, succinctly outlining study details and actively encouraging patient participation. These visually engaging materials not only raise awareness about ongoing research but also provide patients with a tangible and accessible source of information during their dental visits.

Concurrently, dental practitioners conduct targeted patient chart reviews on scheduled appointment days, employing a systematic approach to identify potential participants who meet predefined eligibility criteria. This real-time assessment streamlines recruitment by pinpointing individuals most likely to qualify, enhancing efficiency, and ensuring a more focused effort. To bolster these initiatives, practitioners leverage their relationships with patients during routine appointments, discussing the study’s significance and benefits in a personalized manner that fosters trust and understanding, motivating patients to engage in the research process actively.

Furthermore, dental practitioners introduce compelling incentives for study participation, conveying remuneration options as a tangible acknowledgment of patients’ contributions and enhancing the attractiveness of involvement. The active engagement of dental office staff is usually pivotal in this comprehensive strategy, as staff are equipped with study information and training to ensure a unified and informed promotional effort within the practice. This collaborative approach establishes a supportive environment that consistently encourages patient involvement in National Dental PBRN research studies, ultimately optimizing patient recruitment and ensuring the success and impact of dental studies.

Practitioners or their staff instruct patients when enrolling on the importance of completing the study to retain them for the study’s duration. For in-person follow-up (FU) visits, confirming contact information (the patient’s and/or one contact person’s) is essential. Similarly, confirming the email address and telephone number minimizes the loss of patients for online FU assessments. Practitioners’ staff first attempted the process of contacting patients for FU visits. If unsuccessful, the RC and CC initiated tracking procedures to identify updated patient contact information and contact them. For some studies, the CC assisted with FU reminder calls.

Study design

A retrospective analysis of prospective national clinical studies conducted by the Network during the 2012–2019 funding period was conducted. The Network conducted eight such studies during 2012–2019. To be included in the analysis below, each study had to be national in scope and had to require all enrolled patients to either come in for an FU visit or complete a post-visit online assessment. The CC maintained the database for each study conducted by the Network and the practitioner database (which includes the EQ). These data and accompanying documentation, including study protocols, data forms, and data dictionaries, are stored on secured servers. All clinical studies (viz., studies that enrolled practitioners and their patients) queried patients on demographics, including their sex, age, race, ethnicity, education, and dental insurance. Each study database had a practitioner identification number to allow merging with the EQ so that practitioner characteristics (e.g., demographics, practice setting, training) could be included with the study data (and were for the analysis below). For clinical studies with FU assessment(s), there was an indicator variable for attending or completing each requested FU assessment and the date of the assessment. For studies with multiple FU assessments (whether in person or online), two outcome variables were defined: whether completed any and whether completed all assessments. These were the primary outcome measures of retention.

The eight clinical studies conducted by the Network are presented in Table 2. The Network successfully enlisted the desired number of practitioners (150–200) and patients (1,700–3,800) for each study (Table 3). The studies proposed target recruitment numbers slightly beyond the number necessary to detect the desired magnitude of effect as statistically significant, while also ensuring compliance with IRB regulations by avoiding over-enrollment. Enrolling more than the target number requires submitting protocol deviations to the IRB. When recruiting/enrolling on a national scale, it can be challenging to stop enrollment at a specific date, especially when simultaneously wanting to maintain optimal relationships with practitioners who have devoted significant effort to a specific study. Three studies were excluded: (1) Suspicious Occlusal Caries study because patients were not followed [Reference Makhija, Shugars and Gilbert24]; (2) Anterior Open bite study because only patients whose treatment was considered ended or completed, viz., open-bite closed, were requested to return in 18 months [Reference Choi, Ko and Todoki25]; and (3) Risk for Oral Cancer study because only patients with a positive high-risk human papillomavirus test (N = 11) result were requested to come in for a 6-month visit [Reference Rindal, Gilbert and Carcelén26].

Table 2. Prospective clinical studies conducted by the National Dental Practice-based Research Network

1 Reason excluded: SOCL–No patient follow-up required; AOB–Only patients whose treatment was considered complete were requested to return in 18 months (N = 254 did); ROC–requested to come in for a 6-month visit (N = 11).

Table 3. Target numbers

Two out of the five studies described below required in-person FU visits. The Cracked Tooth Registry (CTR) study was a prospective, observational 3-year cohort study of posterior teeth with visible cracks. The purpose of CTR was to ascertain the rate of crack progression and identify characteristics associated with this progression [Reference Ferracane, Hilton and Funkhouser18,Reference Hilton, Funkhouser and Ferracane19]. Patients were requested to return for 3 annual recall visits. The Factors for Successful Crowns Clinical Study (CROWNS) was the only other study that required an in-person FU visit, and this visit was for the insertion/placement of the crown within 40 days [Reference McCracken, Litaker, Gordan, Sowell and Gilbert22].

The remaining three studies only requested patients to complete FU assessments electronically, namely, online or via telephone. The Management of Dentine Hypersensitivity (MDH) study, to understand the multiple treatments used for dentin hypersensitivity, requested 3 FU assessments (at 1, 4, and 8 weeks) to be completed [Reference Kopycka-Kedzierawski, Meyerowitz and Litaker20]. The Management of Painful Temporomandibular Disorders (TMD) study identified factors contributing to TMD treatment decisions and requested FU assessments at 1, 3, and 6 months [Reference Velly, Anderson and Look23]. Finally, the Predicting Outcomes for Root Canal Treatments (PREDICT) study investigated risk factors for severe pain following a root canal and requested FU assessments 1 week, 6 months, and 12 months after completion of root canal therapy [Reference Lam, Law and Nguyen21]. The number of practitioners, patients, calendar time involved, and the type and timing of FU assessments are presented in Table 2.

Statistical methods

Data from the five studies were merged to create a practitioner-level and a patient-level dataset. Composite measures of follow-up were defined at the patient level (studies included in the measure are in parentheses): completed any follow-up (clinic or online: all studies included), completed any clinic follow-up (CTR and CROWNS), completed any web follow-up (MDH, TMD, PREDICT), completed all clinic follow-up visits (CTR only), completed all online follow-up for at least one study (MDH, TMD, PREDICT). Because the CROWNS follow-up visit was “insertion” of the crown (a procedure necessary to complete the treatment that was started at the study’s enrollment and which the patient would need to do regardless of study participation), this visit was not included in the measure of completing all clinic follow-up visits. Separate analyses were performed for clinic recall visits and for post-visit online/telephone assessments as associated practitioner and patient characteristics may differ for the two types of follow-ups.

Because some practitioners participated in multiple studies and would have different ages, their age during recruitment of the first clinical study (CTR) of this funding cycle, viz., 2014, was used in analyses described below. Descriptive statistics (proportions, means, standard deviations [sd], medians, inter-quartile [IQR], and overall range) of the practitioner and patient characteristics, primarily demographic, are presented. The associations of practitioner and patient characteristics with each of the composite measures of follow-up described above were ascertained. The significance, after adjusting for the clustering of patients within the practice using generalized estimating equations implemented with PROC GENMOD in SAS, was determined for each practitioner and patient characteristic separately. Each variable was then entered into a (full) model. Analyses of each study separately are presented in supplemental tables 1-5. All analyses were performed using SAS software (SAS v9.4, SAS Institute Inc., Cary, NC).

Furthermore, the study conformed to recognized standards of the US Federal Policy for the Protection of Human Subjects by seeking Institutional Review Board (IRB) approval for the five studies as described in study publications [Reference Ferracane, Hilton and Funkhouser18Reference Velly, Anderson and Look23].

Results

Practitioner characteristics

Overall, 591 practitioners enrolled patients in one or more of the five clinical studies: 374 (63%) in one study, 133 (22%) in two studies, and 84 (14%) in three or more studies (Fig. 1). Their mean age in 2014 was 50 (sd = 11). Most of the practitioners were male (70%), non-Hispanic White (78%), worked in private practice (84%), and were general practitioners (85%) (Table 4). Specialists only comprised 1 to 6% of practitioners for three of the studies (CTR, CROWNS, MDH). In contrast, specialists comprised 19% and 29% of practitioners in the TMD and PREDICT studies, respectively, which was expected, given the clinical conditions being investigated (orofacial pain and endodontics). Findings from these analyses are provided in the supplemental tables 1-5. All regions were represented (13% to 22% from each region). The mean number of patients a practitioner enrolled was 21 (sd = 15); the mean number enrolled per study was 13 (sd = 2). The number of patients enrolled by a practitioner varied across the studies, e.g., in the MDH study, enrollment was capped at 16. In the CROWNS study, 82% of practitioners enrolled 20 or more patients (capped at 22); in the PREDICT study, 58% enrolled less than 10 patients, and some (the endodontists) enrolled as many as 50 patients.

Figure 1. Percentage of studies practitioners participated in.

Table 4. Characteristics of practitioners and patients participating in a prospective clinical study conducted by the National Dental Practice-Based Research Network 2012–2019

1 All races listed are non-Hispanic.

2 PPO: Preferred provider organization, HP:Health Partners, PDA: Permanente Dental Associates.

Patient characteristics

A total of 12,159 patients participated in one of the five studies (no patient participated in more than one study). In contrast to practitioners, the majority (65%) of patients were female (Table 4). Patients’ age and race distributions were nearly the same as those of practitioners, viz., patients’ mean age was 50 (sd = 15), and 79% were non-Hispanic White. Around half of the patients had a bachelor’s degree or higher, and 79% had some dental insurance. These characteristics were similar across studies. All studies had patients from each of the Network’s six geographic/administrative regions.

Composite participation/follow-up measures

Overall, 97% (11,736/12,159) of the patients participated in at least one follow-up activity, either online or clinic visits (Fig. 2). Of the three studies (MDH, TMD, PREDICT) for which online follow-up completion was requested, 95% (5,191/5,473) of patients completed at least one and 83% (4,537/5,473) completed all for at least one study. Of the two studies (CTR, CROWNS) requiring a clinic visit, 98% (6,545/6,686) completed at least one; 71% (2,033/2,858) of CTR patients completed all three recall visits.

Figure 2. Composite participation measures. CROWNS: factors for successful crowns, CTR: Cracked Tooth Registry, MDH: management of dentin hypersensitivity, PREDICT: predicting outcomes of root canal treatment, TMD: temporomandibular disorders.

Associations with patient retention (return for recall visits, completing post-visit online assessments) were also analyzed

The numbers are so large for any participation that minor differences (not clinically meaningful) are statistically significant, e.g., patients of general practitioners compared to specialists (97% vs. 95%, P = .003) and female compared to male patients (97% vs. 96%, P < .001). Because of this, we only describe the associations with attending all clinic visits (CTR only) or completing all online (MDH, TMD, or PREDICT) assessments (Table 5). For clinic visits, at the practitioner level, patients of public, federal, or academic practices were more likely to return for all recall visits than patients of preferred provider organizations, and of practitioners who had enrolled more patients compared to fewer patients (Table 6), At the patient level, older patients were more likely to return for all visits than were younger patients. Associations with completing online forms differed from those for clinic visits. The only difference at the practitioner level was race-ethnicity, viz., patients of non-Hispanic white or Asian or Hispanic practitioners were more likely to complete online forms than were patients of African-American, multi-racial, or other unspecified races. At the patient level, females, older, more educated, and (as with practitioners) non-Hispanic white or Asian and Hispanic completed online follow-up more than African-American, multi-racial, and other unspecified races completed post-visit online assessments more frequently.

Table 5. Characteristics of practitioners and patients participating in specified studies 1 conducted by the National Dental Practice-Based Research Network 2012–2019

1 CTR = Cracked Tooth Registry; CROWNs = Factors for successful crowns; MDH = Management of dentin hypersensitivity; TMD = Management of painful temporomandibular disorders; PREDICT = Predicting outcomes of root canal treatment.

2 All races listed are non-Hispanic.

3 PPO = Preferred provider organization; HP = Health Partners; PDA = Permanente Dental Associates.

4 P: From chi-squared statistic.

Table 6. Associations of practitioner and patient characteristics with attending or completing all requested follow-up visits/assessments for specified studies 1

1 CTR = Cracked Tooth Registry; CROWNs = Factors for successful crowns; MDH: Management of dentin hypersensitivity; TMD = Management of painful temporomandibular disorders; PREDICT = Predicting outcomes of root canal treatment.

2 Individual: Adjusted only for patients clustered within practice using generalized estimating equations.

3 Full model: Includes all characteristics listed.

4 Cat: categorical.

Discussion

The Network used various methods to recruit and retain dental practitioners and patients in clinical studies. Practitioner demographics were similar across studies, e.g., the majority were non-Hispanic white males, with mean ages of 50–53 years. The mean number of patients each practitioner recruited varied from 10–19 across the studies. Patient demographics were also similar across studies, e.g., the majority were non-Hispanic white females, had some dental insurance, mean ages 43–55 years, and 46% to 52% had a bachelor’s degree or higher. These practitioner demographics are consistent with the characteristics of dentists nationally and of patients who enter the dental care system for treatment [Reference Cunha-Cruz, Gilbert and Allareddy27].

Our five studies achieved excellent retention rates at both the practitioner (mainly in the CTR study) and patient levels. “Any FU” rates varied from 91% to 96.5%, and rates for participating in all assessments ranged from 68% to 87%. A 3-year study to examine the outpatient management of acute low back pain showed that by the end of the second year of FU, 13 of these 41 clinicians (32%) moved on to other practices, resulting in their study retention rate of 68% [Reference Carey, Kinsinger, Keyserling and Harris28]. In contrast, our CTR study showed 209 practitioners who enrolled patients; 195 (93%) continued participating for 3 years. The Network has achieved these high retention rates for clinical studies by drawing from its experiences and strategies cited in the literature [Reference Chambers, Bliss and Rambur29Reference Rotzenberg and Chui31]. The Network retains practitioners and patients by developing informal and professional relationships through continuous and positive communication and offers financial incentives to encourage their continued participation. As with any research network, it was vital for the Network to establish a continuously updated database that helps with effective communication [Reference Carey, Kinsinger, Keyserling and Harris28].

For all the studies, the recruitment of patients was limited to 6-12 months, so the practitioner would not be involved in study activities for extended durations and possibly tire of it [Reference Mungia, Funkhouser and Buchberg Trejo14]. The visit recall periods were carefully strategized, largely so that the visits were more likely to fit on a schedule consistent with patient recall patterns and insurance compensation. Successful clinical studies rely on recruiting and retaining an adequate number of participants [Reference Desai2]. For the CTR study, the association with the retention of patients was practitioners with a greater number of enrolled patients. This was true regardless of the number or type of FU assessments (1–3). These practitioners could be considered more invested in the study and more effectively communicate the value of the study to their patients.

When joining a study, a patient’s literacy level, sociocultural background, and knowledge of clinical research play a vital role in their decision-making process [Reference Desai2]. Similarly, our results reflected greater participation in post-visit online assessments by patients who were female, older, or more educated. Digital tools, such as remote meetings and online assessments, were more strongly associated with higher practitioner/patient retention rates. This can be attributed to relieving the patients of the burden of attending in-person visits and travel time that could lead to withdrawal from the study [Reference Desai2]. Findings in a similar study about retention and recruitment strategies of young women reported that email announcements and reminders were associated with greater numbers of participants and FU completions [Reference Leonard, Hutchesson, Patterson, Chalmers and Collins32].

This report has limitations. First, the studies were conducted within an existing PBRN, and many practitioner recruitment methods can only be used in such networks. Other PBRNs could incorporate methods described in this report for future clinical studies. All the methods described are from observational studies, none of which had a randomized component to evaluate the effectiveness of any particular recruitment or retention strategy. We cannot state whether any specific method is effective except by our impression and interactions with practitioners. Finally, like most studies, those described in this report were funded by a federal agency to conduct the described study but not to conduct any associated methodological study. This report also has strengths. Several studies were described, each involving over 100 practitioners and over 1,000 patients, and were conducted nationwide (US). No substantial regional differences were observed. In addition, participation methods included electronic and in-person.

Implications for research

The study analysis showcases that the Network’s recruitment and retention strategies yielded favorable practitioner and patient involvement outcomes. These findings inform the broader research community about optimizing recruitment and retention strategies for clinical studies in community-based practices. The study underscores the significance of considering practitioner and patient characteristics when designing such strategies, ultimately contributing to more effective and efficient research initiatives in community-based settings.

Conclusion

These five studies demonstrate overall efficiency in enrolling practitioners and patients by adopting the Network’s recruitment and retention strategies. The phased approach for practitioner recruitment included live events and direct communication, whereas retention involved strong relationships, periodic contact, and a continuously updated practitioner database. Similarly, patient recruitment utilized diverse strategies like strategically placed flyers, targeted chart reviews, and personal discussions during appointments. Patient incentives and active engagement of dental office staff enhanced patient participation, with clear communication and tracking procedures ensuring successful follow-up visits and the impact of National Dental PBRN studies. This report offers how practitioner and patient characteristics might enable effective recruitment and retention strategies; this may be useful when planning studies that seek to maximize recruitment and retention.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/cts.2024.499.

Acknowledgments

We are very grateful to the Network’s Regional Coordinators and other network staff who engaged in the studies discussed in this article Midwest Region: Tracy Shea, RDH, BSDH; Western Region: Stephanie Hodge, MA; Northeast Region: Christine O’Brien, RDH; South Atlantic Region: Hanna Knopf, BA, and Deborah McEdward, RDH, BS, CCRP; South Central Region: Shermetria Massengale, MPH, CHES; Southwest Region: Stephanie Reyes, BA, Meredith Buchberg, MPH, and Colleen Dolan, MPH; network program manager (Andrea Mathews, BS, RDH) and program coordinator (Terri Jones), along with network practitioners and their dedicated staffs to conduct the study.

Author contributions

Author RM, EF, GHG: Contributed to conception and design; acquisition, analysis, or interpretation of data; drafted the manuscript; critically revised the manuscript for important intellectual content; gave final approval; agreed to be accountable for all aspects of the work in ensuring that questions relating to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Author JCC: Contributed to conception and design; interpretation of data; drafted the manuscript; critically revised the manuscript for important intellectual content; gave final approval; agree to be accountable for all aspects of the work in ensuring that questions relating to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Author DC, GVV, RDB, MC, AV, FJL: Contributed to conception and design; interpretation of data; critically revised the manuscript for important intellectual content; gave final approval; agreed to be accountable for all aspects of the work in ensuring that questions relating to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Funding statement

This work was supported by NIH grants U19-DE-22516 and U19-DE-28717. Opinions and assertions contained herein are those of the authors and are not to be construed as necessarily representing the views of the respective organizations or the National Institutes of Health. An Internet site devoted to details about the nation’s Network is located at http://NationalDentalPBRN.org. The informed consent of all human subjects who participated in this investigation was obtained after the nature of the procedures had been explained fully.

Competing interests

None.

Footnotes

The National Dental PBRN Collaborative Group comprises practitioner, faculty, and staff investigators who contributed to this network activity. A list of these persons is at http://www.nationaldentalpbrn.org/collaborative-group.php

References

Adams, J, Steel, A, Moore, C, Amorin-Woods, L, Sibbritt, D. Establishing the ACORN national practitioner database: strategies to recruit practitioners to a national practice-based research network. J Manipulative Physiol Ther. 2016;39(8):594602. doi: 10.1016/j.jmpt.2016.08.006.CrossRefGoogle ScholarPubMed
Desai, M. Recruitment and retention of participants in clinical studies: critical issues and challenges. Perspect Clin Res. 2020;11(2):5153. doi: 10.4103/picr.PICR_6_20.Google ScholarPubMed
McDonald, AM, Knight, RC, Campbell, MK, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7 7(1):9. doi: 10.1186/1745-6215-7-9.Google Scholar
Shelton, BJ, Wofford, JL, Gosselink, CA, et al. Recruitment and retention of physicians for primary care research. J Community Health. 2002;27(2):7989. doi: 10.1023/a:1014598332211.CrossRefGoogle ScholarPubMed
Spears, W, Tsoh, JY, Potter, MB, et al. Use of community engagement strategies to increase research participation in practice-based research networks (PBRNs). J Am Board Fam Med. 2014;27(6):763771. doi: 10.3122/jabfm.2014.06.140059.CrossRefGoogle ScholarPubMed
Dumville, JC, Torgerson, DJ, Hewitt, CE. Reporting attrition in randomised controlled trials. BMJ. 2006;22(7547):969971. doi: 10.1136/bmj.332.7547.969.Google Scholar
Fewtrell, MS, Kennedy, K, Singhal, A, et al. How much loss to follow-up is acceptable in long-term randomised trials and prospective studies? Arch Dis Child. 2008;93(6):458461. doi: 10.1136/adc.2007.127316.CrossRefGoogle ScholarPubMed
Walsh, M, Devereaux, PJ, Sackett, DL. Clinician trialist rounds: 28. When RCT participants are lost to follow-up. Part 1: why even a few can matter. Clin Trials. 2015;12(5):537539. doi: 10.1177/1740774515597702.CrossRefGoogle Scholar
Abshire, M, Dinglas, VD, Cajita, MI, Eakin, MN, Needham, DM, Himmelfarb, CD. Participant retention practices in longitudinal clinical research studies with high retention rates. BMC Med Res Methodol. 2017;17(1):30. doi: 10.1186/s12874-017-0310-z.CrossRefGoogle ScholarPubMed
Booker, CL, Harding, S, Benzeval, M. A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health. 2011;19 11(1):249. doi: 10.1186/1471-2458-11-249.Google Scholar
Robinson, KA, Dinglas, VD, Sukrithan, V, et al. Updated systematic review identifies substantial number of retention strategies: using more strategies retains more study participants. J Clin Epidemiol. 2015;68(12):14811487. doi: 10.1016/j.jclinepi.2015.04.013.CrossRefGoogle ScholarPubMed
Westfall, J, Mold, J, Fagnan, L. Practice-based research-“Blue highways” on the NIH roadmap. JAMA. 2007;02(01):403406. doi: 10.1001/jama.297.4.403.Google Scholar
Loskutova, NY, Smail, C, Ajayi, K, Pace, WD, Fox, CH. Recruiting primary care practices for practice-based research: a case study of a group-randomized study (TRANSLATE CKD) recruitment process. Fam Pract. 2018;16(1):111116. doi: 10.1093/fampra/cmx064.Google Scholar
Mungia, R, Funkhouser, E, Buchberg Trejo, MK, et al. Practitioner participation in national dental practice-based research network (PBRN) studies: 12-year results. J Am Board Fam Med. 2018;31(6):844856. doi: 10.3122/jabfm.2018.06.180019.CrossRefGoogle Scholar
Mungia, R, Funkhouser, E, Makhija, SK, et al. Practitioner engagement in activities of the national dental practice-based research network (PBRN): 7-year results. J Am Board Fam Med. 2020;33(5):687697. doi: 10.3122/jabfm.2020.05.190339.Google Scholar
Gilbert, GH, Fellows, JL, Allareddy, V, et al. Structure, function, and productivity from the national dental practice-based research network. J Clin Transl Sci. 2022;6(1):e87. doi: 10.1017/cts.2022.421.CrossRefGoogle ScholarPubMed
Gilbert, GH, Williams, OD, Korelitz, JJ, et al. Purpose, structure, and function of the united states national dental practice-based research network. J Dent. 2013;41(11):10511059. doi: 10.1016/j.jdent.2013.04.002.CrossRefGoogle ScholarPubMed
Ferracane, JL, Hilton, TJ, Funkhouser, E, et al. Outcomes of treatment and monitoring of posterior teeth with cracks: three-year results from the national dental practice-based research network. Clin Oral Investig. 2021;26(3):24532463. doi: 10.1007/s00784-021-04211-0.CrossRefGoogle ScholarPubMed
Hilton, TJ, Funkhouser, E, Ferracane, JL, et al. Associations of types of pain with crack-level, tooth-level and patient-level characteristics in posterior teeth with visible cracks: findings from the national dental practice-based research network. J Dent. 2018;70:6773. doi: 10.1016/j.jdent.2017.12.014.CrossRefGoogle ScholarPubMed
Kopycka-Kedzierawski, DT, Meyerowitz, C, Litaker, MS, et al. Management of dentin hypersensitivity by practitioners in the national dental practice-based research network. J Am Dent Assoc. 2017;148(10):728736. doi: 10.1016/j.adaj.2017.05.003.CrossRefGoogle ScholarPubMed
Lam, EWN, Law, AS, Nguyen, RHN, et al. Interexaminer agreement in the radiologic identification of apical periodontitis/Rarefying osteitis in the national dental practice-based research network PREDICT endodontic study. J Endod. 2021;47(10):15751582. doi: 10.1016/j.joen.2021.07.008.Google Scholar
McCracken, MS, Litaker, MS, Gordan, Karr VV, Sowell, T, Gilbert, E, GH. Remake rates for single-unit crowns in clinical practice: findings from the national dental practice-based research network. J Prosthodont. 2018;28(2):122130. doi: 10.1111/jopr.12995.Google ScholarPubMed
Velly, AM, Anderson, GC, Look, JO, et al. Management of painful temporomandibular disorders: methods and overview of the national dental practice-based research network prospective cohort study. J Am Dent Assoc. 2022;153(2):144157. doi: 10.1016/j.adaj.2021.07.027.CrossRefGoogle Scholar
Makhija, SK, Shugars, DA, Gilbert, GH, et al. Surface characteristics and lesion depth and activity of suspicious occlusal carious lesions: findings from the national dental practice-based research network. J Am Dent Assoc. 2017;148(12):922929. doi: 10.1016/j.adaj.2017.08.009.Google ScholarPubMed
Choi, KW, Ko, HC, Todoki, LS, et al. The national dental practice-based research network adult anterior open bite study: a description of the practitioners and patients. Angle Orthod. 2018;88(6):675683. doi: 10.2319/070118-491.1.CrossRefGoogle Scholar
Rindal, DB, Gilbert, GH, Carcelén, C, et al. Feasibility and acceptance of oral human papillomavirus detection in the dental office: results from the national dental practice-based research network. J Am Dent Assoc. 2019;150(2):130139.e4. doi: 10.1016/j.adaj.2018.10.022.CrossRefGoogle ScholarPubMed
Cunha-Cruz, J, Gilbert, GH, Allareddy, V, et al. Characteristics of dentists in the national dental practice-based research network. J Dent. 2023;137:104653. doi: 10.1016/j.jdent.2023.104653.Google ScholarPubMed
Carey, TS, Kinsinger, L, Keyserling, T, Harris, R. Research in the community recruitimg and retaining practices. J Commun Health. 1996;21(5):315327. doi: 10.1007/BF01702785.CrossRefGoogle ScholarPubMed
Chambers, M, Bliss, K, Rambur, B. Recruiting research participants via traditional snowball vs facebook advertisements and a website. Western J Nurs Res. 2020;42(10):846851. doi: 10.1177/0193945920904445.Google ScholarPubMed
Goldman, V, Dushkin, A, Wexler, DJ, et al. Effective recruitment for practice-based research: lessons from the REAL HEALTH-diabetes study. Contemp Clin Trials Commun. 2019;15:100374. doi: 10.1016/j.conctc.2019.100374.CrossRefGoogle ScholarPubMed
Rotzenberg, K, Chui, MA. Improving recruitment and retention of pharmacists in a practice-based research network. Pharmacy (Basel). 2019;7(3):131. doi: 10.3390/pharmacy7030131.CrossRefGoogle Scholar
Leonard, A, Hutchesson, M, Patterson, A, Chalmers, K, Collins, C. Recruitment and retention of young women into nutrition research studies: practical considerations. Trials. 2014;15(1):23. doi: 10.1186/1745-6215-15-23.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Tasks required by the practitioner, and some staff, to complete before participating in any study and then for specific studies

Figure 1

Table 2. Prospective clinical studies conducted by the National Dental Practice-based Research Network

Figure 2

Table 3. Target numbers

Figure 3

Figure 1. Percentage of studies practitioners participated in.

Figure 4

Table 4. Characteristics of practitioners and patients participating in a prospective clinical study conducted by the National Dental Practice-Based Research Network 2012–2019

Figure 5

Figure 2. Composite participation measures. CROWNS: factors for successful crowns, CTR: Cracked Tooth Registry, MDH: management of dentin hypersensitivity, PREDICT: predicting outcomes of root canal treatment, TMD: temporomandibular disorders.

Figure 6

Table 5. Characteristics of practitioners and patients participating in specified studies1 conducted by the National Dental Practice-Based Research Network 2012–2019

Figure 7

Table 6. Associations of practitioner and patient characteristics with attending or completing all requested follow-up visits/assessments for specified studies1

Supplementary material: File

Mungia et al. supplementary material

Mungia et al. supplementary material
Download Mungia et al. supplementary material(File)
File 71.2 KB