Hostname: page-component-cd9895bd7-gbm5v Total loading time: 0 Render date: 2024-12-22T14:41:31.116Z Has data issue: false hasContentIssue false

Education and training of clinical and translational study investigators and research coordinators: A competency-based approach

Published online by Cambridge University Press:  13 January 2017

Nancy A. Calvin-Naylor*
Affiliation:
Institute for Research on Innovation and Science (IRIS), University of Michigan, Ann Arbor, MI, USA
Carolynn Thomas Jones
Affiliation:
College of Nursing, Ohio State University, Columbus, OH, USA
Michelle M. Wartak
Affiliation:
Broad Institute of MIT, Tufts University, Boston, MA, USA
Karen Blackwell
Affiliation:
Human Research Protection Program, University of Kansas, Kansas City, KS, USA
Jonathan M. Davis
Affiliation:
Frontiers: The Heartland Institute for Clinical and Translational Science, University of Kansas, Fairway, KS, USA
Ruthvick Divecha
Affiliation:
Medical Affairs, University of Michigan, Ann Arbor, MI, USA
Edward F. Ellerbeck
Affiliation:
Department of Preventive Medicine and Public Health, University of Kansas, Kansas City, KS, USA
Karl Kieburtz
Affiliation:
Clinical and Translational Science Institute, University of Rochester, Rochester, NY, USA
Margaret J. Koziel
Affiliation:
UMass Center for Clinical and Translational Science, University of Massachusetts, Lowell, MA, USA
Katherine Luzuriaga
Affiliation:
UMass Center for Clinical and Translational Science, University of Massachusetts, Lowell, MA, USA
Jennifer Maddox
Affiliation:
Frontiers: The Heartland Institute for Clinical and Translational Science, University of Kansas, Fairway, KS, USA
Nancy A. Needler
Affiliation:
Clinical and Translational Science Institute, University of Rochester, Rochester, NY, USA
Susan Murphy
Affiliation:
Michigan Institute for Clinical & Health Research, University of Michigan, Ann Arbor, MI, USA
Kieran Pemberton
Affiliation:
Frontiers: The Heartland Institute for Clinical and Translational Science, University of Kansas, Fairway, KS, USA
Catherine Radovich
Affiliation:
Michigan Institute for Clinical & Health Research, University of Michigan, Ann Arbor, MI, USA
Eric P. Rubinstein
Affiliation:
Clinical and Translational Science Institute, University of Rochester, Rochester, NY, USA
Harry P. Selker
Affiliation:
Clinical and Translational Science Institute, Tufts University, Boston, MA, USA
Pamela Tenaerts
Affiliation:
Clinical Trials Transformation Initiative, Durham, NC, USA
Kelly Unsworth
Affiliation:
Human Subject Protection Program, University of Rochester, Rochester, NY, USA
Kay Wilson
Affiliation:
Michigan Institute for Clinical & Health Research, University of Michigan, Ann Arbor, MI, USA
Jonelle E. Wright
Affiliation:
Clinical and Translational Science Institute, University of Miami, Miami, FL, USA
Richard Barohn
Affiliation:
Frontiers: The Heartland Institute for Clinical and Translational Science, University of Kansas, Fairway, KS, USA
Thomas P. Shanley
Affiliation:
Department of Pediatrics, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
*
*Address for correspondence: N. Calvin-Naylor, Ph.D., University of Michigan, 426 Thompson Street, Room 3304, Ann Arbor, MI 48106, USA. (Email: [email protected])
Rights & Permissions [Opens in a new window]

Abstract

Introduction

Training for the clinical research workforce does not sufficiently prepare workers for today’s scientific complexity; deficiencies may be ameliorated with training. The Enhancing Clinical Research Professionals’ Training and Qualifications developed competency standards for principal investigators and clinical research coordinators.

Methods

Clinical and Translational Science Awards representatives refined competency statements. Working groups developed assessments, identified training, and highlighted gaps.

Results

Forty-eight competency statements in 8 domains were developed.

Conclusions

Training is primarily investigator focused with few programs for clinical research coordinators. Lack of training is felt in new technologies and data management. There are no standardized assessments of competence.

Type
Education
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Pressmust be obtained for commercial re-use or in order to create a derivative work.
Copyright
© The Association for Clinical and Translational Science 2017

Introduction

This report reflects the consensus of the Clinical and Translational Science Awards (CTSA) Consortium Enhancing Clinical Research Professionals’ Training and Qualification (ECRPTQ) project that responded to a mandate to improve the efficiency of clinical trials through educating principal investigators (PIs) and clinical research coordinators (CRCs) in core clinical trial competencies. The objectives of this project were to codify the core competencies into a single high-level set of standards that could serve as the framework for defining professional competency across the clinical research continuum. There is pressure to provide institution-specific training for some aspects of job performance, but we believe there is significant value and efficiency to be gained by a uniform curriculum that trains to a standard set of competencies.

The Institute of Medicine (IOM) 2012 workshop report entitled Envisioning a Transformed Clinical Trials Enterprise in the United States, stated that the more traditional areas of mechanistic research and efficacy trials call for specialized workforces that until now have all too often depended on ad hoc, “on-the-job” learning as opposed to the prospective training and education that defines a mature discipline [1]. The data from the US Food and Drug Administration Center for Drug Evaluation and Research inspections from fiscal years 2004–2011 (n=2325) of US clinical trial sites show the following clinical investigator deficiencies: 42% protocol violations, 30% record-keeping deficiencies, 12% informed consent deficiencies, 10% of drug accountability violations, 9% Institutional Review Board (IRB) communication, and 5% with problems reporting adverse events (AEs) [Reference Khin2]. Moreover, despite recent requirements for Good Clinical Practice (GCP) training of investigators and clinical research staff, a decrease in these deficiencies and violations have persisted (see http://bit.ly/1maLi8W [Reference Seltzer3]). These data suggest that there is a need for an intervention to increase clinical investigator and coordinator competence and improve clinical trial performance metrics.

We hypothesize that clinical trial (and particularly multisite clinical trial) performance will be significantly improved by a standard set of systematically harmonized competencies that equip PIs and CRCs with the necessary skills to more effectively, efficiently, and safely execute clinical trials.

Current State of PI and CRC Training

The IOM has issued a challenge to create a clinical research workforce that can address increasing complexity in clinical and translational research and generate study results that reach the community more efficiently [1]. This challenge has focused attention on a clinical research workforce that includes not only PIs, but also CRCs and staff members. To date, education and training for PIs has evolved through the CTSA, but this training did not reach all investigators, nor the many clinical research professionals, and other team members who were external to the local CTSA funding mechanism. Mandates for GCP training by industry sponsors and IRBs have provided a minimal training activity for investigators and their clinical research teams. Academic and nonacademic sites provide local training and educational links, but often these efforts are unfunded and/or institution-specific activities. A formalized education and training requirement is lacking for individuals working in this profession.

Competency-based Education (CBE)

Over the past decade, various professional societies and institutes have supported a CBE approach for clinical research professionals. CBE identifies specific learning outcomes for knowledge and its application and is often referred to as outcomes-based education. Part of an educational trend that emerged in the 1970s, this approach has been endorsed by the IOM in its 2005 report. Characteristics that distinguish CBE include the following:

  • Learner outcomes that are based on analysis of typical job responsibilities of practitioners.

  • A curriculum focused on what learners need to learn to perform specific job tasks, not necessarily on traditional subject matter.

  • Hierarchically sequenced modules that allow learners to proceed at their own pace.

  • Educators employing assessment techniques that measure learner performance in settings that approximate the real environment [Reference Hendricson4].

The evolution of CBE/competency-based training and the publication of core competencies in clinical research offer a pathway for achieving workforce development goals [Reference Sonstein5]. CBE/competency-based training promise a skilled workforce to a variety of stakeholders by mapping core competencies to educational and training curricula. The competency-based approach ultimately defines competences and qualifications in a systematic learner-centric pathway [Reference Boahin6]. Competencies represent not only basic knowledge, but higher levels of knowledge, skills, and attitudes (KSAs) that embody the profession.

Core competencies for clinical research nurse coordinators evolved from several works generated by the Royal College of Nursing in the United Kingdom, Oncology Nursing Society, and a National Institutes of Health (NIH) Clinical Research Nurse Working Group [Reference Society79]. Other role delineation work for clinical research nurses have continued to study these domains and specific KSAs in practice [Reference Ehrenberger and Lilington10Reference Jones and Wilson13]. Many of the role delineations attributed to clinical research nurses can also be attributed to non-nurse CRCs [Reference Jones and Wilson14].

In addition, core competencies for clinical and translational PIs were featured on the CTSA Web site [15] and formed the basis for curriculum development for master-level courses under the CTSA, beginning with the K-30 awards. The role of pharmaceutical physicians, which is primarily a role found in Europe and South America, have also resulted in an evolved core competency framework [Reference Silva16].

Materials and Methods

Criteria for Selecting a Competency Framework

The ECRPTQ leadership team considered a variety of competency frameworks for this phase:

  • The CTSA Education and Career Development Key Function Committee developed the CTSA master-level competencies, approved in 2011 (http://bit.ly/21cX5n8), to define the training standards for individuals functioning at the master’s level in clinical and translational research [15]. This framework includes 14 thematic areas that are intended to shape the training experiences of early career investigators and it represents the foundation for many graduate programs in clinical research across the CTSA Consortium. Although the ECRPTQ leadership team felt these competencies to be highly relevant for investigators, they did not fully address the necessary qualifications and skills for other team members. The ECRPTQ leadership team also examined specialty competencies in a variety of areas developed by CTSA key function committees, including bioinformatics.

  • The NIH Clinical Research Nursing Domains of Practice for the Specialty of Clinical Research Nursing (http://cc.nih.gov/nursing/crn/DOP_document.pdf) was another framework that was reviewed and considered, but also did not necessarily address the qualifications and skills for all team members.

  • Competencies outlined by the Oncology Nursing Society (https://www.ons.org/sites/default/files/ctncompetencies.pdf) were also reviewed but the group felt they were rather limited, focusing only on oncology studies.

  • The ECRPTQ leadership also acknowledged the work of the National Research Coordinator Consortium, formerly known as the CTSA Research Coordinator Taskforce. This outlined job description recommendations and identified critical training needs and resources for CRCs. Like the other domains listed previously, the ECRPTQ leadership felt a framework that would be inclusive of all study team members was needed.

Ultimately, the framework proposed by the Joint Task Force for Clinical Trial Competency (JTF) [Reference Sonstein5] was selected that identified 8 broad domains of competence:

  1. (1) Scientific concepts and research design

  2. (2) Ethical and participant safety considerations

  3. (3) Medicines development and regulation

  4. (4) Clinical trial operations

  5. (5) Study and site management

  6. (6) Data management and informatics

  7. (7) Leadership and professionalism

  8. (8) Communication and teamwork

The ECRPTQ leadership team selected this framework because of its comprehensive applicability and its widespread uptake by numerous other stakeholders in the clinical trial enterprise. An additional consideration was the knowledge that the JTF mapped its competency framework to those mentioned previously, along with additional competency frameworks identified by Consortium of Academic Programs in Clinical Research (CoAPCR) and the UK National Health Service [Reference Jones17]. The JTF model is displayed in Table 1.

Table 1 JTF Core Competencies

GCP, Good Clinical Practice.

Competency Domain Working Groups: Recruitment and Composition

This CTSA-wide endeavor drew upon expertise across the consortium for this important and complex project. The ECRPTQ leadership team invited members of the CTSA Consortium with relevant expertise to participate in each of the Competency Domain Working Groups, which were created based on the 8 competency domains identified by the JTF. Two co-leads were appointed to each group. The expectations of the groups included a desire to focus on 2 roles: PIs and CRCs conducting clinical trials. The deliverables also included the charge to review and refine the JTF competency statements, identify assessment areas for each competency statement, and determine gaps in existing training.

As part of the first phase of the ECRPTQ project, a Social/Behavioral Research (S/BR) Working Group was created in response to a recognized need to address GCP in an appropriate and meaningful way for researchers conducting clinical trial testing behavioral interventions. This work is described in a separate paper authored by Murphy and her colleagues in this journal. In this phase of the ECRPTQ project, members of the S/BR Working Group were invited to participate in each of the Competency Domain Working Groups, contributing their expertise.

Competency Domain Working Group Process

Workgroups began working as soon as co-leads were identified and workgroup membership assigned. S/BR Working Group members were embedded within the Competency Domain Working Groups to provide feedback to ensure that the competencies were inclusive of S/BR. After a series of conference calls, email exchanges, and 2 working meetings in 2015, all Competency Domain Working Groups submitted their deliverables to the leadership team. Following this submission, a review team comprised of individuals from across the consortium conducted a thorough appraisal of this work to synthesize and collate the materials and provide a final draft to be reviewed by the Project Leadership Team before being forwarded to the CTSA Steering Committee. The core competencies were then reviewed by the JTF, CoAPCR, and Association of Clinical Research Professionals (ACRP). The final meeting was attended by project leadership, the Competency Domain Co-leads, JTF, and CoAPCR.

At the final meeting, the attendees revisited the importance of focusing on drafting competency statements that represent clear and measurable expressions of performance for professionals involved in clinical trials. The attendees also discussed areas of potential overlap within the framework, with some competencies appearing in more than 1 general competency domain. The group agreed that some overlap was acceptable and probably necessary under some circumstances.

Clinical Trial Competency Statements

The 51 competency statements written by the JTF were carefully reviewed by Competency Domain Working Groups and review teams. Of the 51 JTF statements, 34 were modified to enhance meaning and to reflect a focus on clinical trials. Five of the JTF competency statements were removed as stand-alone statements and were rewritten as assessments for other competencies, and 3 new ECRPTQ competency statements were added. In total, 48 ECRPTQ competency statements reflect the work of these groups (see Appendix 1).

Several items are particularly noteworthy regarding the overall work:

  • First, the Competency Domain Working Group reviewing the Medicines Development and Regulation domain called for a renaming of that domain to Investigational Products Development and Regulation to be more inclusive of device research.

  • Second, the domain Communication and Teamwork was separated into 2 domains at the request of the ECRPTQ leadership team early in the Phase II process, believing the concept of team science to be of critical importance for the CTSA Consortium. Because the field of team science is still emerging and that the relevant skills are still being defined, the decision was made that the domain should be combined with the Leadership and Professionalism domain to become Leadership, Professionalism, and Team Science. As team science competencies emerge and are refined, it may make sense later to separate the domains.

  • Third, there are purposefully some areas of overlap across domains, as the group agreed that understanding concepts can be very related but still highly nuanced.

  • The S/BR Working Group suggested additional edits to 6 competency statements in 3 competency domains. These suggestions are relevant to study teams specifically conducting clinical trials involving behavioral interventions or assessments.

  • Echoing a sentiment expressed by the JTF at its meeting in April 2015, the group recognized the importance of regular updates and revisions to this work, corresponding to advances in science and concomitant regulations.

Competency Domain Assessments

Competency statements are broad and meant to be generally applicable to both PIs and CRCs; however, in thinking of how to apply these statements to different roles within a study team, Competency Domain Working Groups identified areas of assessment specific to investigators and CRCs, with a principal focus on entry-level individuals.

Competency Domain Working Groups were provided with an overview of Bloom’s taxonomy [Reference Bloom18] to assist them in writing measurable and appropriately leveled assessments that are at higher level KSAs. Most assessments proposed by the Competency Domain Working Groups are specific and measurable, such as “Prepare a research question” and “Demonstrate knowledge of appropriate control, storage, and dispensing of investigational products.” Groups identified a total of 429 potential assessments across all domains, with 220 identified as appropriate for investigators and 209 identified as appropriate for CRCs, a list that is in no way exhaustive. A considerable number of these assessments are identical for investigators and for CRCs, so the total does not represent unique assessments.

In terms of methods, many Competency Domain Working Groups suggested the use of case studies and observation of behavior, indicating that simply passing a quiz or multiple-choice exam is not indicative of mastery; some also recommended pre/post testing. It is important to acknowledge that while the creation of detailed assessment methods was not within the scope of this work, some working groups did suggest methods that might be employed. (See http://bit.ly/1Qfm5qr for more details about the assessments by competency domain.)

Existing Clinical Trial Training

Competency Domain Working Groups were also tasked with identifying and examining existing training believed to address the competencies identified within the groups’ respective competency domains. They took a broad approach to this task, based on the expertise and experiential knowledge of their members. It was not possible to examine every training program that might exist, but the groups reviewed a reasonably representative sample of offerings. In general, included were training and education offered by CTSA institutions; by professional organizations devoted to education and resources; by industry; and by government units (see http://bit.ly/1IV821x, entitled training gaps by competency domains). Collectively, Competency Domain Working Groups examined the following number of education and training offerings (with some offerings identified as appropriate for multiple competencies) (see Table 2).

Table 2 Summary of existing education and trainings

CTSA, Clinical and Translational Science Awards.

From Table 2, of the 343, 219 unique education and training offerings were identified.

Every competency domain had associated training with a few exceptions, noted below:

  • Leadership, Professionalism, and Team Science: identify and apply professional guidelines and codes of ethics as they relate to the conduct of clinical trials. No training identified.

  • Leadership, Professionalism, and Team Science: Describe the methods necessary to work effectively with multidisciplinary and interprofessional research teams. No training identified.

  • Communication: Describe the component parts of a traditional scientific publication. No training identified.

Just over half of the offerings identified appear to be available online; not all of those offerings are readily accessible in the public domain, or free of charge, however. In addition to the trainings identified as meeting-specified competencies, groups cited 214 supplemental resources, including Web sites, reports, books, and published articles. See http://bit.ly/1U3PYbS for the catalog of Identified Existing Education and Trainings organized by competency domain.

Sample online offerings:

  • Northwestern University, Clinical and Translational Sciences Institute Introduction to Clinical Research Online Modules

  • University of Washington, Institute of Translational Health Sciences (ITHS), Self-Directed Learning Center

  • Office of Research Integrity: The Lab, The Research Clinic

  • NIH: Teaching the Responsible Conduct of Research

  • ACRP: GCP—An introduction to ICH GCP Guidelines

  • Collaborative Institutional Training Initiative (CITI): Populations in Research Requiring Additional Consideration

  • UC Davis: Strengthening Provider Patient Communication Skills in Clinical Trials.

Competency Domain Working Groups were not tasked to consider cost as a factor in the groups’ work, but it is certainly an important consideration and some groups did so. The cost of these offerings ranges from free to a significant financial investment by the department or individual.

Similarly, the working groups were not tasked to consider training quality, but many did so nevertheless identifying the need for training that actively engages the learner, going beyond mere rote memorization. A number of Competency Domain Working Groups noted that existing training focuses too heavily on theoretical concepts and historical events and not enough on the application of knowledge. Competency Domain Working Groups frequently noted that online offerings are insufficient alone and must be supplemented by local institutional education and training. The education and training offerings that are listed in this report (see http://bit.ly/1U3PYbS) are not endorsed by the ECRPTQ leadership team. It was outside the parameters of this project to conduct a thorough evaluation of the suggested trainings from the Competency Domain Working Groups. There was broad agreement that the assessment of their quality should be undertaken as a future phase of the project.

Results

Identified Training Gaps

Competency Domain Working Groups identified 115 specific training gaps across the 8 reviewed domains. In the review of identified trainings, 5 broad categories of gaps were identified: (1) training that is needed but does not currently exist; (2) existing training that is not adequate; (3) certification, documentation of skill, or formal assessment is needed; (4) a core training curriculum needs to be defined and/or developed; and (5) there is inadequate training at a level for CRCs. Overwhelmingly, groups concluded that some training exists for most ECRPTQ competency domains, but that this training is not adequate to fully meet the needs of the investigators and CRCs. This finding is consistent with the data collected in the JTF Core Competency Survey; participants were asked whether they felt a need for training in these domains, with the majority of respondents indicating they felt training was needed [Reference Sonstein19].

Overall, the education and training identified is primarily investigator focused, particularly offerings provided by CTSA institutions. There are few organized curricular programs available for CRCs. Lack of training is keenly felt in the adoption of new technologies and in areas such as data management. Very importantly, there are no standardized assessments of competence in the domains. Training is not generally organized by level of expertise, and often does not distinguish roles and responsibilities between investigators and CRCs. Some Competency Domain Working Groups, such as Leadership, Professionalism, and Team Science, and Communication were forced to draw from offerings completely outside the context of clinical research, because they were unable to find relevant training within clinical research. As noted previously, many of the trainings cited in this report do not provide opportunities to apply knowledge and do not incorporate learning strategies known to be effective in promoting the development of competence. See http://bit.ly/1IV821x for more details about training gaps by competency domain.

S/BR Working Group Considerations

The S/BR Working Group reviewed all the Competency Domain Working Groups’ deliverables and offered suggested edits to the ECRPTQ competencies in some domains to promote greater inclusion of research teams carrying out clinical trials involving behavioral interventions and assessments. Additional comments made by the group regarding trainings and assessments for select domains were made (reference to http://bit.ly/1RaeSIk).

Recommendations

  • The recently completed JTF Core Competency Survey that is currently being analyzed will provide important data that will help validate the JTF framework. The survey asked individuals to self-assess their own level of competence in the framework’s domains, as well as the relevance of those domains and their perceived needs for additional training. More objective measures of competency are needed to complement these data. This organization is also currently exploring mechanisms to revise and update its competency statements, particularly as new scientific fields and technologies emerge.

  • Building upon the identification of assessment areas by Competency Domain Working Groups, specific assessments must be developed to assess competence. Such assessments should focus not only on different study team member roles, but levels of mastery as well.

  • An evaluation of the quality of existing training should be undertaken, as well as an expansion of the catalog of training that emerged from the working groups. This catalog does not include all available educational opportunities and should be expanded to include additional relevant training.

  • A deeper exploration of training gaps should be undertaken to determine whether new training modules are needed. If so, the development of this education and training should be undertaken by individuals skilled in instructional design and curriculum development, built upon the principles of adult learning.

  • Examination of a cloud-based learning management platform to support individuals seeking and tracking their CBE and assessment, based on the competency framework developed in this work may be warranted.

  • An ePortfolio system would be identified to allow PIs and CRCs to collect, organize, and share their completed trainings, demonstrate learning, and have a portable record of their achievements. Such a system would allow individuals to upload artifacts of competence that could be made available to relevant institutions, sponsors, and other regulatory bodies.

  • Because of the extraordinary opportunity of working with external stakeholder organizations to identify standard competencies for these 2 cohorts (investigators and CRCs), these continued activities should be undertaken in partnership with individuals from the JTF, CoAPCR, ACRP, Clinical Trials Transformation Initiative (CTTI) and other organizations invested in clinical research professional training. These organizations are committed to study team education and training, and the JTF framework is gaining significant traction nationally and internationally through their efforts.

  • Recommendations for institutional policies on clinical research training should be expanded beyond basic IRB and GCP training, with step-wise approaches to training personnel.

  • Job descriptions should be modified to reflect specific competencies by levels.

  • Inter-institutional training courses should be developed and shared as cost-free, easily accessible, web-based formats with additional train-the-trainer mechanisms for onsite training and continuing education.

  • Academic pathways for baccalaureate and graduate degrees in clinical research should be endorsed and more highly accessible to clinical research professionals working in academic medical centers and hospitals. If an institution does not offer a clinical research program of study, then clinical research staff should be able to transfer educational benefits to other institutions.

Conclusions

This document is the result of the CTSA Consortium ECRPTQ supplement and includes discussion and consensus documents with iterative revisions. The competencies and assessments generated in Phase II of the ECRPTQ supplement have been approved by the CTSA Consortium and have the support of JTF, CoAPCR, and ACRP. The competencies and assessments have been submitted to National Center for Advancing Translational Sciences (NCATS) for their consideration. Although these documents provide a framework for investigator and CRC training it does not provide direction on how to implement a training program. The purpose of this document is to provide a standard set of core clinical trial competencies and KSA assessments that equip investigators and CRCs with the necessary skills to more effectively, efficiently, and safely execute clinical trials. Education and training should be patterned to these competencies and ultimately lead to specific formative and summative evaluations of learning.

Acknowledgments

The authors thank Christopher P. Austin (M.D.), Petra Kaufmann (M.D., M.Sc.), Todd Wilson (D.O.), and Michelle A. Culp (M.P.H.) for their support and insightful comments with this supplement. The authors would also like to thank all of the work of the Michigan Institute for Clinical and Health Research at the University of Michigan, especially Vic Divecha, for all of his project management expertise and organizational skills, Christina Loar, Brenda Eakin, and Vicki Ellingrod for all of their assistance with this project. This paper was supported by an administrative supplement award to Michigan Institute for Clinical and Health Research at the University of Michigan (3UL1TR000433-08S1; and individual hub supplement awards to all 62 CTSAs). The leadership team consisted of representatives from the following CTSAs: Heartland Institute Clinical and Translational Research (UL1TR000001), Miami Clinical and Translational Science Institute (1UL1TR000460), Tufts Clinical and Translational Science Institute (UL1TR001064), and the University of Rochester Clinical and Translational Science Institute (UL1TR000042). Finally, this paper represents the work of many people across the entire CTSA Consortium. See Appendix2 for a list of the individuals who participated. Their contributions were invaluable.

Declaration of Interest

None.

Appendix 1: ECRPTQ’s Competency Domains and Competency Statements

Scientific Concepts and Research Design

  1. (1) Demonstrate knowledge of the foundational science behind interventional and diagnostic approaches.

  2. (2) Identify important scientific questions derived from prior knowledge that are potentially testable clinical research hypotheses.

  3. (3) Explain elements of study design.

    S/BR Working Group suggested edit: evaluate the elements of clinical and translational study design.

  4. (4) Design a clinical trial that operationalizes a testable hypothesis.

  5. (5) Critically analyze study results.

Ethical and Participant Safety Considerations

  1. (1) Differentiate between standard of care and clinical trial activities.

  2. (2) Define the concepts “clinical equipoise” and “therapeutic misconception” as related to the conduct of a clinical trial.

  3. (3) Apply relevant principles of human subject protections and privacy throughout all stages of a clinical trial.

  4. (4) Define vulnerable populations and additional safeguards needed for protection of those populations.

  5. (5) Explain how inclusion and exclusion criteria are included in a clinical trial protocol to assure human subject protection.

  6. (6) Summarize the principles of distributive justice through selection and engagement with clinical trial participants.

Investigational Products Development and Regulation

  1. (1) Describe the regulatory responsibilities of the various institutions participating in the investigational product development process.

  2. (2) Summarize the legislative and regulatory framework that supports the development and registration of investigational products and ensures their safety, efficacy, and quality.

  3. (3) Assess and apply manufacturing, chemistry, and engineering studies combined with preclinical study data to evaluate risk, effects, and use of an investigational product.

  4. (4) Describe appropriate control, storage, and dispensing of investigational products.

  5. (5) Describe specific processes and phases that must be followed to satisfy regulatory requirements.

  6. (6) Explain the safety reporting requirements of regulatory agencies.

  7. (7) Appraise the issues generated and the effects of global expansion on the approval and regulation of investigational products.

  8. (8) Differentiate the roles and responsibilities of the sponsor, investigator, and supporting study team for investigational product development.

Clinical Trial Operations

  1. (1) Explain how the design, purpose, and conduct of individual clinical trials fit into the goal of achieving a new intervention.

  2. (2) Describe the roles and responsibilities of the clinical investigation team as defined by GCP guidelines.

    S/BR Working Group suggested edit: describe the roles and responsibilities of the clinical investigational team.

  3. (3) Evaluate the conduct and documentation of clinical trials as required for compliance with GCP guidelines.

  4. (4) Compare and contrast the regulations and guidelines of global regulatory bodies relating to the conduct of clinical trials.

  5. (5) Describe appropriate control, storage, and dispensing of investigational products.

  6. (6) Differentiate the types of AEs that occur during clinical trials, understand the identification process for AEs, and describe the reporting requirements to IRBs/IECs, sponsors, and regulatory authorities.

  7. (7) Describe how international regulations and guidelines assure human subject protection and privacy during the conduct of clinical trials.

  8. (8) Describe the reporting requirements relating to clinical trial safety.

  9. (9) Describe the purpose and process for monitoring clinical trials.

  10. (10) Describe the purpose and process of clinical trial audits.

  11. (11) Describe the various methods by which safety issues are identified and managed during the phases of clinical trials.

Study and Site Management

  1. (1) Describe the methods utilized to determine whether or not to sponsor, supervise, or participate in a clinical trial.

    S/BR Working Group suggested edit: assess proposed clinical trial for feasibility and scope, given available time and resources.

  2. (2) Develop and manage the financial, timeline, and personnel resources necessary to conduct a clinical trial.

    S/BR Working Group suggested edit: develop and manage the financial and cross-disciplinary personnel resources needed for a clinical trial.

  3. (3) Recognize the management and training approaches to mitigate risk to improve clinical trial conduct.

    S/BR Working Group suggested edit: evaluate clinical trial risk and determine training to mitigate risk and improve study quality in the context of applicable regulations.

  4. (4) Develop strategies to manage participant recruitment, study activities, and track progress.

  5. (5) Identify the legal and regulatory responsibilities, liabilities, and accountabilities that are involved in the conduct of clinical trials.

  6. (6) Identify and explain the specific procedural, documentation, and oversight requirements of PIs, sponsors, contract research organizations, and regulatory authorities.

S/BR Working Group suggested edit: identify and explain the specific procedural, documentation, and oversight requirements of PIs, sponsors, and regulatory authorities related to the conduct of a clinical trial.

Data Management and Informatics

  1. (1) Describe the role of statistics and informatics.

  2. (2) Describe the flow and management of data through a clinical trial.

  3. (3) Describe and assess best practices and the importance of informatics for standardizing data collection, capture, management, and analysis.

  4. (4) Describe and develop processes for data quality assurance.

Leadership, Professionalism, and Team Science

  1. (1) Apply the principles and practices of leadership in management and mentorship.

  2. (2) Identify, analyze, and address ethical and professional conflicts associated with the conduct of clinical trials.

  3. (3) Identify and apply professional guidelines and codes of ethics as they relate to the conduct of clinical trials.

  4. (4) Recognize the potential effects of cultural diversity and the need for cultural competency in the design and conduct of clinical trials.

  5. (5) Describe the methods necessary to work effectively with multidisciplinary and interprofessional research teams.

Communication

  1. (1) Discuss the relationship and appropriate communication between sponsor, contract research organizations, and clinical research site.

  2. (2) Describe the component parts of a traditional scientific publication.

  3. (3) Effectively communicate the content and relevance of clinical trial findings to colleagues, advocacy groups, and the non-scientist community.

Appendix 2: ECRPTQ Phase II Working Group Membership

Working Group 1: Scientific Concepts and Research Design

Co-leads:

Janice Gabrilove, Conduits: The Institutes for Translational Sciences at Icahn School of Medicine at Mount Sinai

Rosemarie Gagliardi, Conduits: The Institutes for Translational Sciences at Icahn School of Medicine

Members:

Paul Braunschweiger, CITI

Rebecca Brouwer, Duke Translational Medicine Institute

Alecia Fair, Vanderbilt University

Barbara Hammack, Colorado Clinical & Translational Sciences Institute

Carlton Hornung, Consortium of Academic Programs in Clinical Research

Beth Kerling, Frontiers: The Heartland Institute for Clinical and Translational Research

Laurie S. Lester, Dartmouth SYNERGY Clinical and Translational Science Institute

Lionel D. Lewis, Dartmouth SYNERGY Clinical and Translational Science Institute

Amy Overby University of New Mexico Clinical & Translational Science Center

Andi Shane, The Atlanta Clinical & Translational Science Institute

Laura Weisel, Harvard Catalyst: Clinical and Translational Science Center

Tet-Kin Yeo, The University of Chicago Institute for Translational Medicine

Working Group 2: Ethical and Participant Safety Considerations

Lead:

Alison Antes, Washington University, St. Louis, Institute of Clinical and Translational Sciences

Members:

Jaime Arango, CITI

Jennifer Ayala, Institute for Clinical and Translational Research at Einstein and Montefiore

James Bernat, Dartmouth SYNERGY Clinical and Translational Science Institute

Barbara Bierer, Harvard Catalyst: Clinical and Translational Science Center

Angela Braggs-Brown, University of Cincinnati Center for Clinical & Translational Science & Training

Emily Anderson, University of Illinois at Chicago, Center for Clinical and Translational Science

Kristin Brierley, University of Michigan Health System

Jennifer Swanton Brown, The Stanford Center for Clinical and Translational Education and Research

Nancy Calvin-Naylor, Michigan Institute for Clinical & Health Research

Juan Cordero, Weill Cornell Clinical and Translational Science Center

Joshua Crites, Penn State Institute for Translational Medicine and Therapeutics

Scott Denne, The Indiana Clinical and Translational Science Institute

Laura Denton, University of Michigan Medical School

Brenda Eakin, Michigan Institute for Clinical & Health Research

Gail Glenn, Institute for Clinical and Translational Research at Einstein and Montefiore

Michelle Jenkerson, Washington University, St. Louis, Institute of Clinical and Translational Sciences

Nancy Lowe, Conduits: The Institutes for Translational Sciences at Icahn School of Medicine

Micaela Martinez, University of California-Irvine Institute for Clinical and Translational Science

Karen Moe, University of Washington Institute of Translational Health Sciences

Tammy Neseth, Mayo Clinic Center for Clinical and Translational Science

Tracy Ohrt, University of Wisconsin Institute for Clinical and Translational Research (UW ICTR)

Jesica Pagano-Therrien, UMass Center for Clinical and Translational Science

Carson Reider, Ohio State University, Center for Clinical and Translational Science

Linda Rice, University of Kentucky (UK), Center for Clinical and Translational Science

Fredika Robertson, Virginia Commonwealth University Center for Clinical and Translational Research

Susan Rose, Southern California Clinical and Translational Science Institute

Laurie Shaker-Irwin, University of California, Los Angeles, Clinical and Translational Science Institute

Kelly Unsworth, University of Rochester, Clinical and Translational Science Institute

Lisa Wilson, University of California, Davis, Clinical and Translational Science Center

Working Group 3: Investigational Products Development and Regulation

Co-leads:

Kevin Weatherwax, Michigan Institute for Clinical and Health Research

Blair Holbein, UT University of Texas Southwestern Center for Translational Medicine

Members:

Bridget Adams, Oregon Clinical & Translational Research Institute

Christine Annis, University of Rochester Clinical and Translational Science Institute

Warren Capell, Colorado Clinical and Translational Sciences Institute

Brenda Eakin, Michigan Institute for Clinical and Health Research

Corey Ford, University of New Mexico Clinical & Translational Science Center

James Giordano, Georgetown-Howard Universities Center for Clinical and Translational Science

Ann Glasse, Miami Clinical and Translational Science Institute

Penny Jester, University of Alabama at Birmingham Center for Clinical and Translational Science

Hellen Kim, University of Texas Health Science Center San Antonio

Margaret Koziel, UMass Center for Clinical & Translational Science

Lionel D. Lewis, Dartmouth SYNERGY Clinical and Translational Science Institute

Katherine Luzuriaga, UMass Center for Clinical & Translational Science

Catherine Raimond, Conduits: The Institutes for Translational Sciences at Icahn School of Medicine

Elizabeth Ripley, Virginia Commonwealth University Center for Clinical and Translational Research

Lynn Rose, Washington University, St. Louis, Institute of Clinical and Translational Sciences

Milana Solganik, University of Minnesota Clinical and Translational Science Institute

Working Group 4: Clinical Trial Operations

Co-leads:

Mina Busch, Cincinnati Children’s Hospital Medical Center, University of Cincinnati Center for Clinical & Translational Science & Training

Sharon Rosenberg, Northwestern University Clinical and Translational Sciences Institute

Members:

Susan Anderson, Yale Center for Clinical Investigation

Rebecca Brouwer, Duke Translational Medicine Institute

Valorie Buchholz, North Carolina Translational and Clinical Sciences Institute

Christy Byks-Jazayeri, Michigan Institute for Clinical and Health Research

Virina De Jesus, University of California, Davis, Clinical and Translational Science Center

Debra Dykhuis, University of Minnesota Clinical and Translational Science Institute

Mara Horwitz, University of Pittsburgh Clinical and Translational Science Institute

Darlene Kitterman, Oregon Clinical & Translational Research Institute

Susan Murphy, Michigan Institute for Clinical and Health Research

Roxanne Pritchard, Clinical & Translational Science Institute of Southwestern Wisconsin

Mary Ratliff, Northwestern University Clinical and Translational Sciences Institute

Mary-Tara Roth, Boston University Clinical and Translational Science Institute

Inna Strakovsky, University of Pennsylvania Institute for Translational Medicine and Therapeutics

Sally Jo Zuspan, University of Utah Center for Clinical and Translational Science

Working Group 5: Study and Site Management

Co-leads:

Terry Ainsworth, Duke Translational Medicine Institute

Nancy Needler, University of Rochester Clinical and Translational Science Institute

Members:

Jennifer Ayala, Institute for Clinical and Translational Research at Einstein and Montefiore

Donna Brassil, Rockefeller University Center for Clinical and Translational Science

Kristin Brierley, University of Michigan Health System

Kersten Brinkworth, University of Washington Institute of Translational Health Sciences

Jeri Burr, Utah Center for Clinical and Translational Science

Melissa Byrn, University of Pennsylvania Institute for Translational Medicine and Therapeutics

Stephanie deRijke, Atlanta Clinical & Translational Science Institute

Michelle Doyle, University of Washington Institute of Translational Health Sciences

Cynthia Dwight, Indiana Clinical and Translational Science Institute

Elizabeth Galgocy, Penn State Clinical and Translational Science Institute

Terri Hinkley, Association of Clinical Research Professionals

Megan Hoffman, University of Minnesota Clinical and Translational Science Institute

Tracy Hysong, University of California, Davis, Clinical and Translational Science Center

Amy Jenkins, University of Arkansas for Medical Sciences Translational Research Institute

Penny Jester, University of Alabama at Birmingham Center for Clinical and Translational Science

Dan Kolk, UW ICTR

Kate Marusina, University of California, Davis, Clinical and Translational Science Center

Gena Monroe, University of Texas Health Science Center San Antonio

Mandy Morneault, ITHS

Caroline Murray, Frontiers: The Heartland Institute for Clinical and Translational Research

Heike Newman, Colorado Clinical and Translational Sciences Institute

Clare Tyson, South Carolina Clinical & Translational Research Institute

Karen Weavers, Mayo Clinic Center for Clinical and Translational Science

Tet-Kin Yeo, University of Chicago Institute for Translational Medicine

Working Group 6: Data Management and Informatics

Co-leads:

David Fenstermacher, Virginia Commonwealth University Center for Clinical and Translational Science

Carolyn Apperson-Hansen, Clinical and Translational Science Collaborative of Cleveland

Members:

Cindy Casaceli, University of Rochester Clinical and Translational Science Institute

Bari Dzomba, Penn State Clinical and Translational Science Institute

Stephanie Gentilin, South Carolina Clinical & Translational Research Institute

Carlton Hornung, Consortium of Academic Programs in Clinical Research

Bernie LaSalle, Utah Center for Clinical and Translational Science

Laurie Lester, Dartmouth SYNERGY Clinical and Translational Science Institute

Angela Lyden, University of Michigan

Karen McCracken, Oregon Clinical & Translational Research Institute

Arash Naeim, University of California, Los Angeles, Clinical and Translational Science Institute

Tracy Ohrt, University of Wisconsin Institute for Clinical and Translational Research

David Weitzenkamp, Colorado Clinical and Translational Sciences Institute

Working Group 7: Leadership and Professionalism

Co-leads:

Eric P. Rubinstein, University of Rochester Clinical and Translational Science Institute

Michelle M. Wartak, Tufts Clinical and Translational Science Institute

Members:

Wajeeh Bajwa, University of Florida Clinical and Translational Science Institute

Christy Byks-Jazayeri, Michigan Institute for Clinical & Health Research

Paulla Dennis, Ohio State University Center for Clinical and Translational Science

Edward Ellerbeck, Frontiers: The Heartland Institute for Clinical and Translational Research

Nancy S. Green, Columbia University Irving Institute for Clinical and Translational Research

Lourdes Guerrero, University of California, Los Angeles, Clinical and Translational Science Institute

Sara Horn, Penn State Clinical and Translational Science Institute

Tracy A. Hysong, University of California, Davis, Clinical and Translational Science Center

Tesheia Johnson, Yale Center for Clinical Investigation

Rhonda G. Kost, Rockefeller University Center for Clinical and Translational Science

Michelle M. Lamere, University of Minnesota Clinical and Translational Science Institute

Lois J. Mannon, New York University—Health & Hospitals Corporation Clinical and Translational Science Institute

Paul J. Martin, University of Washington, ITHS

Jennifer A. Miner, University of Michigan Health System

Stephanie Nasatka, Johns Hopkins Institute for Clinical and Translational Research

Claudia S. Plottel, New York University—Health & Hospitals Corporation Clinical and Translational Science Institute

Jenna Rouse, Association of Clinical Research Professionals

Mary Simmerling, Weill Cornell Clinical and Translational Science Center

Gerald Stacy, Johns Hopkins Institute for Clinical and Translational Research

Working Group 8: Communication

Co-leads:

Carolynn Thomas Jones, Consortium of Academic Programs in Clinical Research, Ohio State University

Robert Kolb, University of Florida, Clinical and Translational Science Institute

Scott Gee, Northwestern University, Clinical and Translational Sciences Institute

Members:

Barbara Bixby, Scripps Translational Science Institute

Alison Lakin, Colorado Clinical & Translational Sciences Institute

Leslie McHale, Weill Cornell Clinical and Translational Science Center

James Spilsbury, Clinical and Translational Science Collaborative of Cleveland

Eunice Stephens, University of California, San Francisco, Clinical and Translational Science Institute

Denise Windenburg, University of Minnesota Clinical and Translational Science Institute

Working Group 9: Teamwork and Team Science

Co-leads:

Jan Fertig, Clinical and Translational Science Institute of Southeast Wisconsin

Jonelle Wright, Miami Clinical and Translational Science Institute

Kay Wilson, Michigan Institute for Clinical and Health Research

Members:

Lise Anderson, Michigan Institute for Clinical and Health Research

Christine Annis, University of Rochester Clinical and Translational Science Institute

Heather Bryant, Michigan Institute for Clinical and Health Research

Sue Burhop, Michigan Institute for Clinical and Health Research

Lisa Cicutto, Colorado Clinical and Translational Sciences Institute

Janice Gabrilove, Conduits: The Institutes for Translational Sciences at Icahn School of Medicine at Mount Sinai

Chrystal Johnson, University of Chicago Institute for Translational Medicine

Pat Karausky, University of Pittsburgh Clinical and Translational Science Institute

Victoria King, University of Kentucky Center for Clinical and Translational Science

Joel Kline, University of Iowa Institute for Clinical and Translational Science

Rachel Lally, Irving Institute for Clinical and Translational Research, Columbia University

Angela Lyden, University of Michigan

Paul J. Martin, University of Washington Institute of Translational Health Sciences

Rebecca Ozl, Johns Hopkins Institute for Clinical and Translational Research

Catherine Radovich, Michigan Institute for Clinical and Health Research

Sharon Shriver, Penn State Clinical and Translational Science Institute

Joel Tsevat, University of Cincinnati Center for Clinical & Translational Science & Training

S/BR Working Group

Co-leads:

Susan Murphy, Michigan Institute for Clinical & Health Research

Christy Byks-Jazayeri, Michigan Institute for Clinical & Health Research

Members:

Lise Anderson, Michigan Institute for Clinical and Health Research

Rebecca Brouwer, Duke Translational Medicine Institute

Nancy Calvin-Naylor, Michigan Institute for Clinical & Health Research

Laura Denton, University of Michigan Medical School

Edward F. Ellerbeck, Frontiers: The Heartland Institute for Clinical and Translational Research

Nicole Exe, Michigan Institute for Clinical & Health Research

Alecia Fair, Vanderbilt University

Terri Hinkley, Association of Clinical Research Professionals

Penny Jester, University of Alabama at Birmingham, Center for Clinical and Translational Science

Valerie Kahn, University of Michigan Medical School

Laurie Lester, Dartmouth SYNERGY Clinical and Translational Science Institute

Angela Lyden, University of Michigan

Alison Miller, Michigan Institute for Clinical and Health Research

Jennifer A. Miner, University of Michigan Medical School

James Spilsbury, Clinical and Translational Science Collaborative of Cleveland

Catherine Radovich, Michigan Institute for Clinical and Health Research

Susan Rose, Southern California Clinical and Translational Science Institute

Mary-Tara Roth, Boston University, Clinical and Translational Science Institute

Jenna Rouse, Association of Clinical Research Professionals

Kelly Unsworth, University of Rochester, Clinical and Translational Science Institute

References

1. Institute of Medicine. Envisioning a Transformed Clinical Trials Enterprise in the United States: Establishing an Agenda for 2020: Workshop Summary. Washington, DC: The National Academies Press, 2012.Google Scholar
2. Khin, NA, et al. Regulatory and scientific issues regarding use of foreign data in support of new drug applications in the United States: an FDA perspective. Clinical Pharmacology and Therapeutics 2013; 94: 230242.Google Scholar
3. Seltzer, J. Increasing the efficiency of GCP training: recommendations from the Clinical Trials Transformation Initiative. Presented at 2nd National Working Group Meeting for Enhancing Clinical Research Professional Training and Qualifications, February 10, 2015, Dallas, TX.Google Scholar
4. Hendricson, WD. Appropriate Assessments for Competency-Based Education. Washington, D.C.: American Dental Education Association, 2008.Google Scholar
5. Sonstein, SA, et al. Moving from compliance to competency: a harmonized core competency framework for the clinical research professional. Clinical Researcher 2014; 3: 1723.Google Scholar
6. Boahin, PHW. Perceived effects of competency-based training on the acquisition of professional skills. International Journal of Educational Development 2014; 36: 8189.Google Scholar
7. Society, ON. Oncology clinical trials nurse competencies 2010. [Internet]. 2010 [cited May 3, 2016]. (https://www.ons.org/sites/default/files/ctncompetencies.pdf)Google Scholar
8. Royal College of Nursing. Research nurse competency framework [Internet]. Royal College of Nursing, London, UK, 2011 [cited May 13, 2016]. (http://cambridge.crf.nihr.ac.uk/wp-content/uploads/2015/04/Research_Nurse_Competency_Framework_-_Version_2_-_Full_-_Oct_20111.pdf)Google Scholar
9. CRN 2010 Domain of Practice Committee. Building the foundation for clinical research nursing: domain of practice for the specialty of clinical research nursing [Internet]. National Institutes of Health Clinical Center, Nursing and Patient Care Services, Bethesda, MD, 2009 [cited May 3, 2016]. (http://www.cc.nih.gov/nursing/crn/DOP_document.pdf)Google Scholar
10. Ehrenberger, HE, Lilington, L. Development of a measure to delineate the clinical trials nursing role. Oncology Nursing Forum 2004; 31: E64E68.Google Scholar
11. Castro, K, et al. Validating the clinical research nursing domain of practice. Oncology Nursing Forum 2011; 38: E72E80.Google Scholar
12. Bevans, M, et al. Defining clinical research nursing practice: results of a role delineation study. Clinical and Translational Science 2011; 6: 421427.Google Scholar
13. Jones, CT, Wilson, LL. Role perceptions of nurse clinical research coordinators. Nursing: Research and Reviews 2013; 3: 133139.Google Scholar
14. Jones, CT, Wilson, LL. Clinical research nurses’ perceptions of research activities performed by unsupervised non-nurse clinical research coordinators. The Monitor 2014; 28: 1219.Google Scholar
15. Clinical and Translational Science Awards. Core competencies for clinical and translational research [Internet]. 2011 [cited May 3, 2016]. (https://ctsacentral.org/consortium/best-practices/335-2)Google Scholar
16. Silva, H, et al. Alignment of competencies to address inefficiencies in medicines development and clinical research: need for inter-professional education. Pharmaceutical Medicine 2015; 29: 131140.Google Scholar
17. Jones, CT, et al. Defining competencies in clinical research: issues in clinical research education. Research Practitioner 2012; 12: 99107.Google Scholar
18. Bloom, BS, et al. Taxonomy of Educational Objectives: The Classification of Educational Goals. Volume I: Cognitive Domain. New York: May; 1956.Google Scholar
19. Sonstein, S. Moving from compliance to competency: a harmonized core competency framework for the clinical research professional. Presentation and live webinar at the University of Florida, November 17, 2015, Gainesville, FL.Google Scholar
Figure 0

Table 1 JTF Core Competencies

Figure 1

Table 2 Summary of existing education and trainings