Hostname: page-component-586b7cd67f-t8hqh Total loading time: 0 Render date: 2024-11-25T01:32:06.231Z Has data issue: false hasContentIssue false

Translating the learning sciences into practice: A primer for clinical and translational educators

Published online by Cambridge University Press:  19 August 2021

Marie K. Norman*
Affiliation:
Innovative Design for Education and Assessment (IDEA) Lab, Institute for Clinical Research Education, University of Pittsburgh, Pittsburgh, PA, USA
Gaetano R. Lotrecchiano
Affiliation:
Department of Clinical Research and Leadership, Instructional Core for Advocacy, Research, and Excellence In Teaching and Learning (ICare), George Washington University School of Medicine and Health Sciences, Washington, DC, USA
*
Address for correspondence: M.K. Norman, PhD, Innovative Design for Education and Assessment (IDEA) Lab, Institute for Clinical Research Education, University of Pittsburgh, Pittsburgh, PA, USA. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

The learning sciences have yielded a wealth of insights about the mechanisms and conditions that promote learning, yet the findings from this body of research often do not make their way into educational practice. This fundamentally translational problem is one we believe that educators from translational fields, with their evidence-based orientation and familiarity with the challenges and importance of translation, are well-positioned to address. Here, we provide a primer on the learning sciences to guide educators in the Clinical and Translational Science Institutes and other organizations that train translational researchers. We (a) describe the unique teaching and learning environment in which this training occurs, and why it necessitates attention to learning research and its appropriate application, (b) explain what the learning sciences are, (c) distill the complex science of learning into core principles, (d) situate recent developments in the field within these principles, and (e) explain, in practical terms, how these principles can inform our teaching.

Type
Review Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2021. Published by Cambridge University Press on behalf of The Association for Clinical and Translational Science

Introduction

Almost a century of research on the brain and cognition has yielded a wealth of insights into how people learn – insights that can inform how we teach and train learners [Reference Bransford1,2]. With a deeper understanding of the factors that affect learning, from the mechanics of memory to the conditions that spark and sustain motivation to the role of emotion in cognition, one would expect educators to be better positioned than ever before to teach effectively. Yet, it is disconcerting how inconsistently learning research makes its way into educational practice [Reference Mintzes and Walter3Reference Stanovich and Stanovich10].

Disconcerting, perhaps, but is it surprising? As academics involved in translational research, we know all too well that the process of moving ideas from basic research in controlled conditions to application in the complex, messy real world is far from easy or automatic [Reference Austin11Reference Garcia, Polegato and Zornoff13]. To do so effectively, bridges need to be built: key operational principles must be identified [Reference Austin11], complexity must be grappled with [Reference Seyhan12], technical language must be deciphered and made comprehensible to stakeholders [Reference DeWitt14], facilitators to implementation must be identified and barriers removed [Reference Brownson, Proctor and Luke15,Reference Emmons and Colditz16]. We also understand the critical importance and high stakes of translational pursuits and know that, without these bridges, important findings and insights from basic research languish in technical journals and are never used to improve practice or policy [Reference Jiang, Zhang, Wang and Shen17].

What’s more, because of our familiarity with the processes of translation and implementation, we may be especially well-suited to the work of bringing learning research into educational practice. We are evidence-based in our orientation, accustomed to working across disciplines to find effective approaches to complex problems, trained to find bridges between research and application, and firmly committed to educating and training the next generation of researchers. Moreover, because we are facing seismic shifts in the educational environment – a sudden move to remote and hybrid modalities, changing student populations, and an ever-broadening range of educational technologies – that demand constant innovation and adaptation [Reference Sharp, Norman, Spagnoletti and Miller18Reference Rose20], we understand the need to build new educational practices on a solid, evidence-based foundation.

Our goal in this article is to provide a primer on the learning sciences – new for some; a review for others – to guide us in this fundamentally translational process. We will (a) describe the teaching and learning environment in which translational researchers are trained, and explain why it necessitates an understanding of learning research, (b) explain what the learning sciences are and why they matter, (c) distill the complex science of learning into a set of basic principles, (d) situate recent developments in the field within these principles, and (e) explain, in practical terms, how these principles and insights can inform teaching and learning in our unique educational environment.

Our Unique Educational Environment

Since their creation in 2006, the Clinical and Translational Science Institutes (CTSIs) have played a vital role in training and supporting the next generation of clinical and translational researchers [Reference Leshner, Terry, Schultz and Liverman21Reference Dilmore, Moore and Bjork24]. Although surprisingly little has been written about learners in the CTSIs and in other organizations that train the translational workforce, we know that learners include graduate students, residents, fellows, faculty, research staff, and community collaborators [Reference Brishke, Evans and Shenkman25]. They bring with them considerable prior education (bachelor’s degrees at minimum and often medical, master’s, and doctoral degrees) as well as deep expertise in their fields [Reference Oster, Devick and Thurston26,Reference Yin, Gabrilove and Jackson27]. They tend to have concrete goals for their learning and seek the development of specific, practical skills. Educators also come from a wide variety of fields and departments, from surgery to social work to engineering. The same people who occupy the roles of teacher and student in one context may be colleagues and collaborators in another context, creating a somewhat flattened hierarchy atypical of academic medicine [Reference Whitelaw, Kalra and Van Spall28,Reference Conrad, Carr, Knight, Renfrew, Dunn and Pololi29]. This promotes a high degree of collegiality among instructors and learners.

Translational science is taught in a range of contexts, including credit-bearing courses in master’s, PhD, and certificate programs; training programs for early career investigators; professional development workshops and seminars in areas such as mentorship [Reference Nearing, Nuechterlein, Tan, Zerzan, Libby and Austin30,Reference Pfund, House and Asquith31], leadership [Reference Vaughan, Romanick, Schlesinger, Kost, Drassil and Coller32Reference Straus, Soobiah and Levinson34], equity and inclusion [Reference Rubio, Mayowski and Norman35,Reference Estape, Quarshie and Segarra36], teamwork and team science [Reference Hall, Feng, Moser, Stokols and Taylor37Reference Mayowski, Norman, Schenker, Proulx and Kapoor39]; and in the informal space of mentor–mentee relationships and interdisciplinary collaborations [Reference David, Kochan, Lunsford, Dominquez and Haddock-Millar40]. Both formal and informal curricula in the CTSIs tend to be practical rather than theoretical, focused on skill-building in discrete competency areas (e.g., statistical knowledge, grantsmanship, qualitative research skills [Reference Robinson, Moore, McTigue, Rubio and Kapoor41,Reference Mayowski, Norman and Kapoor42]). Since the COVID-19 pandemic, we – along with the rest of higher education – have seen a shift in learning modalities toward online and hybrid programming that may become more permanent [Reference Sharp, Norman, Spagnoletti and Miller18,Reference Lau and Dasgupta43].

These unique elements of the teaching and learning environment, in particular the focus on teaching adult learners in diverse and generally interdisciplinary contexts, should be foremost in our minds as we consider how to apply the rich science of learning to our educational pursuits.

What Are the Learning Sciences and Why Do They Matter?

For such a widely used term, “learning” has proven remarkably difficult to pin down [Reference Barron, Hebets, Cleland, Fitzpatrick and Hauber44,Reference De Houwer, Barnes-Holmes and Moors45]. Most definitions describe a process of change, prompted by experience, that increases knowledge [Reference Garvin46]. It is not a change that happens to learners passively but rather something that learners must make happen by reflecting on the experience and forming and testing mental models [Reference Dewey47,Reference Vygotsky and Kozulin48]. Learning is understood to be an interior process that cannot be measured directly but must be inferred through behavior [Reference Soderstrom and Bjork49]. Performance, in other words, serves as a proxy for learning. Many researchers situate the locus of learning within individuals; however, others locate learning in social interactions [Reference Bransford1,Reference Vygotsky and Kozulin48,Reference Rogoff50Reference Roth and Jornet52], a formulation that has been extended to describe learning at the level of teams and organizations [Reference Argyris53,Reference Senge54].

The term “learning sciences” emerged in the 1990s to describe an interdisciplinary field of research that seeks to understand the mechanisms by which learning occurs in real-world situations and to identify and encourage practices that facilitate learning [Reference Sommerhoff, Szameitat, Vogel, Chernikova, Loderer and Fischer55,Reference Sawyer56]. The learning sciences are inherently interdisciplinary, drawing on a diverse array of fields including cognitive and developmental psychology, neuroscience, computer science, sociology, and anthropology [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57].

Among other things, the learning sciences have challenged long-standing myths about teaching and learning [Reference Holmes and Richmond58Reference Christodoulou61]. Among these myths is the belief that subject matter expertise is sufficient to make one an effective teacher [Reference Hattie and Yates62], that increasing content increases learning [Reference Luckie, Aubry, Marengo, Rivkin and Foos63,Reference Deslauriers, McCarty, Miller, Callaghan and Kestin64], that lecturing by itself is an effective teaching strategy [Reference Freeman and Eddy4,65], and that it is important to diagnose and teach to specific learning styles [Reference Pashler, McDaniel, Rohrer and Bjork59,Reference Willingham66,Reference Royal and Stockdale67]. None of these beliefs is supported by evidence. Teaching requires knowledge and skills entirely distinct from subject matter expertise. Less content, accompanied by opportunities for active engagement, contributes to deeper learning and longer retention [Reference Freeman and Eddy4]. Similarly, lectures yield poor learning results relative to active learning, and should be used advisedly [Reference Freeman and Eddy4,Reference Mallin68]. Moreover, although many educators tout the importance of adjusting their teaching strategies to students’ individual learning styles, there is little in the research literature to support that approach. Indeed, “learning styles” are generally little more than context-dependent preferences and not stable states; thus, researchers agree that instructors are better off adjusting their teaching strategies to the content rather than to students’ professed learning styles [Reference Pashler, McDaniel, Rohrer and Bjork59,Reference Galagan69Reference Kirschner72].

In addition to expanding research on learning and debunking myths, the learning sciences have sought to distill existing research (often highly technical in its original form) into core principles and practical strategies to guide teaching practice. These distillations have yielded principles of adult learning [Reference Knowles73], principles to promote deeper learning and knowledge retention [Reference Brown, Roediger and McDaniel74Reference Willingham76], multimedia design principles [Reference Mayer77], principles of social learning [Reference Bandura78], and theories of applied intelligence [Reference Sternberg, Kaufman and Grigorenko79], among others. Each framework organizes the complex literature in somewhat different ways, with different foci and intended audiences, and all are valuable. For the purposes of this article, we have loosely adapted the framework set out in Ambrose et a l[Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. This framework, which synthesizes half a century of literature on learning, identifies a basic set of principles to help educators understand how learning works, as well as how to use that understanding to teach more effectively. The principles are not specific to any discipline or student level, and thus apply across learning contexts and modalities. Moreover, they are sufficiently broad to encompass new discoveries and formulations, such as work in the areas of cognitive load and social presence, which we have also included.

For simplicity, we have organized these principles into three categories: acquisition and integration of knowledge, social and emotional components of learning, and elements of skill-building. In the following sections, we describe the research that informs each area and explain how it relates to the specific learning environments in which translational researchers are educated.

Acquisition and Integration of Knowledge

Four areas of the learning sciences shed light on how knowledge is acquired and integrated. They concern the role of prior knowledge, knowledge organizations, cognitive load, and metacognition.

Prior Knowledge

All learning builds on prior knowledge [Reference Ausubel80Reference Fyfe and Rittle-Johnson82]. Indeed, learning only occurs when learners connect what they are learning to what they already know or have experienced. In the case of adult learners, who bring significant academic, professional, and life experience into new learning situations, there is a strong knowledge foundation on which to build and one that educators should not neglect. However, gaps and deficits in prior knowledge can also impede learners’ ability to integrate new knowledge and may be particularly important to recognize and address in interdisciplinary learning environments, where students and trainees come from different academic and professional backgrounds and do not all possess the same baseline knowledge. The interdisciplinarity of institutions and departments focused on translational education may also create other learning challenges, including the inappropriate application of prior knowledge. Specifically, learners may apply knowledge gained in one context (e.g., prior degree programs) in contexts where it is not relevant or applicable [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. (One example, for instance, is importing concepts of bias and generalizability from quantitative fields into qualitative research, which operates on very different terms.) Both knowledge gaps and misapplied prior knowledge are issues that educators should be aware of and look to remediate.

  • Advice for educators: Help learners connect what they are learning to what they already know and have experienced, but also pay close attention to – and address – what they do not know, apply in the wrong context, and believe in error.

Organization of Knowledge

Learning involves not only what learners know but how they organize what they know. The ways that knowledge is organized determines how easily it can be retrieved and how effectively it can be used [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57,Reference Chi, Feltovich and Glaser83]. However, the organizational frameworks of experts and novices differ markedly [Reference Chi, Feltovich and Glaser84,Reference Bradshaw and Anderson85]. Expert knowledge is richly connected [Reference Bradshaw and Anderson85], making it possible for experts (including teachers) to readily see how ideas are linked. Moreover, experts organize what they know around the deep structures and underlying principles of problems and cases, rather than superficial similarities [Reference Chi, Feltovich and Glaser83]. Experts also possess multiple organizational frameworks, which allow them to sort information in different ways for different purposes and facilitates the transfer of that knowledge to new situations [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. Expert/novice differences are important to recognize in the context of teaching and learning. As experts in their fields, educators – even at the graduate level – cannot assume their learners naturally possess these organizational structures. Rather, part of the task of educators is to help learners develop similarly meaningful and flexible knowledge organizations [Reference Gentner, Loewenstein, Thompson and Forbus86,Reference Chi and VanLehn87].

  • Advice for educators: In addition to imparting information, provide organizational frameworks and schemas to help learners organize their growing knowledge in meaningful and practical ways. Also, ask questions that require learners to make and articulate connections, thus growing their neural networks [Reference Elio and Scharf88].

Cognitive Load

Recognition of the limitations of working memory has been one of the most important discoveries to come out of the learning sciences [Reference Klingberg89]. Working memory is the cognitive system responsible for manipulating, encoding, and organizing new information before it is ultimately moved into long-term memory. While long-term memory is capacious, with almost limitless space (think: the Library of Congress), the cognitive resources available for processing information in working memory are highly limited (think: your physical desktop) and must be husbanded carefully. Cognitive load theory focuses on ways to make optimal use of working memory for learning [Reference Sweller, Ayres and Kalyuga90,Reference Kalyuga and Sweller91]. Scholars in this area have differentiated between intrinsic, germane, and extraneous cognitive load. Intrinsic cognitive load refers to the cognitive resources required by a task itself (e.g., reading a journal article). Germane cognitive load refers to the cognitive resources required to generate meaningful connections or develop a schema (e.g., connecting the content of one journal article to others). Extraneous cognitive load refers to cognitive resources eaten up by incidental or unnecessary factors (e.g., the confusing directions of an instructor) [Reference Sweller92,Reference Klepsch and Seufert93]. Learning scientists agree that instructors should minimize extraneous cognitive load while maximizing germane cognitive load [Reference Sweller92], in other words, to make sure the difficulty in a task advances learning without draining cognitive resources unnecessarily. Cognitive load theory is particularly applicable in the context of online learning, where poorly organized platforms and unfamiliar technologies can add extraneous cognitive load, potentially eroding motivation and impeding learning [Reference Jochems, JJGv and Koper94Reference Schweppe and Rummer96].

  • Advice for educators: Increase germane cognitive load by assigning tasks and asking questions that compel learners to think harder about the material you are teaching. At the same time, decrease the extraneous cognitive load by making written directions clear and succinct and employing good visual design.

Metacognition

Another critical facet of knowledge acquisition is metacognition or the process by which learners understand, monitor, and refine their own cognitive processes [Reference Rhodes97Reference Osman and Hannafin99]. Ambrose et al represent metacognition as a set of five abilities [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]: first, the ability to realistically and accurately assess the requirements of a task (e.g., the time, resources, and skills required); second, the ability to evaluate one’s own skills and competencies relative to the task requirements; third, the ability to plan appropriately; fourth, the ability to monitor and assess performance as one acts; and fifth, the ability to reflect back on one’s performance after the fact and make adjustments for the future. While one would think that accomplished graduate-level learners typical of the CTSIs and other translational educational contexts have already developed strong metacognitive skills, research indicates that, in fact, adult learners often fail to monitor their own thinking and fall back into familiar patterns and biases that limit their intellectual growth [Reference Kleka, Brycz, Fanslau and Pilarska100]. Research also shows that metacognitive skills can be strengthened considerably and with very positive outcomes for learning if instructors provide structured opportunities for self-evaluation, planning, and reflection on past performance [Reference Perry, Lundie and Golder101,Reference Kramarski and Mevarech102].

  • Advice for educators: Allocate ample time for learners to reflect on their strengths and weaknesses in relation to complex tasks, to assess the demands of those tasks, and to plan their strategy. Allow time at the mid-point of projects for learners to stop, monitor progress, and adjust their approach, and leave time at the end of such tasks for learners to reflect on their performance and plan.

Social and Emotional Components of Learning

Learning is an intensely communal activity that cannot be divorced from the social and interactive contexts in which it occurs [Reference Vygotsky and Kozulin48,Reference Bandura51,Reference Lave and Wenger103]. Indeed, there is increasing recognition that learning is heavily influenced by social and emotional – and not simply cognitive – factors [Reference Cavanagh104], a fact that is even more apparent since the advent of online education [Reference Marmon105,Reference Garrison, Anderson and Archer106], where social connection and community can become attenuated, with detrimental impacts on learning. There is far more to say about the social elements of learning than space here allows. However, four important principles concern the factors that influence motivation, the importance of learners’ developmental stage, the ways in which climate affects learning, and the role of presence, particularly online.

Motivation

Motivation drives the behaviors that result in learning and is thus a critical ingredient in all learning contexts. There are two high-level factors that, taken together, increase learner motivation: value and expectancy [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57,Reference Wildman and Bedwell107]. Value stems from learners’ perceptions that the material they are learning and the tasks they are engaged in are relevant, meaningful, and of practical value. According to the tenets of self-determination theory, three elements increase perceived value: competence (awareness of increasing mastery), relatedness (connection and accountability to other people), and autonomy (a sense of agency and control) [Reference Ryan and Deci108]. Daniel Pink adds to that a sense of purpose [Reference Pink109].

The other factor in motivation is expectancy. Expectancy concerns learners’ beliefs that success is possible: that their efforts are connected to desired goals [Reference Carver and Scheier110], that they are personally capable of achieving those goals [Reference Bandura111], and that the environment will support and not thwart their efforts [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. Learners who believe that a task is unreasonably difficult, that they are personally incapable, or that they do not have adequate support will lose motivation. Both value and expectancy must be present for motivation to be high. If learners value an outcome but do not feel capable of achieving it (high value, low expectancy) they will lose motivation. By the same token, if learners feel capable of achieving a goal but do not value it (low value, high expectancy), motivation will suffer. Notice that both value and expectancy are issues of perception, not objective reality: learners must believe that what they are learning has value and that successful learning is possible. While graduate-level learners often possess a fair degree of intrinsic motivation, instructors should not assume that their motivation will be high for all tasks and activities or that motivation cannot be eroded even when initially high. Considering ways to increase value and expectancy is thus a wise course of action for all educators.

  • Advice for educators: Seek to increase learners’ motivation by highlighting the practical value of what they are learning and reducing factors that erode expectations of success, without compromising high standards. Provide opportunities for learners to exercise autonomy, demonstrate increasing competence, and connect with one another.

Developmental Stage

While the factors that affect learning (e.g., prior knowledge, motivation, metacognition) are the same for students at all life stages, learners themselves differ, as do their learning needs [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. Various stage models have been offered to help educators understand learners at different phases of life. These include Perry’s model of intellectual development, which describes four stages in learners’ ability to tolerate ambiguity and countenance different perspectives on complex issues yet, ultimately, commit to action [Reference Perry112]. Perry’s model has been refined and extended by Baxter-Magolda, who has explored the issue of “self-authorship” across cognitive, interpersonal, and intrapersonal domains of development [Reference Baxter Magolda and King113]. Stage models also include theories of racial identity development [Reference Watson114Reference Boykins117]. While many such models focus on the developmental tasks of traditional college-aged learners [Reference Chickering and Reisser118,Reference Jones and Stewart119], the paradigm with perhaps the most relevance to the educational context of the CTSIs is Knowles’ theory of andragogy [Reference Knowles120Reference Knowles122]: teaching adult learners. Theories of adult learning vary but the primary components are these: Adult learners want to know how the material they are learning serves concrete personal or professional goals [Reference Merriam123,Reference Merriam124]. They learn best by doing, i.e., through practice and participation, preferably through problem-solving [Reference Hagen and Park125]. They bring experiences to the learning encounter that can facilitate learning but also at times cause mental rigidity [Reference Bransford1,Reference Knowles120]. Finally, adult learners do best in informal environments, in which they have a degree of self-direction and control, and where the relationship between instructor and learner is more collaborative than directive [Reference Schank126]. It should be noted that developmental theories, many of which took individual psychology as their starting point and neglected structural issues of power and inequity, have been reexamined in recent years through the lens of critical theories about race, ethnicity, gender, and disability [Reference Jones and Stewart119,Reference Torres, Jones and Renn127,Reference Abes, Jones and Stewart128].

  • Advice for educators: Assign tasks with obvious practical relevance to learners’ professional and/or personal lives, focus on allowing students to learn by doing, allow ample opportunities for learners to bring their experiences to bear in discussion, and approach the learning situation in a collegial and collaborative manner.

Climate

Equity and inclusion are and should be an increasing focus within higher education [Reference Newton5,Reference Willingham66]. A critical issue for educators to consider is whether the learning climate they foster in courses and training seminars is genuinely inclusive, welcoming, and supportive of diverse learners [Reference DeSurra and Church129,Reference Longerbeam130]. We know that when the climate of a classroom or training is overtly or subtly marginalizing toward learners, whether on the basis of race, gender, age, sexual orientation, disability, or any other factor, it exacts a high toll on learning, performance, motivation, and persistence [Reference Lee and McCabe131Reference Gregg135]. Powerful messages about inclusion and exclusion can be conveyed to learners simply by the choice of authors and topics to include (or not include) on a course reading list [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. Assumptions and biases about ethnic and racial groups can be embedded in case studies [Reference Allotey, Allotey-Reidpath and Reidpath136]. Choices in instructional materials (e.g., the use of videos without subtitles or podcasts without transcripts) can marginalize and disadvantage students with visual or auditory disabilities [Reference Cohn, Molinero and Stoehr137]. Microaggressions can be prevalent in classrooms and detrimental to students’ learning and persistence in the field [Reference Sue138Reference Murray140]. A fascinating body of research on stereotype threat demonstrates that, when stereotypes are triggered even in the subtlest ways, members of stereotyped groups can experience a disruptive cognitive state that undermines learning and performance [Reference Inzlicht and Schmader141,Reference Goff, Steele and Davies142].

Fortunately, there is much that instructors can do to create inclusive learning environments, including employing simple strategies to reduce stereotype threat, such as communicating high expectations for all learners [Reference Good, Aronson and Inzlicht143Reference Alter, Aronson, Darley, Rodriguez and Ruble145]. Other factors that create a positive learning climate are the demonstration of “instructor immediacy” – verbal and nonverbal instructor behaviors that convey approachability to students [Reference Creasey, Jarvis and Gadke146Reference Witt, Wheeless and Allen149]. The communication of immediacy is particularly important online, where learners can easily feel isolated [Reference D’Agustino150]. Universal Design for Learning (UDL), a set of guidelines that grew out of disability research, seeks to make learning accessible to all through the design of flexible learning environments in which learners have a range of choices in how they engage with instructional materials and demonstrate learning [Reference Nelson151,Reference Rose and Meyer152]. While the impact of UDL has yet to be empirically assessed, it is grounded in well-established learning research and early studies look promising [Reference Schreffler, Vasquez, Chini and James153].

  • Advice for educators: Work to create a learning environment that is intellectually challenging yet welcoming to every learner. Use content that reflects diverse voices and conveys approachability. Design for accessibility and inclusion.

Presence

Online learning has distinct benefits when it comes to convenience, access, and self-pacing; however, it also has challenges, principally the attenuation of social connection that comes when people are not physically “present” with one another. Scholarship coming out of the Community of Inquiry framework [Reference Arbaugh, Cleveland-Innes and Diaz154,Reference Garrison, Cleveland-Innes and Fung155] has emphasized the importance of creating three types of “presence” in online courses: social presence: the ability of learners to project their identities and connect with one another effectively through technologically mediated means [Reference Whiteside, Dikkers and Swan156,Reference Armellini and De Stefani157]; cognitive presence: the ability of learners to connect deeply to course content [Reference Shea and Bidjerano158,Reference Darabi, Arrastia, Nelson, Cornille and Liang159]; and teaching presence: the instructor’s ability to reach across the distance, seem real and genuine, and connect meaningfully with learners [Reference D’Agustino150]. This body of research points to the fact that social connection and community building cannot be taken for granted but must be developed deliberately and cultivated carefully online [Reference Cuthbertson and Falcone160,Reference Whiteside, Dikkers and Swan161]. As the CTSIs expand their online programming, this research is critically important to consider. However, the Community of Inquiry framework is equally applicable to face-to-face and hybrid educational environments and speaks to the powerful social and emotional components of learning.

  • Advice for educators: In all courses, but especially online, be deliberate about projecting your own personality and presence while working to build community and encourage meaningful interaction among learners.

Elements of Skill-Building

Considerable scholarship in the learning sciences has attended to the processes and stages by which learners acquire skills, gain fluency and automaticity using those skills, and develop expertise within a particular domain [Reference Alexander162]. Much of the research in this area explores differences in the ways experts and novices organize, access, and use information [Reference Chi, Feltovich and Glaser84,Reference Charness, Reingold, Pomplin and Stampe163] and is informed by research on artificial intelligence and machine learning. Two relevant principles relate to the development of mastery and the role of practice and feedback in that process.

Mastery

To develop expertise in a given domain (say, clinical research), learners must master complex skills. According to Ambrose et al., this requires first that they acquire the component skills that make up the complex skill (consider, for example, how many sub-skills are required to perform a task like writing a grant proposal!). In addition to acquiring these sub-skills, learners must integrate them successfully, developing speed and fluency at executing these skills in combination. Finally, they must understand when and where to apply what they have learned [Reference Bransford1,Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. This final element of mastery is also known as transfer and is, arguably, the central point of learning [Reference Billing164]. When should you employ a particular research design? When are specific statistical methods appropriate? Skill gaps at any of these levels can inhibit the development of mastery and interfere with performance. Ironically, one factor that complicates learning for relative novices is the expertise of their teachers, whether in formal or informal learning contexts. Because experts have gained mastery to the point of unconscious fluency [Reference Sprague and Stuart165], they tend not to see all the steps and component skills involved in learning complex tasks, and thus often do not scaffold tasks appropriately for learners. Researchers call this “expert blind spot” [Reference Nathan and Petrosino166,Reference Nathan and Koedinger167]. It is a hazard that educators in translational science programs should watch for, because their own expertise can sometimes blind them to the learning needs of students.

  • Advice for educators: Recognize that mastery takes time to develop and allocate sufficient time for students to learn skills in isolation, practice them in combination, and use them in diverse contexts to develop transfer. Also, watch out for your own expert blind spot when teaching others!

Practice

Practice and feedback are both essential for developing competence in any domain [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57]. Practice without feedback is not only demotivating; it also reinforces mistakes [Reference Bangert-Drowns, Kulik, Kulik and Morgan168Reference Metcalfe170]. Feedback without practice, on the other hand, is pointless: without opportunities to address mistakes, learners do not improve. They also lose motivation [Reference Gnepp, Klayman, Williamson and Barlas171]. However, not all practice and feedback are useful. Ideally, the practice should be focused on specific performance goals [Reference Ericsson and Charness172,Reference Ericsson and Lehmann173]. The task, moreover, should be appropriately challenging: too easy and the learner is not pushed to improve; too difficult and both performance and motivation suffer [Reference Ambrose, Bridges, DiPietro, Lovett and Norman57,Reference Vygotsky and Cole174,Reference Sanders and Welk175]. Finally, the practice should involve sufficient time on task [Reference Martin, Klein and Sullivan176]. A fascinating area of research has focused on what Bjork and Bjork have called “desirable difficulties” [Reference Bjork and Kroll177Reference Bjork, Soderstrom and Little179]. As it turns out, when learners struggle to learn something, they encode the information more deeply and remember it longer. Thus, there is an optimal level of difficulty (challenging but not discouraging) that facilitates learning. A related area of research is on “retrieval practice,” also called the testing effect [Reference Bjork and Kroll177,Reference Birnbaum, Kornell, Bjork and Bjork178,Reference Pyc and Rawson180,Reference Karpicke181]. This scholarship has found that the act of retrieving information from long-term memory, whether through testing or simply by being asked questions, helps to create stronger mental paths back to that information and ultimately leads to deeper learning [Reference Brown, Roediger and McDaniel60]. In addition, spacing practice sessions farther apart (the “spacing effect”) aids learning by compelling learners to engage in more effortful retrieval [Reference Cepeda, Vul, Rohrer, Wixted and Pashler182]. The research on retrieval practice and spacing has had particular resonance in medical education, where learners are expected to integrate and remember vast amounts of information [Reference Dobson, Linderholm and Perez183].

  • Advice for educators: Make sure learners have ample and repeated opportunities to practice key skills, ensuring that tasks are sufficiently difficult to be effortful but not so difficult as to be discouraging. Give learners retrieval practice by asking frequent questions or giving low-stakes assessments.

Feedback

Feedback, or information provided to learners to help them improve their understanding or performance, is one of the most powerful factors affecting learning [Reference Hattie and Yates62,Reference Hattie and Timperley184]. Feedback helps learners identify gaps between current and desired knowledge and skills while helping to identify specific actions they can take to close the gaps. Feedback helps learners develop stronger skills at self-evaluation [Reference Chou and Zou185] and also plays a key role in motivation [Reference Nicol and Macfarlane-Dick186]. Research shows that feedback is most effective when it focuses on specific areas for improvement [Reference Balzer, Doherty and O’Connor187], is prioritized so as to differentiate high-importance items from low-importance items [Reference Lamburg188], and is delivered soon after performance [Reference Hattie and Timperley184]. The collegial, mentorship-focused nature of education in the CTSIs makes feedback a particularly important tool for helping learners improve.

  • Advice for educators: Provide learners with feedback that identifies specific, actionable, and prioritized areas for improvement, make sure the feedback is delivered in a timely fashion, and ensure there are immediate opportunities for learners to incorporate your feedback into practice.

Recommendations

While the summary of research and advice for educators provided in the earlier sections may seem somewhat daunting, the lessons are actually simple and intuitive. Taken together, they suggest the types of strategies for teaching and training outlined in Table 1.

Table 1. Strategies educators can use to incorporate research-based learning principles

Conclusion

Teaching and learning are ubiquitous in the CTSIs and other institutions focused on training the translational workforce. Thus, there is much for educators in the CTSIs to gain by cultivating a deep understanding of the mechanisms of learning and the attributes of high-quality teaching. In this article, we have made a case for bringing the learning sciences more systematically into our educational practices. We have argued, moreover, that educators in the field of translational science may be particularly well-equipped to translate the rich, varied, and interdisciplinary research on learning into practice because of their appreciation for the importance and complexity of translational pursuits, and their commitment both to evidence-based practices and to educational excellence.

We have offered this distillation of key principles from the learning sciences and contextualized it within our unique educational environment in the hope that this framework can provide helpful guidance and a shared vocabulary for educators at our institutions, regardless of the specific contexts in which they teach. We believe that, armed with these principles, educators will be better able to discern why effective practices are effective, identify and address teaching problems, adapt strategies successfully to new teaching contexts and modalities, and innovate from a solid foundation of understanding.

Acknowledgements

The authors would like to thank Ethan Lennox, for his invaluable editorial assistance. Research reported in this publication was supported by The University of Pittsburgh Clinical and Translational Science Institute (CTSI) NIH/NCATS: 1UL1TR001857 and the National Center for Advancing Translational Sciences of the National Institutes of Health.

Disclosures

The authors have no conflicts of interest to declare.

References

Bransford, J. How People Learn: Brain, Mind, Experience, and School. Expanded Edition. Washington, D.C: National Academy Press, 2000.Google Scholar
National Academies of Sciences, Engineering, and Medicine. How People Learn. II: Learners, Contexts, and Cultures. Washington, DC: The National Academies Press, 2018.Google Scholar
Mintzes, JJ, Walter, EM. Active Learning in College Science: The Case for Evidence-Based Practice. 1st ed. Cham: Springer International Publishing, 2020, 2020CrossRefGoogle Scholar
Freeman, S, Eddy, SL, McDonough M, et al. Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences 2014; 111(23): 84108415.CrossRefGoogle ScholarPubMed
Newton, PM. The learning styles myth is thriving in higher education. Frontiers in Psychology 2015; 6: 1908.CrossRefGoogle ScholarPubMed
Herckis, L. Passing the Baton: digital literacy and sustained implementation of eLearning technologies. Current Issues in Emerging eLearning 2018; 5(1): 2944.Google Scholar
Heyes, D. Why important education research often gets ignored. The Conversation [Internet], 2014. (https://theconversation.com/why-important-education-research-often-gets-ignored-33040)Google Scholar
Hurtado, S. Linking diversity with the educational and civic missions of higher education. Review of Higher Education 2007; 30(2): 185196.CrossRefGoogle Scholar
Solari, EJ, Terry, NP, Gaab, N, et al. Translational science: a road map for the science of reading. Reading Research Quarterly 2020; 55(S1): S347S360.CrossRefGoogle Scholar
Stanovich, PJ, Stanovich, KE. Using Research and Reason in Education: How Teachers Can Use Scientifically Based Research to Make Curricular & Instructional Decisions. Washington, DC: Partnership for Reading Project, National Institute for Literacy, U.S. Dept. of Education, 2003.Google Scholar
Austin, CP. Translating translation. Nature Reviews Drug Discovery 2018; 17(7): 455456.CrossRefGoogle ScholarPubMed
Seyhan, AA. Lost in translation: the valley of death across preclinical and clinical divide – identification of problems and overcoming obstacles. Translational Medicine Communications 2019; 4(1): 119.CrossRefGoogle Scholar
Garcia, LR, Polegato, BF, Zornoff, LAM. Challenges of translational science. Arquivos Brasileiros de Cardiologia 2017; 108(5): 388389.Google ScholarPubMed
DeWitt, P. 4 reasons educators use research and 4 reasons they don’t. Education Week [Internet], 2019. (https://www.edweek.org/education/opinion-4-reasons-educators-use-research-and-4-reasons-they-dont/2019/01)Google Scholar
Brownson, RC, Proctor, EK, Luke, DA, et al. Building capacity for dissemination and implementation research: one university’s experience. Implementation Science 2017; 12(1): 104.CrossRefGoogle ScholarPubMed
Emmons, KM, Colditz, GA. Realizing the potential of cancer prevention — the role of implementation science. The New England Journal of Medicine 2017; 376(10): 986990.CrossRefGoogle ScholarPubMed
Jiang, F, Zhang, J, Wang, X, Shen, X. Important steps to improve translation from medical research to health policy. Journal of Translational Medicine 2013; 11(1): 33.CrossRefGoogle ScholarPubMed
Sharp, EA, Norman, MK, Spagnoletti, CL, Miller, BG. Optimizing synchronous online teaching sessions: a guide to the, new normal, in medical education. Academic Pediatrics 2021; 21(1): 1115.CrossRefGoogle ScholarPubMed
Zalat, MM, Hamed, MS, Bolbol, SA. The experiences, challenges, and acceptance of e-learning as a tool for teaching during the COVID-19 pandemic among university medical staff. PloS One 2021; 16(3): e0248758.CrossRefGoogle ScholarPubMed
Rose, S. Medical student education in the time of COVID-19. JAMA 2020; 323(21): 21312132.CrossRefGoogle ScholarPubMed
Leshner, AI, Terry, SF, Schultz, AM, Liverman, CT, eds. The CTSA Program at NIH: Opportunities for Advancing Clinical and Translational Research. Washington, DC: National Academies Press, 2013.Google Scholar
Meyers, FJ, Begg, MD, Fleming, M, Merchant, C. Strengthening the career development of clinical translational scientist trainees: a consensus statement of the Clinical Translational Science Award (CTSA) Research Education and Career Development Committees. Clinical and Translational Science 2012; 5(2): 132137.CrossRefGoogle ScholarPubMed
Zerhouni, EA. Translational and clinical science — time for a new vision. The New England Journal of Medicine 2005; 353(15): 16211623.CrossRefGoogle ScholarPubMed
Dilmore, TC, Moore, DW, Bjork, Z. Developing a competency-based educational structure within clinical and translational science. Clinical and Translational Science 2013; 6(2): 98102.CrossRefGoogle ScholarPubMed
Brishke, J, Evans, C, Shenkman, E. 3021 strengthening translational research through citizen scientist education. Journal of Clinical and Translational Science 2019; 3(s1): 9495.Google Scholar
Oster, RA, Devick, KL, Thurston, SW, Learning gaps among statistical competencies for clinical and translational science learners. Journal of Clinical and Translational Science 2020; 5(1): e12e12.Google ScholarPubMed
Yin, HL, Gabrilove, J, Jackson, R, et al. Sustaining the clinical and translational research workforce: training and empowering the next generation of investigators. Academic Medicine 2015; 90(7): 861865.CrossRefGoogle ScholarPubMed
Whitelaw, S, Kalra, A, Van Spall, HGC. Flattening the hierarchies in academic medicine: the importance of diversity in leadership, contribution, and thought. European Heart Journal 2020; 41(1): 910.Google ScholarPubMed
Conrad, P, Carr, P, Knight, S, Renfrew, MR, Dunn, MB, Pololi, L. Hierarchy as a barrier to advancement for women in academic medicine. Journal of Women’s Health 2010; 19(4): 799805.CrossRefGoogle ScholarPubMed
Nearing, KA, Nuechterlein, BM, Tan, S, Zerzan, JT, Libby, AM, Austin, GL. Training mentor-mentee pairs to build a robust culture for mentorship and a pipeline of clinical and translational researchers: the Colorado mentoring training program. Academic Medicine 2020; 95(5): 730736.CrossRefGoogle Scholar
Pfund, C, House, SC, Asquith, P, et al. Training mentors of clinical and translational research scholars: a randomized controlled trial. Academic Medicine 2014; 89(5): 774782.CrossRefGoogle ScholarPubMed
Vaughan, R, Romanick, M, Schlesinger, S, Kost, R, Drassil, D, Coller, B. 4037 assessing leadership skills in translational science training: The Rockefeller University leadership survey. Journal of Clinical and Translational Science 2020; 4(s1): 116117.CrossRefGoogle Scholar
Libby, AM, Ingbar, DH, Nearing, KN, Moss, M, Albino, J. Developing senior leadership for clinical and translational science. Journal of Clinical and Translational Science 2018; 2(3): 124128.CrossRefGoogle ScholarPubMed
Straus, SE, Soobiah, C, Levinson, W. The impact of leadership training programs on physicians in academic medical centers: a systematic review. Academic Medicine 2013; 88(5): 710723.CrossRefGoogle ScholarPubMed
Rubio, DM, Mayowski, CA, Norman, MK. A multi-pronged approach to diversifying the workforce. International Journal of Environmental Research and Public Health 2018; 15(10): 2219.CrossRefGoogle ScholarPubMed
Estape, ES, Quarshie, A, Segarra, B, et al. Promoting diversity in the clinical and translational research workforce. Journal of the National Medical Association 2018; 110(6): 598605.CrossRefGoogle ScholarPubMed
Hall, KL, Feng, AX, Moser, RP, Stokols, D, Taylor, BK. Moving the science of team science forward: collaboration and creativity. American Journal of Preventive Medicine 2008; 35(2 Suppl): S243S249.CrossRefGoogle ScholarPubMed
Bisbey, TM, Reyes, DL, Traylor, AM, et al. Teams of psychologists helping teams: the evolution of the science of team training. The American Psychologist 2019; 74(3): 278289.CrossRefGoogle ScholarPubMed
Mayowski, CA, Norman, MK, Schenker, Y, Proulx, CN, Kapoor, WN. Developing a team science workshop for early-career investigators. Journal of Clinical and Translational Science 2019; 3(4): 184189.CrossRefGoogle ScholarPubMed
David, C, Kochan, FK, Lunsford, LG, Dominquez, N, Haddock-Millar, J. The Effective Mentor, Mentee and Mentoring Relationship. City Road: SAGE Publications Ltd; 2017. 143.Google Scholar
Robinson, GFWB, Moore, CG, McTigue, KM, Rubio, DM, Kapoor, WN. Assessing competencies in a master of science in clinical research program: the comprehensive competency review. Clinical and Translational Science 2015; 8(6): 770775.CrossRefGoogle Scholar
Mayowski, CA, Norman, MK, Kapoor, WN. Assessing an assessment: the review and redesign of a competency-based mid-degree evaluation. Journal of Clinical and Translational Science 2018; 2(4): 223227.CrossRefGoogle ScholarPubMed
Lau, JYB, Dasgupta, R. Will the coronavirus make online education go viral? Times Higher Education. (https://www.timeshighereducation.com/features/will-coronavirus-make-online-education-go-viral)Google Scholar
Barron, AB, Hebets, EA, Cleland, TA, Fitzpatrick, CL, Hauber, ME, Stevens JR. Embracing multiple definitions of learning. Trends in Neurosciences 2015; 38(7): 405407.CrossRefGoogle Scholar
De Houwer, J, Barnes-Holmes, D, Moors, A. What is learning? On the nature and merits of a functional definition of learning. Psychonomic Bulletin & Review 2013; 20(4): 631642.CrossRefGoogle Scholar
Garvin, D. Building a learning organization. Harvard Business Review 1993; 71: 7891.Google ScholarPubMed
Dewey, J. Education and democracy in the world of today. 1938 Schools (Chicago, Ill) 2012; 9(1): 96100.Google Scholar
Vygotsky, LS, Kozulin, A. Thought and Language. Cambridge, MA: MIT Press; 1986, Translation newly revised and edited by Alex Kozulin.Google Scholar
Soderstrom, NC, Bjork, RA. Learning versus performance: an integrative review. Perspectives on Psychological Science 2015; 10(2): 176199.CrossRefGoogle Scholar
Rogoff, B. Human teaching and learning involve cultural communities, not just individuals. The Behavioral and Brain Sciences 2015; 38: e60.CrossRefGoogle Scholar
Bandura, A. Social Learning Theory. Englewood Cliffs, NJ: Prentice Hall, 1977.Google Scholar
Roth, W-M, Jornet, A. Situated cognition. Wiley Interdisciplinary Reviews Cognitive Science 2013; 4(5): 463478.CrossRefGoogle ScholarPubMed
Argyris, C. On organizational Learning. 2nded. Oxford: Blackwell Business, 1999.Google Scholar
Senge, PM. The Fifth Discipline: The Art and Practice of the Learning Organization. New York: Doubleday/Currency, 2006, Revised and updated edition.Google Scholar
Sommerhoff, D, Szameitat, A, Vogel, F, Chernikova, O, Loderer, K, Fischer, F. What do we teach when we teach the learning sciences? A document analysis of 75 graduate programs. The Journal of the Learning Sciences 2018; 27(2): 319351.CrossRefGoogle Scholar
Sawyer, RK. The Cambridge Handbook of the Learning Sciences. 2nd ed. New York, NY: Cambridge University Press, 2014.CrossRefGoogle Scholar
Ambrose, SA, Bridges, MW, DiPietro, M, Lovett, MC, Norman, MK. How Learning Works: Seven Research-Based Principles for Smart Teaching. 1sted. San Francisco, CA: Jossey-Bass, 2010.Google Scholar
Holmes, JD, Richmond, AS. Great Myths of Education and Learning. Chichester: Wiley, 2016.CrossRefGoogle Scholar
Pashler, H, McDaniel, M, Rohrer, D, Bjork, R. Learning styles: concepts and evidence. Psychological Science in the Public Interest 2008; 9(3): 105119.CrossRefGoogle ScholarPubMed
Brown, PC, Roediger, HL, McDaniel, MA. Make It Stick: The Science of Successful Learning. Cambridge: Harvard University Press, 2014.CrossRefGoogle Scholar
Christodoulou, D. Seven Myths About Education. London: Routledge, 2014.CrossRefGoogle Scholar
Hattie, J, Yates, G. Visible Learning and the Science of How We Learn. London: Routledge, Taylor & Francis Group, 2014.Google Scholar
Luckie, DB, Aubry, JR, Marengo, BJ, Rivkin, AM, Foos, LA, Maleszewski JJ. Less teaching, more learning: 10-yr study supports increasing student learning through less coverage and more inquiry. Advances in Physiology Education 2012; 36(4): 325335.CrossRefGoogle ScholarPubMed
Deslauriers, L, McCarty, LS, Miller, K, Callaghan, K, Kestin, G. Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom. Proceedings of the National Academy of Sciences 2019; 116(39): 1925119257.CrossRefGoogle ScholarPubMed
Prince M. Does active learning work? A review of the research. Journal of engineering education (Washington, DC) 2004; 93(3): 223231.Google Scholar
Willingham, DT. Why Don×t Students Like School?: A Cognitive Scientist Answers Questions About How the Mind Works and What It Means for Your Classroom. San Francisco: Jossey-Bass, 2009.Google Scholar
Royal, KD, Stockdale, MR. The myth of learning styles: what medical educators need to know. Ear, Nose, & Throat Journal 2015; 94(4-5): 132.Google ScholarPubMed
Mallin, I. Lecture and active learning as a dialectical tension. Communication Education 2017; 66(2): 242243.CrossRefGoogle Scholar
Galagan, P. Learning styles: going, going, almost gone: recent studies find that the scientific research on learning styles is weak and unconvincing. T+D (Alexandria, Va) 2014; 68(1): 22.Google Scholar
Husmann, PR, Mussell, J. Styles over substance: can learning styles teach us anything? The FASEB Journal 2019; 33(S1): 211.213.CrossRefGoogle Scholar
Fallace, T. The ethnocentric origins of the learning style idea. Educational Researcher 2019; 48(6): 349355.Google Scholar
Kirschner, PA. Stop propagating the learning styles myth. Computers and Education 2017; 106: 166171.CrossRefGoogle Scholar
Knowles, M. Andragogy in Action. Vol San Francisco: Jossey-Bass, 1984.Google Scholar
Brown, P, Roediger, H, McDaniel, M. Make It Stick: The Science of Successful Learning. Cambridge, MA: Harvard University Press, 2014.CrossRefGoogle Scholar
Carey, B. How We Learn: The Surprising Truth About When, Where, and Why It Happens. New York: Random House, 2014.Google Scholar
Willingham, D. Why Don’t Students Like School?: A Cognitive Scientist Answers Questions About How the Mind Works and What It Means for Your Classroom. San Francisco: Jossey-Bass, 2009.Google Scholar
Mayer, R. Multimedia Learning. New York: Cambridge University Press, 2009.CrossRefGoogle Scholar
Bandura, A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ: Prentice-Hall, Inc, 1986.Google Scholar
Sternberg, R, Kaufman, J, Grigorenko, E. Applied Intelligence. Cambridge: Cambridge University Press, 2008.CrossRefGoogle Scholar
Ausubel, D. The use of advance organizers in the learning and retention of meaningful verbal material. Journal of Educational Psychology 1960; 51(5): 267272.CrossRefGoogle Scholar
Braasch, J, Goldman, S. The role of prior knowledge in learning from analogies in science texts. Discourse Processes 2010; 47(6): 447479.CrossRefGoogle Scholar
Fyfe, E, Rittle-Johnson, B. Feedback both helps and hinders learning: the causal role of prior knowledge. Journal of Educational Psychology 2016; 108(1): 8297.CrossRefGoogle Scholar
Chi, MTH, Feltovich, PJ, Glaser, R. Categorization and representation of physics problems by experts and novices. Cognitive Science 1981; 5(2): 121152.CrossRefGoogle Scholar
Chi, M, Feltovich, P, Glaser, R. Categorization and representation of physics problems by experts and novices. Cognitive Science 1981; 5(2): 121152.CrossRefGoogle Scholar
Bradshaw, GL, Anderson, JR. Elaborative encoding as an explanation of levels of processing. Journal of Verbal Learning and Verbal Behavior 1982; 21(2): 165174.CrossRefGoogle Scholar
Gentner, D, Loewenstein, J, Thompson, L, Forbus, KD. Reviving inert knowledge: analogical abstraction supports relational retrieval of past events. Cognitive Science 2009; 33(8): 13431382.CrossRefGoogle ScholarPubMed
Chi, MTH, VanLehn, KA. The content of physics self-explanations. The Journal of the Learning Sciences 1991; 1(1): 69105.CrossRefGoogle Scholar
Elio, R, Scharf, PB. Modeling novice-to-expert shifts in problem-solving strategy and knowledge organization. Cognitive Science 1990; 14(4): 579639.CrossRefGoogle Scholar
Klingberg, T. The Overflowing Brain: Information Overload and the Limits of Working Memory. Oxford: Oxford University Press, 2009.Google Scholar
Sweller, J, Ayres, P, Kalyuga, S. Cognitive Load Theory, vol. 1, 1st ed. New York, NY: Springer, 2011.CrossRefGoogle Scholar
Kalyuga, S, Sweller, J. Measuring knowledge to optimize cognitive load factors during instruction. Journal of Educational Psychology 2004; 96(3): 558568.CrossRefGoogle Scholar
Sweller, J. Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review 2010; 22(2): 123138.CrossRefGoogle Scholar
Klepsch, M, Seufert, T. Understanding instructional design effects by differentiated measurement of intrinsic, extraneous, and germane cognitive load. Instructional Science 2020; 48(1): 4577.CrossRefGoogle Scholar
Jochems, W, JJGv, Merriënboer, Koper, R. Integrated E-learning: Implications for Pedagogy, Technology and Organization. London: RoutledgeFalmer, 2004.CrossRefGoogle Scholar
Mayer, RE. The Cambridge Handbook of Multimedia Learning. 2nd ed. New York, NY: Cambridge University Press, 2014.CrossRefGoogle Scholar
Schweppe, J, Rummer, R. Integrating written text and graphics as a desirable difficulty in long-term multimedia learning. Computers in Human Behavior 2016; 60: 131137.CrossRefGoogle Scholar
Rhodes, MG. Metacognition. Teaching of Psychology 2019; 46(2): 168175.CrossRefGoogle Scholar
Fleming, SM, Lau, HC. How to measure metacognition. Frontiers in Human Neuroscience 2014; 8: 443.CrossRefGoogle ScholarPubMed
Osman, ME, Hannafin, MJ. Metacognition research and theory: analysis and implications for instructional design. Educational Technology Research and Development 1992; 40(2): 8399.CrossRefGoogle Scholar
Kleka, P, Brycz, H, Fanslau, A, Pilarska, A. Becoming aware of one’s own biases in emerging adulthood — a longitudinal study. Metacognitive approach. Advances in Cognitive Psychology 2019; 15(4): 308317.CrossRefGoogle ScholarPubMed
Perry, J, Lundie, D, Golder, G. Metacognition in schools: what does the literature suggest about the effectiveness of teaching metacognition in schools? Educational Review (Birmingham) 2019; 71(4): 483500.CrossRefGoogle Scholar
Kramarski, B, Mevarech, ZR. Enhancing mathematical reasoning in the classroom: the effects of cooperative learning and metacognitive training. American Educational Research Journal 2003; 40(1): 281310.CrossRefGoogle Scholar
Lave, J, Wenger, E. Situated Learning: Legitimate Peripheral Participation. Cambridge: Cambridge University Press, 1991.CrossRefGoogle Scholar
Cavanagh, S. The Spark of Learning: Energizing the College Classroom with the Science of Emotion. Morgantown: West Virginia University Press, 2016.Google Scholar
Marmon, M. Enhancing Social Presence in Online Learning Environments. Hershey, PA: IGI Global, 2018.CrossRefGoogle Scholar
Garrison, D, Anderson, T, Archer, W. The first decade of the community of inquiry framework: a retrospective. The Internet and Higher Education 2010; 13(1): 59.CrossRefGoogle Scholar
Wildman, J, Bedwell, W. Practicing wat we preach: teaching teams using validated team science. Small Group Research 2013; 44(4): 381394.CrossRefGoogle Scholar
Ryan, R, Deci, E. Self-Determination Theory: Basic Psychological Needs in Motivation, Development, and Wellness. New York: Guilford Press, 2017.CrossRefGoogle Scholar
Pink, D. Drive: the Surprising Truth About What Motivates Us. New York: Riverhead Books, 2009.Google Scholar
Carver, C, Scheier, M. On the Self-Regulation of Behavior. Cambridge: Cambridge University Press, 1998.CrossRefGoogle Scholar
Bandura, A. Social Learning Theory. Upper Saddle River, NJ: Prentice Hall, 1977.Google Scholar
Perry, WG. Forms of Intellectual and Ethical Development in the College Years: A Scheme. 1sted. San Francisco, CA: Jossey-Bass Publishers, 1999.Google Scholar
Baxter Magolda, MB, King, PM. Assessing Meaning Making and Self-Authorship: Theory, Research, and Application. San Francisco, CA: Wiley/Jossey-Bass, 2012.Google Scholar
Watson, JC. Native American racial identity development and college adjustment at two-year institutions. Journal of College Counseling 2009; 12(2): 125136.CrossRefGoogle Scholar
Chan, J. Complexities of racial identity development for Asian Pacific Islander Desi American (APIDA) college students: complexities of racial identity development. New Directions for Student Services 2017; 2017(160): 1123.CrossRefGoogle Scholar
Tatum, BD. Racial Identity Development and Relational Theory: The Case of Black Women in White Communities. Wellesley, MA: The Stone Center, Wellesley College, 1993.Google Scholar
Boykins, M. The Relationship Between White Racial Identity Development and Implicit Bias Among White American College and University Students. Ann Arbor, MI: ProQuest Dissertations Publishing, 2021.Google Scholar
Chickering, AW, Reisser, L. Education and Identity. 2nded. San Francisco: Jossey-Bass Publishers, 1993.Google Scholar
Jones, SR, Stewart, D-L. Evolution of student development theory. New Directions for Student Services 2016; 2016(154): 1728.CrossRefGoogle Scholar
Knowles, MS. Andragogy in Action. 1sted. San Francisco: Jossey-Bass, 1984.Google Scholar
Bennett, EE, Blanchard, RD, Hinchey, KT. AM last page. applying Knowles× andragogy to resident teaching. Academic Medicine 2012; 87(1): 129.CrossRefGoogle ScholarPubMed
Knowles, MS. The Modern Practice of Adult Education: From Pedagogy to Andragogy. Wilton, CT: Association Press, 1980, Revised and updated edition.Google Scholar
Merriam, SB. The New Update on Adult Learning Theory. San Francisco: Jossey-Bass, 2001.Google Scholar
Merriam, SB. Andragogy and self-directed learning: pillars of adult learning theory. New Directions for Adult and Continuing Education 2001; 2001(89): 314.CrossRefGoogle Scholar
Hagen, M, Park, S. We knew it all along! Using cognitive science to explain how andragogy works. European Journal of Training and Ddevelopment 2016; 40(3): 171190.CrossRefGoogle Scholar
Schank, RC. The Connoisseur’s Guide to the Mind: How We Think, How We Learn, and What It Means to Be Intelligent. New York: Summit Books, 1991.Google Scholar
Torres, V, Jones, SR, Renn, K. Student affairs as a low-consensus field and the evolution of student development theory as foundational knowledge. Journal of College Student Development 2019; 60(6): 645658.CrossRefGoogle Scholar
Abes, ES, Jones, SR, Stewart, DL. Rethinking College Student Development Theory Using Critical Frameworks. Bloomfield: Stylus Publishing, LLC, 2019.Google Scholar
DeSurra, C, Church, K. Unlocking the classroom closet: privileging the marginalized voices of gay/lesbian college students, Annual Meeting of the Speech Communication Association (New Orleans, November 19–22, 1994); 1994.Google Scholar
Longerbeam, S. Lesbian, gay, and bisexual college student experiences: an exploratory study. Journal of College Student Development 2007; 48(2): 215230.CrossRefGoogle Scholar
Lee, JJ, McCabe, JM. Who speaks and who listens: revisiting the chilly climate in college classrooms. Gender & Society 2021; 35(1): 3260.CrossRefGoogle Scholar
Epstein, I, Stephens, L, Mora Severino, S, et al. “Ask me what I need”: a call for shifting responsibility upwards and creating inclusive learning environments in clinical placement. Nurse Education Today 2020; 92: 104505.CrossRefGoogle Scholar
Baglieri, S. Disability Studies and the Inclusive Classroom: Critical Practices for Creating Least Restrictive Attitudes. Florence: Routledge, 2012.CrossRefGoogle Scholar
Chin, MJ, Quinn, DM, Dhaliwal, TK, Lovison, VS. Bias in the air: a nationwide exploration of teachers’ implicit racial attitudes, aggregate bias, and student outcomes. Educational Researcher 2020; 49(8): 566578.CrossRefGoogle Scholar
Gregg, N. Increasing access to learning for the adult basic education learner with learning disabilities: evidence-based accommodation research: adults with learning disabilities in adult education. Journal of Learning Disabilities 2012; 45(1): 4763.CrossRefGoogle Scholar
Allotey, P, Allotey-Reidpath, C, Reidpath, DD. Gender bias in clinical case reports: a cross-sectional study of the "big five" medical journals. PloS One 2017; 12(5): e0177386.CrossRefGoogle ScholarPubMed
Cohn, E, Molinero, A, Stoehr, G. Is School Really Open? A Report Card of Web Based Accessibility in Higher Education. Austin, TX: Department of Education, University of Texas at Austin, 2001.Google Scholar
Sue, DW. Microaggressions in Everyday Life: Race, Gender, and Sexual Orientation. Hoboken, NJ: Wiley, 2010.Google Scholar
Suárez-Orozco, C, Casanova, S, Martin, M, et al. Toxic rain in class: classroom interpersonal microaggressions. Educational Researcher 2015; 44(3): 151160.CrossRefGoogle Scholar
Murray, TA. Microaggressions in the classroom. The Journal of Nursing Education 2020; 59(4): 184185.CrossRefGoogle ScholarPubMed
Inzlicht, M, Schmader, T. Stereotype Threat: Theory, Process, and Application. New York, NY: Oxford University Press, 2012.Google Scholar
Goff, PA, Steele, CM, Davies, PG. The space between us: stereotype threat and distance in interracial contexts. Journal of Personality and Social Psychology 2008; 94(1): 91107.CrossRefGoogle ScholarPubMed
Good, C, Aronson, J, Inzlicht, M. Improving adolescents× standardized test performance: an intervention to reduce the effects of stereotype threat. Journal of Applied Developmental Psychology 2003; 24(6): 645662.CrossRefGoogle Scholar
Chalabaev, A, Radel, R, Masicampo, EJ, Dru, V. Reducing stereotype threat with embodied triggers: a case of sensorimotor-mental congruence. Personality & Social Psychology Bulletin 2016; 42(8): 10631076.CrossRefGoogle ScholarPubMed
Alter, AL, Aronson, J, Darley, JM, Rodriguez, C, Ruble, DN. Rising to the threat: reducing stereotype threat by reframing the threat as a challenge. Journal of Experimental Social Psychology 2010; 46(1): 166171.CrossRefGoogle Scholar
Creasey, G, Jarvis, P, Gadke, D. Student attachment stances, instructor immediacy, and student-Instructor relationships as predictors of achievement expectancies in college students. Journal of College Student Development 2009; 50(4): 353372.CrossRefGoogle Scholar
D’Agustino, S. Creating Teacher Immediacy in Online Learning Environments. Hershey, PA: Information Science Reference, 2016.CrossRefGoogle Scholar
Holliday, C. How instructor immediacy behaviors affect student satisfaction and learning in web-based courses. (Education). Technical Communication (Washington) 2002; 49(2): 255.Google Scholar
Witt, PL, Wheeless, LR, Allen, M. A meta-analytical review of the relationship between teacher immediacy and student learning. Communication Monographs 2004; 71(2): 184207.CrossRefGoogle Scholar
D’Agustino, S. Leveraging Teaching Presence in Online Courses: Strategies, Technology, and Student Perspectives. Hershey, PA: IGI Global, 2016, 113137.Google Scholar
Nelson, LL. Design and Deliver: Planning and Teaching Using Universal Design for Learning. Baltimore: Brookes Publishing Co, 2014.Google Scholar
Rose, DH, Meyer, A. Teaching Every Student in the Digital Age: Universal Design for Learning. Alexandria, VA: Association for Supervision and Curriculum Development, 2002.Google Scholar
Schreffler, J, Vasquez, E, Chini, J, James, W. Universal design for learning in postsecondary STEM education for students with disabilities: a systematic literature review. International Journal of STEM Education 2019; 6(1): 110.CrossRefGoogle Scholar
Arbaugh, JB, Cleveland-Innes, M, Diaz, SR, et al. Developing a community of inquiry instrument: testing a measure of the community of inquiry framework using a multi-institutional sample. Internet & Higher Education 2008; 3(4): 133136.CrossRefGoogle Scholar
Garrison, DR, Cleveland-Innes, M, Fung, TS. Exploring causal relationships among teaching, cognitive and social presence: student perceptions of the community of inquiry framework. The Internet and Higher Education 2010; 13(1): 3136.CrossRefGoogle Scholar
Whiteside, AL, Dikkers, AG, Swan, K. Social Presence in Online Learning: Multiple Perspectives on Practice and Research. Herndon: Stylus Publishing, LLC, 2017.Google Scholar
Armellini, A, De Stefani, M. Social presence in the 21st century: an adjustment to the community of inquiry framework. British Journal of Educational Technology 2016; 47(6): 12021216.CrossRefGoogle Scholar
Shea, P, Bidjerano, T. Community of inquiry as a theoretical framework to foster, epistemic engagement, and, cognitive presence, in online education. Computers and Education 2009; 52(3): 543553.CrossRefGoogle Scholar
Darabi, A, Arrastia, MC, Nelson, DW, Cornille, T, Liang, X. Cognitive presence in asynchronous online learning: a comparison of four discussion strategies: discussion strategies in online learning. Journal of Computer Assisted Learning 2011; 27(3): 216227.CrossRefGoogle Scholar
Cuthbertson, W, Falcone, A. Elevating engagement and community in online courses. Journal of Library & Information Services in Distance Learning 2014; 8(3–4): 216224.CrossRefGoogle Scholar
Whiteside, AL, Dikkers, AG, Swan, K. Social Presence in Online Learning: Multiple Perspectives on Practice and Research. Sterling, VA: Stylus Publishing, 2017.Google Scholar
Alexander, P. The development of expertise: the journey from acclimation to proficiency. Educational Researcher 2003; 32(8): 1014.CrossRefGoogle Scholar
Charness, N, Reingold, EM, Pomplin, M, Stampe, DM. The perceptual aspect of skilled performance in chess: evidence from eye movements. Memory and Cognition 2001; 29(8): 11461152.CrossRefGoogle ScholarPubMed
Billing, D. Teaching for transfer of core/key skills in higher education: cognitive skills. Higher Education 2007; 53(4): 483516.CrossRefGoogle Scholar
Sprague, J, Stuart, D. The Speaker’s Handbook. 7thed. Belmont, CA: Thomson/Wadsworth, 2005.Google Scholar
Nathan, M, Petrosino, A. Expert blind spot among preservice teachers. American Educational Research Journal 2003; 40(4): 905928.CrossRefGoogle Scholar
Nathan, M, Koedinger, K. An investigation of teachers’ beliefs of students’ algebra development. Cognition and Instruction 2000; 18(2): 209237.CrossRefGoogle Scholar
Bangert-Drowns, RL, Kulik, C-C, Kulik, JA, Morgan, M. The instructional effect of feedback in test-like events. Review of Educational Research 1991; 61(2): 213238.CrossRefGoogle Scholar
Anderson, RC, Kulhavy, RW, Andre, T. Feedback procedures in programmed instruction. Journal of Educational Psychology 1971; 62(2): 148156.CrossRefGoogle Scholar
Metcalfe, J. Learning from errors. Annual Review of Psychology 2017; 68(1): 465489.CrossRefGoogle ScholarPubMed
Gnepp, J, Klayman, J, Williamson, IO, Barlas, S. The future of feedback: motivating performance improvement through future-focused feedback. PloS One 2020; 15(6): e0234444e0234444.CrossRefGoogle ScholarPubMed
Ericsson, K, Charness, N. Expert performance: its structure and acquisition. The American Psychologist 1994; 49(8): 725747.CrossRefGoogle Scholar
Ericsson, K, Lehmann, A. Expert and exceptional performance: evidence of maximal adaptation to task constraints. Annual Review of Psychology 1996; 47(1): 273305.CrossRefGoogle ScholarPubMed
Vygotsky, L, Cole, M. Mind in society: the development of higher psychological processes. Cambridge: Harvard University Press, 1978.Google Scholar
Sanders, D, Welk, D. Strategies to scaffold student learning: applying Vygotsky’s zone of proximal development. Nurse Educatore 2005; 30(5): 203207.CrossRefGoogle ScholarPubMed
Martin, F, Klein, J, Sullivan, H. The impact of instructional elements in computer-based instruction. British Journal of Educational Technology 2007; 38(4): 623636.CrossRefGoogle Scholar
Bjork, RA, Kroll, JF. Desirable difficulties in vocabulary learning. The American Journal of Psychology 2015; 128(2): 241252.CrossRefGoogle ScholarPubMed
Birnbaum, MS, Kornell, N, Bjork, EL, Bjork, RA. Why interleaving enhances inductive learning: the roles of discrimination and retrieval. Memory & Cognition 2013; 41(3): 392402.CrossRefGoogle ScholarPubMed
Bjork, EL, Soderstrom, NC, Little, JL. Can multiple-choice testing induce desirable difficulties? evidence from the laboratory and the classroom. The American Journal of Psychology 2015; 128(2): 229239.CrossRefGoogle ScholarPubMed
Pyc, MA, Rawson, KA. Testing the retrieval effort hypothesis: does greater difficulty correctly recalling information lead to higher levels of memory? Journal of Memory and Language 2009; 60(4): 437447.CrossRefGoogle Scholar
Karpicke, JD. Metacognitive control and strategy selection: deciding to practice retrieval during learning. Journal of Experimental Psychology General 2009; 138(4): 469486.CrossRefGoogle ScholarPubMed
Cepeda, NJ, Vul, E, Rohrer, D, Wixted, JT, Pashler, H. Spacing effects in learning: a temporal ridgeline of optimal retention. Psychological Science 2008; 19(11): 10951102.CrossRefGoogle ScholarPubMed
Dobson, J, Linderholm, T, Perez, J. Retrieval practice enhances the ability to evaluate complex physiology information. Medical Education 2018; 52(5): 513525.CrossRefGoogle ScholarPubMed
Hattie, J, Timperley, H. The power of feedback. Review of Educational Research 2007; 77(1): 81112.CrossRefGoogle Scholar
Chou, C-Y, Zou, N-B. An analysis of internal and external feedback in self-regulated learning activities mediated by self-regulated learning tools and open learner models. International Journal of Educational Technology in Higher Education 2020; 17(1): 127.CrossRefGoogle Scholar
Nicol, DJ, Macfarlane-Dick, D. Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Studies in Higher Education (Dorchester-on-Thames) 2006; 31(2): 199218.CrossRefGoogle Scholar
Balzer, W, Doherty, M, O’Connor, R. Effects of cognitive feedback on performance. Psychological Bulletin 1989; 106(3): 410433.CrossRefGoogle Scholar
Lamburg, W. Self-provided and peer-provided feedback. College Composition and Communication 1980; 31(1): 6369.CrossRefGoogle Scholar
Figure 0

Table 1. Strategies educators can use to incorporate research-based learning principles