Skip to main content Accessibility help
×
Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-28T19:23:33.773Z Has data issue: false hasContentIssue false

15 - Assessment in Undergraduate Research

The EvaluateUR Method

from Part II.2 - Key Measures for the Implementation of Undergraduate Research

Published online by Cambridge University Press:  11 August 2022

Harald A. Mieg
Affiliation:
Humboldt-Universität zu Berlin
Elizabeth Ambos
Affiliation:
Council on Undergraduate Research, Washington DC
Angela Brew
Affiliation:
Macquarie University, Sydney
Dominique Galli
Affiliation:
Indiana University–Purdue University, Indianapolis
Judith Lehmann
Affiliation:
Universidad de Buenos Aires, Argentina
Get access

Summary

The first part of the chapter provides an overview of assessment as an integral element of undergraduate research’s continued success and sustainability. Building from this introduction, the remainder of the chapter explains the EvaluateUR method, a proven approach to assessing the skills and competencies of undergraduate research students and for improving student learning. The EvaluateUR method documents student growth in academic and workplace-related knowledge and skills and fosters meaningful student–mentor dialog to strengthen students’ awareness of their academic strengths and weaknesses. The chapter includes a summary of the findings from an independent evaluation of the method and concludes with remarks about how the method is being adapted to support the assessment of course-based undergraduate research experiences and students competing in remotely operated underwater vehicle competitions.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2022

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Auchincloss, L. C., Laursen, S. L., Branchaw, J. L., Eagan, K., Graham, M., Hanauer, D. I., Lawrie, G., McLinn, C. M., et al. (2014). Assessment of course-based undergraduate research experiences: A meeting report. CBE–Life Sciences Education, 13(1), 2940. https://doi.org/10.1187/cbe.14-01-0004Google Scholar
Bauer, K. W., & Bennett, J. S. (2003), Alumni perceptions used to assess undergraduate research experience. Journal of Higher Education, 74(2), 210230.CrossRefGoogle Scholar
Billing, D. (2007). Teaching for transfer of core/key skills in higher education: Cognitive skills. Higher Education, 53, 483516.CrossRefGoogle Scholar
Blockus, L. (2012). The challenge of the count. Council on Undergraduate Research Quarterly, 32(3), 48.Google Scholar
Brew, A. (2006). Research and teaching: Beyond the divide. Palgrave Macmillan.CrossRefGoogle Scholar
Crawford, I., Orel, S. E., & Shanahan, J. O. (Eds.). (2014). How to get started in arts and humanities research with undergraduates. Council on Undergraduate Research.Google Scholar
Crowe, M., & Brakke, D. (2008). Assessing the impact of undergraduate research experiences on students: An overview of current literature. Council on Undergraduate Research Quarterly, 28(1), 4350.Google Scholar
Crowe, M., & Brakke, D. (2020). Assessing undergraduate research experiences: An annotative bibliography. Scholarship and Practice of Undergraduate Research, 3(2), 2130. https://doi.org/10.18833/spur/3/2/3Google Scholar
Crowe, M., Stanford, D., & Shattell, M. (2010). Student and faculty perceptions of the National Conference on Undergraduate Research (NCUR). Council on Undergraduate Research Quarterly, 31(1), 1417.Google Scholar
Dolan, E. L. (2016). Course-based undergraduate research experiences: Current knowledge and future directions. Committee on Strengthening Research Experiences for Undergraduate STEM Students / National Science Foundation. Retrieved from https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_177288.pdfGoogle Scholar
Eagan, M. K. Jr., Hurtado, S., Chang, M., Garcia, G. A., Herrera, F. A., & Garibay, J. C. (2013). Making a difference in science education: The impact of undergraduate research programs. American Educational Research Journal, 50(4), 463713.CrossRefGoogle ScholarPubMed
Estrada, M., Hernandez, P. R., & Schultz, P. W. (2018). A longitudinal study of how quality mentorship and research experience integrate underrepresented minorities into STEM careers. CBE–Life Sciences Education, 17(1), 113. https://doi.org/10.1187/cbe.17-04-0066CrossRefGoogle ScholarPubMed
Finley, A., & McNair, T. (2013). Assessing underserved students’ engagement in high-impact practices. Association of American Colleges and Universities.Google Scholar
Gilliams, T., Morris, L., Woodward, K., Rice, K., & Osgood, D. (2008). Models and assessment of collaborative research in the arts and humanities. Council on Undergraduate Research Quarterly, 29(3), 3437.Google Scholar
Hathaway, R. S., Nagda, B., & Gregerman, S. (2002). The relationship of undergraduate research participation to graduate and professional education pursuit: An empirical study. Journal of College Student Development, 43(5), 614631.Google Scholar
Healey, M., & Jenkins, A. (2009). Developing undergraduate research and inquiry. Higher Education Academy. www.researchgate.net/publication/256208546_Developing_Undergraduate_Research_and_InquiryGoogle Scholar
Hensley, M. K., & Johnson, H. R. (2019). The library as collaborator in student publishing: An index and review of undergraduate research journals. Scholarship and Practice of Undergraduate Research, 2(4), 5867.Google Scholar
Hill, J., & Walkington, H. (2016). Developing graduate attributes through participation in undergraduate research conferences. Journal of Geography in Higher Education, 40(2), 222237. https://doi.org/10.1080/03098265.2016.1140128CrossRefGoogle Scholar
Hogan, M., Dwyer, C., Harney, O., Noone, C., & Conway, R. (2015). Metacognitive skill development and applied systems science: A framework of metacognitive skills, self-regulatory functions and real-world applications. In Peña-Ayala, A. (Ed.), Metacognition: Fundaments, applications, and trends (pp. 75106). Springer International Publishing.CrossRefGoogle Scholar
Hunter, A. B., Laursen, S. L., & Seymour, E. (2006). Becoming a scientist: The role of undergraduate research in students’ cognitive, personal, and professional development. Science Education, 91(1), 3674.CrossRefGoogle Scholar
Hurtado, S., Eagen, K., Figueroa, T., & Hughes, B. (2014). Reversing underrepresentation: The impact of undergraduate research programs on enrollment in STEM graduate programs. Retrieved from www.heri.ucla.edu/nih/downloads/AERA-2014-Undergraduate-Research-And-STEM-Grad-Enrollment.pdfGoogle Scholar
Johnson, D. C., & Gould, C. (2009). Special challenges of assessing undergraduate research in the arts and humanities. Council on Undergraduate Research Quarterly, 29(3), 3338.Google Scholar
Jordan, T. C., Burnett, S. H., Carson, S., Caruso, S. M., Clase, K., DeJong, R. J., Dennehy, J. J., Denver, D. R., et al. (2014). A broadly implementable research course in phage discovery and genomics for first-year undergraduate students. mBio, 5(1), e01051–13. https://doi.org/10.1128/mbio.01051-13CrossRefGoogle ScholarPubMed
Karukstis, K. K., & Elgren, T. E. (Eds.). (2007). Designing and sustaining a research-supportive curriculum: A compendium of successful practices. Council on Undergraduate Research.Google Scholar
Kuh, G. D. (2008). High-impact educational practices: What they are, who has access to them, and why they matter. Association of American Colleges and Universities.Google Scholar
Laursen, S. L. (2015). Assessing undergraduate research in the sciences: The next generation. Council on Undergraduate Research Quarterly, 35(3), 914.Google Scholar
Laursen, S. L., Hunter, A.-B., Seymour, E. Thiry, H., & Melton, G. (2010). Undergraduate research in the sciences: Engaging students in real science. Jossey-Bass.Google Scholar
Lopatto, D. (2010). Science in solution: The impact of undergraduate research on student learning. Research Corporation for Science Advancement.Google Scholar
Mieg, H. A. (Ed.). (2019). Inquiry-based learning – Undergraduate research: The German multidisciplinary experience. Springer (open access). https://doi.org/10.1007/978-3-030-14223-0Google Scholar
Nadelson, L., Walters, L., & Waterman, J. (2010). Course-integrated undergraduate research experiences structured at different levels of inquiry. Journal of STEM Education: Innovations and Research, 11(1–2), 2744.Google Scholar
Nagda, B. A., Gregerman, S. R., Jonides, J., von Hippel, W., & Lerner, J. S. (1998). Undergraduate student–faculty research partnerships affect student retention. Review of Higher Education, 22(1), 5572. https://doi.org/10.1353/rhe.1998.0016CrossRefGoogle Scholar
Panadero, E., Jönsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Educational Research Review, 22, 7498.Google Scholar
Rivera, J., Khelifa, M., Hamdah, B. A., Al-Hamadi, A. M., & Zdgiebloski, E. S. (2018). A global conversation: Reflections from the first World Congress on Undergraduate Research. Scholarship and Practice of Undergraduate Research, 2(1), 5559. https://doi.org/10.18833/spur/2/1/4Google Scholar
Rodenbusch, S., Hernandez, P. R., Simmons, S. L., & Dolan, E. L. (2016). Early engagement in course-based research increases graduation rates and completion of science, engineering and mathematics degrees. CBE–Life Sciences Education, 15(2), article 20. https://doi.org/10.1187/cbe.16-03-0117Google Scholar
Scharff, L., Draeger, J., Verpoorten, D., Devlin, M., Dvorakova, L., Lodge, J., & Smith, S. (2017). Exploring metacognition as support for learning transfer. Teaching & Learning Inquiry, 5(1), 114.Google Scholar
Schinske, J., Balke, V. L., Bangera, G., Bonney, K. M., Brownell, S. E., Carter, R. S., Curran-Everett, D., Dolan, E. L., et al. (2017). Broadening participation in biology education research (BER): Engaging community college students and faculty. CBE–Life Sciences Education, 16(2), 111. www.lifescied.org/doi/10.1187/cbe.16-10-0289CrossRefGoogle ScholarPubMed
Schmitz, H. J., & Havholm, K. (2015). Undergraduate research and alumni: Perspectives on learning gains and post-graduation benefits. Council on Undergraduate Research Quarterly, 35(3), 1522.Google Scholar
Schraw, G., Crippen, K. J., & Hartley, K. (2006). Promoting self-regulation in science education: Metacognition as part of a broader perspective on learning. Research in Science Education, 36, 111139.CrossRefGoogle Scholar
Shaffer, C. D., Alvarez, C., Bailey, C., Barnard, D., Bhalla, S., Chandrasekaran, C., Chandrasekaran, V., Chung, H.-M., et al. (2010). The Genomics Education Partnership: Successful integration of research into laboratory classes at a diverse group of undergraduate institutions. CBE–Life Sciences Education, 9(1), 5569. https://doi.org/10.1187/09-11-0087Google Scholar
Shanahan, J. (2012). Building undergraduate research into the curriculum. In Hensel, N. & Paul, E. (Eds.), Faculty support and undergraduate research: Innovation in faculty role definition, workload, and reward (pp. 6876). Council on Undergraduate Research.Google Scholar
Shortlidge, E. E., & Brownell, S. E. (2016). How to assess your CURE: A practical guide for instructors of course-based undergraduate research experiences. Journal of Microbiology and Biology Education, 17(3), 399408. www.asmscience.org/content/journal/jmbe/10.1128/jmbe.v17i3.1103CrossRefGoogle Scholar
Singer, J., & Weiler, D. (2009). A longitudinal student outcomes evaluation of the Buffalo State College summer undergraduate research program. Council on Undergraduate Research Quarterly, 29(3), 2025.Google Scholar
Singer, J., & Zimmerman, B. (2012). Evaluating a summer undergraduate research program: Measuring student outcomes and program impact. Council on Undergraduate Research Quarterly, 32(3), 4047.Google Scholar
Spronken-Smith, R., Brodeur, J., Kajaks, T., Luck, M., Myatt, P., Verburgh, A., Walkington, H., & Wuetherick, B. (2013). Completing the research cycle: A framework for promoting dissemination of undergraduate research and inquiry. Teaching & Learning Inquiry, 1(2), 105118.Google Scholar
Stanford, J. S., Rocheleau, S. E., Smith, K. P. W., & Mohan, J. (2017). Early undergraduate research experiences lead to similar learning gains for STEM and non-STEM undergraduates. Studies in Higher Education, 42(1), 115129. https://doi.org/10.1080/03075079.2015.1035248CrossRefGoogle Scholar
Vandermaas-Peeler, M., Miller, P., & Moore, J. (Eds.). (2018). Excellence in mentoring undergraduate research. Council on Undergraduate Research.Google Scholar
Willison, J. W. (2009). Multiple contexts, multiple outcomes, one conceptual framework for research skill development in the undergraduate curriculum. Council on Undergraduate Research Quarterly, 29(3), 1014.Google Scholar
Willison, J., Zhu, X., Xie, B., Yu, X., Chen, J., Zhang, D., Shahshoug, I., & Sabir, F. (2020). Graduates’ affective transfer of research skills and evidence-based practice from university to employment in clinics. BMC Medical Education, 20, article 89. https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909–020-1988-xGoogle Scholar
Wolters, C., & Hussain, M. (2015). Investigating grit and its relations with college students’ self-regulated learning and academic achievement. Metacognition and Learning, 10(3), 293311.CrossRefGoogle Scholar
Wuetherick, B., Willison, J. W., & Shanahan, J. (2018). Mentored undergraduate research at scale: Undergraduate research in the curriculum and as pedagogy. In Vandermaas-Peeler, M., Miller, P., & Moore, J. (Eds.), Excellence in mentoring undergraduate research (pp. 181202). Council on Undergraduate Research.Google Scholar
Zimbardi, K., & Myatt, P. (2014). Embedding undergraduate research experiences within the curriculum: A cross-disciplinary study of the key characteristics guiding implementation. Studies in Higher Education, 39(2), 233250. www.tandfonline.com/doi/abs/10.1080/03075079.2011.651448CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×