Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-31T18:56:09.500Z Has data issue: false hasContentIssue false

Chapter 12 - Reflections on Testing, Assessment, and the Future

from Part III - Regional Focus

Published online by Cambridge University Press:  08 November 2023

By
Fred Oswald  and
Tara Behrend
Edited by
Louis Tay ,
Sang Eun Woo  and
Tara Behrend
Louis Tay
Affiliation:
Purdue University, Indiana
Sang Eun Woo
Affiliation:
Purdue University, Indiana
Tara Behrend
Affiliation:
Purdue University, Indiana
Get access

Summary

In this essay, we review the Technology and Measurement around the Globe chapters with an eye toward integration and synthesis. We primarily focus on implications for testing, and then make connections to the broader world of nontest assessment. We identify themes of privacy, fairness, workplace applications, and emerging technologies, and offer a research agenda for future investigations that seek to understand culture, technology, and measurement.

Keywords

privacyfairnesstestingculture
Type
Chapter
Information
Technology and Measurement around the Globe , pp. 349 - 359
Publisher: Cambridge University Press
Print publication year: 2023

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education, & Joint Committee on Standards for Educational and Psychological Testing. (2014). Standards for educational and psychological testing. AERA.Google Scholar
Hamilton, R. H., & Davidson, H. K. (2022). Legal and ethical challenges for HR in machine learning. Employee Responsibilities and Rights Journal, 34, 19–39. https://doi.org/10.1007/s10672–021-09377-zCrossRefGoogle Scholar
Landers, R. N., & Behrend, T. S. (2023). Auditing the AI auditors: A framework for evaluating fairness and bias in high stakes AI predictive models. American Psychologist, 78(1), 36–49. https://doi.org/10.1037/amp0000972CrossRefGoogle ScholarPubMed
Meredith, W. (1964). Notes on factorial invariance. Psychometrika, 29, 177–185. https://doi.org/10.1007/BF02289699CrossRefGoogle Scholar
Miller, A., Crede, M., & Sotola, L. K. (2021). Should research experience be used for selection into graduate school: A discussion and meta-analytic synthesis of the available evidence. International Journal of Selection and Assessment, 29, 19–28. https://doi.org/10.1111/ijsa.12312CrossRefGoogle Scholar
Millsap, R. E. (1997). Invariance in measurement and prediction: Their relationship in the single-factor case. Psychological Methods, 2(3), 248–260. https://doi.org/10.1037/1082-989X.2.3.248CrossRefGoogle Scholar
National Conference of State Legislatures. (2021, September 15). Legislation related to artificial intelligence. https://www.ncsl.org/research/telecommunications-and-information-technology/2020-legislation-related-to-artificial-intelligence.aspxGoogle Scholar
Office of Science and Technology Policy. (2022). Blueprint for an AI bill of rights: Making automated systems work for the American people (“AI Blueprint”). Executive Office of the President. https://www.whitehouse.gov/wpcontent/uploads/2022/10/Blueprint-for-an-AI-Bill-of-Rights.pdfGoogle Scholar
Rocher, L., Hendrickx, J. M., & de Montjoye, Y. A. (2019). Estimating the success of re-identifications in incomplete datasets using generative models). Nature Communications, 10, Article 3069. https://doi.org/10.1038/s41467-019-10933-3CrossRefGoogle ScholarPubMed
Roth, P. L., & Bobko, P. (2000). College grade point average as a personnel selection device: Ethnic group differences and potential adverse impact. Journal of Applied Psychology, 85(3), 399–406. https://doi.org/10.1037/0021-9010.85.3.399CrossRefGoogle ScholarPubMed
Society for Industrial and Organizational Psychology. (2018). Principles for the validation and use of personnel selection procedures (5th ed.). https://www.apa.org/ed/accreditation/about/policies/personnel-selection-procedures.pdfGoogle Scholar
Somaraju, A. V., Nye, C. D., & Olenick, J. (2022). A review of measurement equivalence in organizational research: What’s old, what’s new, what’s next? Organizational Research Methods, 25(4), 741–785. https://doi.org/10.1177/10944281211056524CrossRefGoogle Scholar
Woo, S. E., LeBreton, J. M., Keith, M. G., & Tay, L. (2023). Bias, fairness, and validity in graduate-school admissions: A psychometric perspective. Perspectives on Psychological Science, 18(1), 3–31. https://doi.org/10.1177/17456916211055374CrossRefGoogle ScholarPubMed
Wu, F. Y., Mulfinger, E., AlexanderIII, L., Sinclair, A. L., McCloy, R. A., & Oswald, F. L. (2022). Individual differences at play: An investigation into measuring Big Five personality facets with game-based assessments. International Journal of Selection and Assessment, 30(1), 62–81. https://doi.org/10.1111/ijsa.12360CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×