Book contents
- Technology and Measurement around the Globe
- Educational and Psychological Testing in a Global Context
- Technology and Measurement around the Globe
- Copyright page
- Contents
- Contributors
- Introduction
- Part I Foundations
- Part II Global Perspectives on Key Methods/Topics
- Part III Regional Focus
- Chapter 7 Technology and Measurement in Asia
- Chapter 8 Technology-Enabled Measurement in Singapore
- Chapter 9 A European Perspective on Psychometric Measurement Technology
- Chapter 10 Testing and Measurement in North America with a Focus on Transformation
- Chapter 11 Technology and Measurement Challenges in Education and the Labor Market in South America
- Chapter 12 Reflections on Testing, Assessment, and the Future
- Index
- References
Chapter 10 - Testing and Measurement in North America with a Focus on Transformation
from Part III - Regional Focus
Published online by Cambridge University Press: 08 November 2023
Book contents
- Technology and Measurement around the Globe
- Educational and Psychological Testing in a Global Context
- Technology and Measurement around the Globe
- Copyright page
- Contents
- Contributors
- Introduction
- Part I Foundations
- Part II Global Perspectives on Key Methods/Topics
- Part III Regional Focus
- Chapter 7 Technology and Measurement in Asia
- Chapter 8 Technology-Enabled Measurement in Singapore
- Chapter 9 A European Perspective on Psychometric Measurement Technology
- Chapter 10 Testing and Measurement in North America with a Focus on Transformation
- Chapter 11 Technology and Measurement Challenges in Education and the Labor Market in South America
- Chapter 12 Reflections on Testing, Assessment, and the Future
- Index
- References
Summary
An overview of testing and measurement in North America is provided, covering topics related to privacy laws and regulations, online proctoring, artificial intelligence, accommodations, accessibility, and the “opt out of testing” movement that are currently defining measurement in North America. This is not to say that these challenges are unique to North America; in fact, the challenges related to these topics are being faced all over the world in varying degrees and the same opportunities exist, but these topics are of particular importance when it comes to measurement and assessment in North America. Building on these observations, a discussion of how advances in technology and computing power provide an opportunity to challenge the status quo related to assessment; these advancements will allow assessment of skills in more authentic ways that will provide better insight into someone’s knowledge, skills, and abilities. The question we should be asking and attempting to answer is “How can assessment developers leverage the power of the cloud and technology to measure skills more accurately and create higher fidelity in the assessment process?”
Keywords
- Type
- Chapter
- Information
- Technology and Measurement around the Globe , pp. 308 - 325Publisher: Cambridge University PressPrint publication year: 2023
References
ACTNext. (2019). Computational psychometrics: A field guide. https://actnext.org/research-and-projects/computational-psychometrics-field-guide/Google Scholar
Alleyne, R. (2011). Welcome to the Information Age – 174 newspapers a day. Daily Telegraph. https://www.telegraph.co.uk/news/science/science-news/8316534/Welcome-to-the-information-age-174-newspapers-a-day.htmlGoogle Scholar
Anderson, C. (2017). Cloud skills and organizational influence: How cloud skills are accelerating the careers of IT professionals. http://download.microsoft.com/download/C/3/0/C3068200–2F9B-4D8D-BF5D-32E1F7ED669A/IDC_Microsoft_How_Cloud_Skills_Are_Accelerating_IT_Pro_Careers_May_2017.pdfGoogle Scholar
Association for Test Publishers (ATP). (2019). Privacy in Practice Bulletin: Customer guidance on privacy compliance. Bulletin 1. Privacy in Practice Bulletin Series (memberclicks.net).Google Scholar
Association for Test Publishers (ATP). (2021, December). Nevada broadens its privacy law… what are the implications? Test Publishers News and Information from ATP, 21.Google Scholar
Bock, R. D. (1997). A brief history of item response theory. Educational Measurement: Issues and Practice, 16(4), 21–33. https://doi.org/10.1111/j.1745-3992.1997.tb00605.xCrossRefGoogle Scholar
Brown, M. F. (2021). Key challenges to remote proctoring: Communications and technology, security, and privacy. https://www.credentialinginsights.org/Article/key-challenges-to-remote-proctoring-communications-and-technology-security-and-privacy-1Google Scholar
Buchanan, R., & Finch, S. (2005). History of psychometrics. In Everitt, B. & Howell, D. (Eds.), Encyclopedia of statistics in behavioral science. John Wiley & Sons.Google Scholar
Cahn, A. F., & Deng, G. (2020). Remote test-taking software is an inaccurate, privacy-invading mess. https://www.fastcompany.com/90586386/remote-test-taking-software-is-an-inaccurate-privacy-invading-messGoogle Scholar
Californians for Consumer Privacy. (2021). Introducing the California Privacy Rights Act (CPRA) Resource Center. https://www.caprivacy.org/introducing-the-california-privacy-rights-act-cpra-resource-center/Google Scholar
CCPA. (2018). California Consumer Privacy Act (CCPA). https://www.oag.ca.gov/privacy/ccpaGoogle Scholar
Crumpler, W. (2020). The problem of bias in facial recognition. https://www.csis.org/blogs/technology-policy-blog/problem-bias-facial-recognitionGoogle Scholar
Diebert, R. J. (2020). Opinion: We’ve become dependent on a technological ecosystem that is highly invasive and prone to serial abuse. Mail. https://www.theglobeandmail.com/opinion/article-the-pandemic-has-made-us-even-more-dependent-on-a-highly-invasive/Google Scholar
DLA Piper. (2021). Law in Mexico – DLA Piper global data protection laws of the world. https://www.dlapiperdataprotection.com/index.html?t=law&c=MXGoogle Scholar
Faggella, D. (2020). Everyday examples of artificial intelligence and machine learning. https://emerj.com/ai-sector-overviews/everyday-examples-of-ai/Google Scholar
Fletcher, D. (2009). A brief history of standardized testing. http://content.time.com/time/nation/article/0,8599,1947019,00.htmlGoogle Scholar
Foster, D. (2020). SmartItem™: Stop test fraud, improve fairness, and upgrade the way you test. https://info.caveon.com/the-smartitem-ebook-promoGoogle Scholar
GDPR EU. (2021). GDPR – user-friendly guide to General Data Protection Regulation. https://www.gdpreu.org/Google Scholar
Gierl, M. J., Lai, H., & Tanygin, V. (2021). Advanced methods in automatic item generation. Routledge.CrossRefGoogle Scholar
Global Disability Rights Now!. (n.d.). Mexico. https://www.globaldisabilityrightsnow.org/mexicoGoogle Scholar
Goddard, W. (2020). Where is AI used today? https://itchronicles.com/artificial-intelligence/where-is-ai-used-today/Google Scholar
Government of Canada. (1977). Rights of people with disabilities. https://www.canada.ca/en/canadian-heritage/services/rights-people-disabilities.htmlGoogle Scholar
Harwell, D. (2020, November 12). Students rebel over remote test monitoring during the pandemic. The Washington Post. https://www.washingtonpost.com/technology/2020/11/12/test-monitoring-student-revolt/Google Scholar
International Data Corporation. (2020). Cloud adoption and opportunities will continue to expand leading to a $1 trillion market in 2024, according to IDC. https://www.idc.com/getdoc.jsp?containerId=prUS46934120Google Scholar
Journal Editorial Board. (2020). Online proctoring unfairly punishes cheaters & non-cheaters alike. https://www.queensjournal.ca/story/2020-11-19/editorials/online-proctoring-unfairly-punishes-cheaters-and-non-cheaters-alike/Google Scholar
Kelly, J., & Oliver, L. (2020). Senators express privacy concerns over proctoring apps. https://www.eff.org/deeplinks/2020/12/senators-express-privacy-concerns-over-proctoring-appsGoogle Scholar
Manea, A. I. (2020). Selecting subject matter experts in job and work analysis surveys: Advantages and disadvantages. Academic Journal of Economic Studies, 6(2), 52–61. https://link.gale.com/apps/doc/A631140986/AONE?u=anon~aa6ed072&sid=googleScholar&xid=b0778136Google Scholar
MIT Technology Review. (2020). Ten breakthrough technologies in 2020. https://www.technologyreview.com/10-breakthrough-technologies/2020/Google Scholar
MIT Technology Review. (2021). Ten breakthrough technologies in 2021. https://www.technologyreview.com/2021/02/24/1014369/10-breakthrough-technologies-2021/Google Scholar
Morse, J. (2020). Online testing is a biased mess, and senators are demanding answers. https://mashable.com/article/senate-open-letter-remote-proctoring-examsoft-bias-student-privacy/Google Scholar
Office of the Privacy Commissioner of Canada. (2019). The Privacy Act. https://priv.gc.ca/en/privacy-topics/privacy-laws-in-canada/the-privacy-act/Google Scholar
Patil, A., & Bromwich, J. E. (2020, September 29). How it feels when software watches you take tests. The New York Times. https://www.nytimes.com/2020/09/29/style/testing-schools-proctorio.htmlGoogle Scholar
Polyak, S. T., von Davier, A. A., & Peterschmidt, K. (2017). Computational psychometrics for the measurement of collaborative problem-solving skills. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.02029CrossRefGoogle ScholarPubMed
Recio, D. (2017). Mexico’s new public-sector data protection law. https://iapp.org/news/a/mexicos-new-public-sector-data-protection-law/Google Scholar
Rippy, S. (2021). US state privacy legislation tracker. https://iapp.org/resources/article/us-state-privacy-legislation-tracker/Google Scholar
Saeed, F. (2020). 9 powerful examples of artificial intelligence in use today. https://www.iqvis.com/blog/9-powerful-examples-of-artificial-intelligence-in-use-today/Google Scholar
Shaw, F. X. (2021). Microsoft Cloud at Ignite 2021: Metaverse, AI, and hyperconnectivity in a hybrid world. https://blogs.microsoft.com/blog/2021/11/02/microsoft-cloud-at-ignite-2021-metaverse-ai-and-hyperconnectivity-in-a-hybrid-world/Google Scholar
Traub, R. E. (1997). Classical test theory in historical perspective. Educational Measurement: Issues and Practice, 16(4), 8–14. https://doi.org/10.1111/j.1745-3992.1997.tb00603.xCrossRefGoogle Scholar
University of California. (2020). University of California Board of Regents unanimously approved changes to standardized testing requirement for undergraduates. https://www.universityofcalifornia.edu/press-room/university-california-board-regents-approves-changes-standardized-testing-requirement#:~:text=Elimination>%20of%20the%20ACT%2FSAT%20test%20requirement%3A%20By%202025%2C,UC-endorsed%20test%20to%20measure%20UC-readiness%20would%20be%20required%20of%20the%20ACT%2FSAT%20test%20requirement%3A%20By%202025%2C,UC-endorsed%20test%20to%20measure%20UC-readiness%20would%20be%20required>Google Scholar
US Equal Employment Opportunity Commission. (1990). Americans with Disabilities Act of 1990. https://www.eeoc.gov/americans-disabilities-act-1990-original-textGoogle Scholar
Valentino-DeVries, J. (2020, January 12). How the police use facial recognition, and where it falls short. The New York Times. https://www.nytimes.com/2020/01/12/technology/facial-recognition-police.htmlGoogle Scholar
von Davier, A. A. (2017). Computational psychometrics in support of collaborative educational assessments. Journal of Educational Measurement, 54(1), 3–11. https://doi.org/10.3389/fpsyg.2017.02029CrossRefGoogle Scholar
von Davier, A. A., Munson, L., & Lottridge, S. (2021, July). In Hembry, T. (Moderator), Increased automation in our industry: How not to get it wrong. Panel discussion presented at ATP’s New World of Testing (NWT) Digital Series.Google Scholar
Weiner, J., Munson, L. J., & Foster, D. (2020, September). Test security in the digital age: Advances in design and analytics. Breakout session accepted at ATP’s Global Annual Innovations in Testing Virtual Conference.Google Scholar
Woodley, C. D. (2015, April). Careful selection of subject matter experts is the key to a successful JTA meeting. The Item Bank: The Professional Testing Blog. http://www.proftesting.com/blog/2015/04/29/2015429careful-selection-of-subject-matter-experts-is-the-key-to-a-successful-jta-meeting/Google Scholar
xAPI.com. (2021). What is xAPI aka the Experience API or Tin Can API? https://xapi.com/overview/Google Scholar