Evaluating General-Purpose AI with Psychometrics
Abstract
[EN] IN THE RAPIDLY evolving field of artificial intelligence (AI), rigorous evaluation is critical. Evaluation helps prevent disastrous outcomes in high-stakes applications such as autonomous driving and medical diagnosis,7 and helps stop the spread of racist, sexist, ableist, extremist, and other harmful ideologies.4 It also plays a key role in understanding how intelligent AI is, preventing the misallocation of resources, and guiding improvements in future model development. Despite its importance, rigorous evaluation of versatile general-purpose AI systems such as ChatGPT and Gemini is challenging. The versatility of these systems, which can handle diverse tasks specified
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Ethics and Social Impacts of AI
Explainable Artificial Intelligence (XAI)
Publication details
- Journal / source
- RiuNet (Universitat Politècnica de València)
- Publisher
- Association for Computing Machinery (ACM)
- Volume
- 69
- Issue
- 5
- Pages
- 92-102
- Publication date
- 1 May 2026
- Language
- EN