PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional Reasoning

Read full text
Authors: Afra Feyza Akyürek, Advait Gosai, Chen Bo Calvin Zhang, Vipul Kumar Gupta, Jaehwan Jeong, Anisha Gunjal, Tahseen Rabbani, Maria Mazzone, David Randolph, Mohammad Mahmoudi Meymand, Gurshaan Chattha, Paula Rodríguez
+12 more Diego Mares, Pavit Singh, Michael C. Liu, Subodh Chawla, Pete Cline, Lucy Ogaz, Ernesto Hernández-Martínez, Zihao Wang, Pavi Bhatter, Marcos Ayestaran, Bing Liu, Yunzhong He
Cited by: 0

Abstract

Afra Feyza Akyürek, Advait Gosai, Chen Bo Calvin Zhang, Vipul Gupta, Jaehwan Jeong, Anisha Gunjal, Tahseen Rabbani, Maria Mazzone, David Randolph IV, Mohammad Mahmoudi Meymand, Gurshaan Chattha, Paula Rodriguez, Diego A. Mares Buendia, Pavit Singh, Michael Liu, Subodh Chawla, Peter Cline, Lucy Ogaz, Ernesto Gabriel Hernández Montoya, Zihao Wang, Pavi Bhatter, Marcos Ayestaran, Bing Liu, Yunzhong He. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.

Fields of Study & Subjects

Explainable Artificial Intelligence (XAI) Ethics and Social Impacts of AI Artificial Intelligence in Law

Publication details

Pages
42297–42325
Publication date
1 January 2026