The difficulty parameter's estimation of the achievement test items according to the item response theory and its logical estimation by the subject teachers

Read full text
Authors: Bakr Hussein
Cited by: 0

Abstract

The study aims to compare the teacher's estimation of the difficulty of the mathematics achievement test items, based on the item response theory (IRT), and the rational estimation of the items by subject matter experts (SME). The research sample consisted of (500) male and female students from the first intermediate grade, and (25) specialized teachers to estimate the difficulty based on their experience in the subject. A test consisting of (40) multiple-choice items was constructed, and its data were analyzed using the Rasch model using the Construct Map 4.6 program. The study results showed that IRT estimates were more accurate and reliable in determining item difficulty, particularly the more extreme items (very easy, very difficult), compared to teachers' estimates, which tended to overestimate difficulty. There was also a high correlation between the two estimation methods (r = 0.91) and high inter-estimation reliability (ICC = 0.88), with a slight bias in favor of teachers' estimates, with the Bland-Altman agreement rate being (-0.37). This result confirms the integration of quantitative (IRT) and qualitative (SME).

Fields of Study & Subjects

Psychometric Methodologies and Testing Educational Assessment and Pedagogy Educational Technology and Assessment

Publication details

Journal / source
International Journal of Humanities and Education Research
Volume
8
Issue
2
Pages
01–09
Publication date
1 February 2026