A Theoretical Framework and Evaluation Instrument for the Competence to Use Artificial Intelligence and Digital Technology in Educational Processes

Artificial intelligence (AI) and digital technology provide extensive possibilities for education. But focusing only on their implementation does not address the challenges associated with them and they may even have a negative impact on learners. So far, the disciplines of psychology and computer science have not provided a theoretical framework for the competence needed to develop and use AI and digital technology in education in order to prepare learners for successful participation in modern societies. The main aim of this paper is to theoretically specify competent use of AI and digital technology in education and to provide a standardized instrument to evaluate courses that teach this competence. Therefore, we (a) combine theoretical contributions from both scientific disciplines to formulate a theoretical framework with four levels for the “Competence to Use Artificial Intelligence and Digital Technology in Educational Processes” (AIEDTEC competence), (b) introduce a questionnaire to evaluate courses that teach AIEDTEC competence, and (c) present results regarding its psychometric properties (N=240). The questionnaire showed good to very good psychometric properties and the assumed factor structure was supported by confirmatory factor analyses. The paper connects research on systems thinking and learning and instruction with recent developments regarding AI and digital technology and thereby provides an essential base for creating effective, modern, and safe learning environments in the future as well as a psychometric evaluation instrument.