Proceedings chapter
OA Policy
English

Embedding Pedagogical Principles into LLMs: A Field Study of AI-Generated Feedback in a Programming Serious Game

Presented at27th International Conference, AIED 2026, Séoul, 27.06-03.07 2026
Published inBlanchard, E. G., Chen, G., Chi, M. & Isotani, S. (Ed.), Artificial Intelligence in Education, p. 245-260
PublisherCham : Springer Nature Switzerland
Collection
  • Lecture Notes in Computer Science (LNCS); 16584
Publication date2027
First online date2026-06-27
Abstract

Providing individualized support in introductory programming is challenging for teachers in secondary classrooms. Although LLMs can effectively deliver automated feedback in this context, they may provide excessive assistance that hinders learning and lack access to the full context of exploratory environments such as serious games. This study investigates the impact of integrating a pedagogically driven LLM-based digital assistant, which integrates distinct constructivist constraints, into Pyrates, a Python programming game for high schools. In a field user study (N = 241), we found that the assistant was positively perceived by students, supported in-game progression, and significantly reduced teacher interventions without negatively affecting learning. Interaction trace analyses revealed distinct post-feedback strategies, advocating for a tight control of LLM content generation. These findings highlight the feasibility and value of embedding pedagogical principles into LLMs to reduce teacher workload while influencing student strategies and maintaining their learning outcomes in authentic K-12 programming courses.

Keywords
  • Adaptive Feedback
  • LLM
  • Generative AI
  • Pedagogical Framework
  • Exploratory Serious Game
  • K-12 Computer Science Education
  • Field User Study
  • Empirical Evaluation
Citation (ISO format)
BRANTHÔME, Matthieu et al. Embedding Pedagogical Principles into LLMs: A Field Study of AI-Generated Feedback in a Programming Serious Game. In: Artificial Intelligence in Education. Blanchard, E. G., Chen, G., Chi, M. & Isotani, S. (Ed.). Séoul. Cham : Springer Nature Switzerland, 2027. p. 245–260. (Lecture Notes in Computer Science (LNCS)) doi: 10.1007/978-3-032-29763-1_17
Main files (1)
Proceedings chapter (Accepted version)
Identifiers
6views
3downloads

Technical informations

Creation28/06/2026 12:18:30
First validation24/07/2026 07:54:30
Update24/07/2026 07:54:30
Status update24/07/2026 07:54:30
Last indexation24/07/2026 07:54:31
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack