Microsoft describes StudentSim research for evaluating AI tutors

Microsoft Research described StudentSim, a student-simulation system, in a research announcement dated October 12. It learns from de-identified learner records publicly released for research and creates a simulator for each student. The evaluation covers chess, second-language English writing and mathematics. The paper was previously released in September 2026; the October 12 blog explains its method and results.

The study separately measures how well a simulator matches a particular learner’s responses and how it changes its response after tutor guidance. The announcement reports StudentSim chess scores of 0.5150 for behavioral fidelity and 0.9067 for guidance responsiveness. These are research evaluations; they do not show classroom deployment or improvements of those magnitudes in real students’ learning.