Agentic education · Learning science

Actionable companion · Motivation & engagement

Learning with agency: A Rasch Analysis of Students’ Academic Motivation toward Mathematics in an Adaptive Learning System

AI-assisted editorial implementation guide, separate from the original research. Proposed actions are not claims or recommendations attributed to the source authors. No independent peer review of this guide is asserted.

Evidence and context

Title and abstract screening; stage labels describe reported settings, not verified numerical ages. Design labels require full-text appraisal. Reported stage(s): Higher education. Verify the participant population and task before transferring the findings.

Original authors’ abstract, reproduced under the linked source license:

Despite the criticality of considering student academic motivation as it influences learning, research within the field of adaptive learning technologies for education has so far focused more on customising instruction to implement personalised learning, than investigating how personalised learning is associated with learners’ motivation. Given this, a robust instrument is required to gather information about student academic motivation within the context of adaptive learning technologies. This study sought to validate the Academic Motivation Toward Mathematics Survey (AMTMS) currently used to measure motivation based on self-determination theory in mathematics education at pre-tertiary levels (grades 11 and 12) in Asia. A total of 196 participants recruited via availability sampling took part in this study, after interacting with an in-house mathematics adaptive learning system within a tertiary educational institution. The validation was performed based on modern test theory given that it overcomes some limitations of classical factor analytic approaches. Results supported the factorial structure of the AMTMS but 12 of the original 21 items had to be rescored to establish ordered thresholds. Further, the bifactor equivalent solution suggested the possibility of reporting a singular motivation index comprising the five factors within the AMTMS. Along with the results, this study offers researchers a robust and validated instrument to measure motivation toward mathematics that can be used within an adaptive learning environment.

What kind of evidence is this?

Intelligent tutoring & adaptive learning · Survey / observational study

Stage: Higher education. Screening labels describe reported context and study-design language. They are not a risk-of-bias rating or proof of effectiveness for an age band.

Study methods · source passage

This study was conducted in two stages, both of which sought validity evidence for the AMTMS based on the unified concept of validity recommended by the Standards for Educational and Psychological Testing [38].

Limitations and uncertainty · source passage

Despite the criticality of considering student academic motivation as it influences learning, research within the field of adaptive learning technologies for education has so far focused more on customising instruction to implement personalised learning, than investigating how personalised learning is associated with learners’ motivation. Given this, a robust instrument is required to gather information about student academic motivation within the context of adaptive learning technologies. This study sought to validate the Academic Motivation Toward Mathematics Survey (AMTMS) currently used to measure motivation based on self-determination theory in mathematics education at pre-tertiary levels (grades 11 and 12) in Asia. A total of 196 participants recruited via availability sampling took part in this study, after interacting with an in-house mathematics adaptive learning system within a tertiary educational institution. The validation was performed based on modern test theory given that it overcomes some limitations of classical factor analytic approaches. Results supported the factorial structure of the AMTMS but 12 of the original 21 items had to be rescored to establish ordered thresholds. Further, the bifactor equivalent solution suggested the possibility of reporting a singular motivation index comprising the five factors within the AMTMS. Along with the results, this study offers researchers a robust and validated instrument to measure motivation toward mathematics that can be used within an adaptive learning environment.

Design the system before the pilot

Document the learner model, mastery rule, hint sequence and adaptation signal. Compare adaptive routing with the same content in a non-adaptive sequence. Check whether early errors lead to persistent low-expectation pathways.

  • Measure engagement separately from achievement. Check whether novelty-driven participation persists and whether it translates to independent performance.

A 90-day district pilot

  1. Days 1–15 · Appraise. Have the curriculum lead and a teacher read the methods and limitations. Record the study design, sample, comparator, outcomes and evidence gaps. Define a local question that the study can help inform.
  2. Days 16–30 · Design. Choose one disciplinary task. Require a first attempt, a documented AI consultation, a critique of the output and an independent explanation. Align the comparison group and scoring rubric with the same objective. Name an accountable owner and set the baseline, success threshold and budget before implementation.
  3. Days 31–60 · Test. Start with a small voluntary cohort, preserve an accessible non-AI route and require teacher review. Use synthetic or de-identified examples; approve data handling and tool terms through district processes.
  4. Days 61–90 · Decide. Blind-score reasoning and accuracy on a new task without AI. Distinguish model examination scores, student perceptions and actual learner gains; only the last directly tests educational benefit. Compare with baseline, document uncertainty and stop or revise if learning worsens, access is unequal or critical errors persist.

The board decision brief

Report the learning problem, evidence quality, participating population, total cost including review time, measured benefit, errors, access differences and remaining uncertainties. Make a dated recommendation to stop, revise or expand. A positive perception survey alone does not establish learning improvement.

Attribution and reuse

Lyndon Lim; Seo Hong Lim; Wei Ying Rebekah Lim. A Rasch Analysis of Students’ Academic Motivation toward Mathematics in an Adaptive Learning System. Behavioral Sciences (2022-07-21). https://doi.org/10.3390/bs12070244

Companion prepared 2026-10-30. Original authorship and DOI are preserved. The abstract is an attributed source extract; the implementation plan is new AI-assisted editorial material, offered under the same CC BY 4.0 license. This guide has not undergone independent peer review.