Beyond the 5%: Why Student Engagement Determines Whether Tutoring Works

/in , , /by

Main Takeaways

  • The “5% problem” in this article describes a persistent pattern in which only a small minority of students engage with tutoring systems frequently enough to benefit academically.
  • Most tutoring technologies benefit only a small, highly motivated minority of students.
  • Learning gains depend less on access to tutoring and more on whether students spend sufficient, focused time actively working on academic tasks.
  • Engagement improves when AI tutoring is embedded in school routines and supported by educators.

Commentary

A recent article featured in Renaissance Philosophy synthesizes emerging evidence from AI-supported tutoring initiatives to diagnose a persistent challenge: most students do not engage with tutoring systems enough to benefit. Drawing on pilot data, randomized controlled trials, and implementation insights across platforms such as Khanmigo, PLUS, and Eedi, the authors find that most students do not use tutoring programs long enough to see real learning benefits; only a small group spends the recommended amount of time, typically around 30 minutes per week.

Using experimental and quasi-experimental evidence, the article explains that increased engagement is not driven by technology alone. For example, a 2024 RCT of Eedi involving 2,901 students found an effect size of 0.34 for students who met modest weekly practice targets, equivalent to four months of additional learning. However, students from low-income backgrounds were significantly less likely to reach these thresholds, highlighting equity concerns.

Across systems, the strongest gains emerged when tutoring was integrated into school ecosystems through teacher-led goal setting, aligned incentives, and scheduled instructional time. The evidence reinforces a central conclusion of implementation science: learning technologies are most effective when educators, rather than tools, anchor engagement.

Implications for Mentoring

For mentors and tutoring programs, the findings underscore that relationship-centered supports matter. Mentors can play a critical role in goal setting, accountability, and motivation, especially for students least likely to self-engage. Embedding mentoring within structured routines, aligning goals with school priorities, and emphasizing consistent practice can help ensure that tutoring reaches beyond the motivated 5%, to the students who need it most.

Read the full article here