📘 Can an AI Tutor Improve Math Scores? Evidence from Ghana
A 2024 field experiment in Ghana found that students using a WhatsApp-based AI math tutor improved their math test scores by 0.37 standard deviations—meaning significant learning gains over an 8-month period.
Why This Study Matters
Many students worldwide, especially in low-resource areas, struggle to access quality math instruction outside school. This study explores whether an AI-based tutor—delivered simply via chat—can boost learning in a real setting.
In places with limited resources, like rural parts of Ghana, technology like WhatsApp is often more accessible than classrooms or computers. This study showed that using an AI math tutor through WhatsApp helped students learn significantly better — improving their scores by 0.37 standard deviations, which education experts consider a meaningful and measurable gain. It’s a powerful example of how affordable, mobile-based AI tools can close learning gaps worldwide.
What is an AI Tutor?
This study used “Rori”, an AI-powered tutor sending math questions and hints via WhatsApp. It adapts to each student’s level and offers practice on the go—like a pocket tutor.
Study Outline
| Aspect | Details |
|---|---|
| Study Focus | Rori AI WhatsApp tutor vs no-tutor control group |
| Participants | ~1,000 students in grades 3–9 across 11 Ghanaian schools |
| Design | Randomized controlled trial (treatment vs control) |
| Intervention | Two 30-min chatbot sessions per week for 8 months |
| Outcome | Standardized math test score |
Key Results
- Effect size: +0.37 SD (p < 0.001)
- This gain is substantial—comparable to 3–4 months of additional schooling
- Improvements were seen across age groups and baseline performance levels
Real-World Implications
| Use Case | Benefit of AI Tutor |
|---|---|
| Homework support | Accessible anytime, even offline |
| Large classrooms | Scales without needing new teachers |
| Low-bandwidth regions | Works with WhatsApp on basic phones |
| Supplement to school | Complements classroom instruction |
Limitations & Considerations
- Focused only on math
- Delivered outside school hours—not a school-day substitute
- Built on availability of WhatsApp and mobile phones
Summary
This study presents strong evidence that a simple AI tutor via WhatsApp can significantly boost math learning in resource-limited settings—without needing new infrastructure or extra teachers.
Sources
- Henkel, O., Horne‑Robinson, H., Kozhakhmetova, N., & Lee, A. (2024). Effective and Scalable Math Support: Evidence on the Impact of an AI‑Tutor on Math Achievement in Ghana. https://arxiv.org/abs/2402.09809
Earning Opportunity with AI
If this article helped you,
☕ Buy me a coffee
Your support keeps more things coming!
Disclaimer
This article summarizes findings from real peer-reviewed research. This content is intended for educational and informational purposes only.