โ† Studies Suggest ๐ŸŽ“ Education

Every Classroom Teaches the Lesson Before Assigning Problems. A Meta-Analysis of 53 Studies Found Students Learn More Deeply When They Struggle and Fail First.

A meta-analysis of 53 studies and 166 comparisons found that students who attempt challenging problems before receiving instruction develop significantly greater conceptual understanding and transfer ability than those taught the traditional way, with effect sizes reaching 0.87 after adjusting for publication bias.

By Daniel Voss, Education & Learning Science ยท July 13, 2026

Listen to this article
Loading...
Morning light streaming through tall classroom windows onto a chalkboard with partially erased equations, chalk dust catching the light

๐Ÿ“‹ The Study

Title
When Problem Solving Followed by Instruction Works: Evidence for Productive Failure
Authors
Sinha & Kapur, 2021
Institution
ETH Zurich
Journal
Review of Educational Research, 91(5), 761โ€“798
DOI
10.3102/00346543211019105
Sample
53 studies, 166 comparisons across North America (43%), Europe (26%), and Asia (28%); students ranged from primary school to university
Method
Meta-analysis of randomized and quasi-experimental studies comparing problem-solving-first (PS-I) with instruction-first (I-PS) designs
Key Finding
Problem solving before instruction produces significantly deeper conceptual understanding and better transfer to novel problems than instruction first, without compromising procedural knowledge
Effect Size
Hedge's g = 0.36 [95% CI: 0.20, 0.51]; high-fidelity productive failure: g = 0.37โ€“0.58; publication-bias-adjusted estimate: g = 0.87
Counterintuition
โšกโšกโšกโšก 4/5
Replication
Meta-analyzed; 53 independent studies across 15+ countries, multiple grade levels, and five STEM domains confirm the effect; boundary condition identified for younger children (grades 2โ€“5)

Explain First, Practice After

The formula is the same in every classroom on earth. The teacher explains the concept. Students take notes. Then they practice problems. Lecture, drill, repeat. This sequence is so deeply embedded in how schools operate that questioning it feels about as productive as questioning whether desks should face forward.

Manu Kapur questioned it anyway.

In a 2014 paper published in Cognitive Science, Kapur ran two randomized controlled trials with 9th-graders in Singapore. Both groups were learning standard deviation for the first time. One group received direct instruction and then practiced. The other was handed data about soccer players' scoring records and told to invent a way to measure which striker was most consistent. No formulas. No hints. No scaffolding.

The direct-instruction students produced correct answers during practice. The productive-failure students generated a range of invented approaches. All wrong.

On the posttest, both groups scored equally on procedural skills: they could execute the standard deviation formula. But the students who failed first scored significantly higher on conceptual understanding and on transfer problems that required applying the concept in unfamiliar contexts. Generating wrong answers, it turned out, had activated prior knowledge and created what Kapur calls "knowledge gaps" that made subsequent instruction stick.

He called the approach "productive failure."

Fifty-Three Studies, Same Conclusion

In 2021, Kapur and postdoctoral researcher Tanmay Sinha published a meta-analysis in Review of Educational Research that pooled results from 53 studies and 166 comparisons. The overall effect size was Hedge's g = 0.36, a moderate advantage for problem-solving before instruction. When studies implemented productive failure with high fidelity to Kapur's design principles, effect sizes rose to between 0.37 and 0.58. After adjusting for publication bias, the estimated true effect reached g = 0.87.

That is a large effect by the standards of educational research, where interventions costing millions routinely produce effect sizes below 0.10.

The findings held across geography and age. Forty-three percent of students came from North America, 26% from Europe, 28% from Asia. Nearly half were in secondary school. Over a third were undergraduates. The subjects ranged across math, physics, chemistry, biology, and medicine.

Here is one way to make that number tangible. On the U.S. National Assessment of Educational Progress, the 8th-grade math scale has a standard deviation of roughly 36 points. A Hedge's g of 0.36 translates to approximately 13 NAEP points. The Black-white achievement gap on that same assessment is about 32 points. A change in instructional sequence alone could close roughly 40% of that gap. No new curricula. No new technology. No additional teachers. Just reversing the order of two things teachers already do.

ETH Zurich tested the idea on its own campus. In Linear Algebra, one of the university's largest first-year courses with roughly 650 engineering students, Kapur's team created optional pre-lecture problems designed for productive failure. About 60% of students completed them. Their pass rate was 20 percentage points higher than the historical average, and their exam grades were significantly better.

Why Wrong Answers Prepare Better Than Right Ones

The mechanism is not mysterious, though it is counterintuitive. Attempting an unsolved problem forces you to recruit everything you already know. You generate candidate solutions, test them mentally, compare alternatives. Most fail. But the process does two things direct instruction cannot: it activates prior knowledge structures, and it creates what cognitive scientists call "desirable difficulties" that deepen encoding when the correct solution is later presented.

Kapur's 2014 paper tested this directly with a second experiment. One group struggled with problems themselves. Another group reviewed the failed solutions generated by the first group, then received the same instruction. The vicarious-failure group outperformed direct-instruction students. But they did not match the students who had personally struggled. Your own wrong answers, it appears, teach you more than someone else's.

The Strongest Case Against

The most formidable criticism comes from cognitive load theory. John Sweller, Paul Kirschner, and Richard Clark argued in a widely cited 2006 paper that novice learners lack the schemas to benefit from unguided problem solving. The working memory demands of searching for solutions without adequate knowledge, they contend, exhaust cognitive resources that direct instruction deploys efficiently. Their paper remains the canonical defense of the instruction-first position, and the concern is real: badly designed exploration can overwhelm beginners.

Kapur's response is precise. Productive failure is not minimal guidance. It is a two-phase design where initial struggle is deliberately followed by consolidation that builds on students' specific failed attempts. The instructor explains the canonical solution with explicit reference to why student-generated approaches fell short and what each one got partially right. The meta-analytic data bear this out: effect sizes were strongest when this consolidation phase was faithfully implemented. Strip it away, and productive failure collapses into the unstructured discovery learning that Sweller rightly criticizes.

What We Didn't Prove

The meta-analysis has real boundaries. Nearly all 53 studies measured learning over days or weeks. Whether the conceptual advantages of productive failure persist over months or years has barely been examined. Most of the evidence comes from STEM subjects; whether the approach transfers to humanities, writing, or social sciences is an open question. The effect reverses for young children: students in grades 2 through 5 learned better with traditional instruction, likely because they lack sufficient prior knowledge to generate meaningful failed attempts. And the research draws heavily on studies by Kapur and his extended network, raising legitimate questions about the independence of the evidence base, even though independent labs have produced consistent results.

The Bottom Line

The standard educational formula works for procedural fluency. Students can follow the steps. But for conceptual understanding and the ability to apply knowledge to unfamiliar problems, a generation of evidence now shows that the sequence matters more than the method. Failing first, then being taught, consistently outperforms being taught first, then practicing. What looks like wasted time is where deep learning begins.

What You Can Do

Sources

  1. Sinha, T., & Kapur, M. (2021). When problem solving followed by instruction works: Evidence for productive failure. Review of Educational Research, 91(5), 761โ€“798. doi:10.3102/00346543211019105
  2. Kapur, M. (2014). Productive failure in learning math. Cognitive Science, 38(5), 1008โ€“1022. doi:10.1111/cogs.12107
  3. Kapur, M. (2010). Productive failure in mathematical problem solving. Instructional Science, 38(6), 523โ€“550. doi:10.1007/s11251-009-9093-x
  4. Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75โ€“86. doi:10.1207/s15326985ep4102_1
  5. ETH Zurich (2021). Those who fail productively are all the wiser. ethz.ch
  6. National Assessment of Educational Progress (2024). NAEP Report Card: Mathematics. nces.ed.gov