How studies are labeled
| Study label | Meaning |
|---|---|
| Randomized trial | Students, classes, or schools assigned by chance. The strongest single-study design. |
| Lottery study | Admission by lottery, which works like random assignment for those who applied. |
| Meta-analysis | A combined analysis of many studies; only as strong as the studies inside it. |
| Comparison study | Groups compared without random assignment. Useful, but differences may come from who chose what. |
| Lab study | Controlled experiment outside a regular classroom. Explains why; doesn't prove it works at scale. |
| Correlation | Two things move together. Shows a link, never cause. Used only for "why it matters." |
| Study | Design | Who | Compared with | Found | Limits |
|---|---|---|---|---|---|
| Ehri et al. 2001 (National Reading Panel)(opens in a new tab) | Meta-analysis of experiments | 38 experiments, 66 comparisons | Unsystematic or no phonics | d = 0.41; 0.55 when started early, 0.27 after 1st grade; effects lasted | Mix of experimental and quasi-experimental studies |
| Camilli et al. reanalyses(opens in a new tab) | Reanalysis of the same studies | Same | Same | Smaller effect, about d = 0.24 | Different coding choices |
| Stuebing et al. 2008(opens in a new tab) | Response to the reanalyses | Same | Same | Effects of the reanalyzed size are still practically meaningful | — |
| IES Foundational Skills guide, 2016(opens in a new tab) | Expert panel review of rigorous studies | K–3 | — | Strong evidence for sound-letter links and decoding; moderate for daily connected text; minimal for academic language (summary(opens in a new tab)) | Panel judgment |
| England phonics screening check(opens in a new tab) | National trend data | All Year 1 pupils | Earlier years | 58% met the standard in 2012, 82% in 2018 | Not causal; schools learn the test |
| Mississippi, 2024 NAEP(opens in a new tab) | State trend, demographics-adjusted | 4th graders | Other states | First in the nation in 4th grade reading after adjustment | Not causal; many reforms at once |
Counter-evidence, written fairly
- Bowers (2020) reviewed 12 meta-analyses and argued there is little evidence systematic phonics beats the main alternatives, including whole language and balanced literacy (summary(opens in a new tab); Bowers' reply(opens in a new tab)).
- The response. Fletcher, Savage, and Vaughn found definitional problems and misread meta-analyses in that review, and argued the evidence for explicitly teaching phonics is replicable and positive (Fletcher et al. 2021(opens in a new tab)). Buckingham concluded that even a conservative reading favors systematic phonics over any existing alternative (Buckingham 2020(opens in a new tab)).
- Where this leaves a school. Every meta-analysis estimate of systematic phonics is positive. The live debate is about size and about how to combine phonics with vocabulary, morphology, and knowledge, not whether to teach it.
What we don't know yet
The best mix and timing of phonics, morphology, and fluency work for older struggling readers.
Change log
First published.
Sources
- Ehri et al. 2001 (National Reading Panel) (opens in a new tab)
journals.sagepub.com
- Camilli et al. reanalyses (opens in a new tab)
pmc.ncbi.nlm.nih.gov
- Stuebing et al. 2008 (opens in a new tab)
texasldcenter.org
- IES Foundational Skills guide, 2016 (opens in a new tab)
ies.ed.gov
- IES via Nebraska DOE summary (opens in a new tab)
education.ne.gov
- England phonics data 2018 (opens in a new tab)
gov.uk
- Mississippi First: Contextualizing Mississippi's 2024 NAEP scores (opens in a new tab)
mississippifirst.org
- Bowers debate summary (opens in a new tab)
texasldcenter.org
- Bowers 2021, reply to Fletcher, Savage & Vaughn (opens in a new tab)
link.springer.com
- Fletcher, Savage & Vaughn 2021 (opens in a new tab)
discovery-pp.ucl.ac.uk
- Buckingham 2020 (opens in a new tab)
cambridge.org