The fragile foundation of pre- and early-school programs for disadvantaged children

  • Geert Driessen Radboud University, 6525XZ Nijmegen, The Netherlands
Article ID: 1869
75 Views, 30 PDF Downloads
DOI: https://doi.org/10.59400/fes1869
Keywords: pre- and early school programs; Early Childhood Education and Care; model programs; Perry Preschool; Abecedarian; educational disadvantage; effectiveness; experiment; validity

Abstract

In many countries, pre- and early-school programs are the core of educational disadvantage policy. Such programs aim at preventing educational delays of children growing up under unfavorable socioeconomic circumstances. The programs provide a range of compensational stimulation activities in child care centers and kindergartens, sometimes combined with activities for parents at home. Despite the investment of billions of dollars each year, the educational gap between the rich and poor is widening. The question, then, is whether such programs are really effective. Therefore, studies into the effectiveness of such programs are significant. In this sense, this article reviews two so-called model programs, the Perry Preschool and the Abecedarian programs, which were small-scale experimental programs conducted in the 1960s and 1970s. This review critically analyzes a series of publications written by the projects’ staff and reanalyses done by Nobel laureate James Heckman and colleagues. They claim that both programs are highly effective and that their findings can be generalized to other reasonably similar programs. This review shows, however, that both experiments were hampered by several methodological shortcomings, which seriously threaten the reliability and validity of their outcomes. Furthermore, the projects were so exceptional, in terms of circumstances, target groups, budgets, and teacher qualifications, that it is not possible to generalize their results. It is concluded that not just quality research, but especially critical quality research, is imperative. That is, researchers should be more critical with regard to their own work and that of their colleagues, and they should not accept research findings at face value.

References

[1]APA. Education and socioeconomic status. Available online: https://www.apa.org/pi/ses/resources/publications/education (accessed on 25 June 2024).

[2]Long K, Renbarger R. Persistence of poverty: How measures of socioeconomic status have changed over time. Educational Researcher. 2023; 52(3): 144–154. doi: 10.3102/0013189X221141409

[3]Sirin S. Socioeconomic status and academic achievement: A meta-analytic review of research. Review of Educational Research. 2005; 75(3): 417–453. doi: 10.2307/3515987

[4]Bourdieu P, Passeron J-C. Reproduction in Education, Society, Culture. Sage Publishing; 1977.

[5]Coleman J. Social capital in the creation of human capital. American Journal of Sociology. 1988; 94: S95–120.

[6]Driessen G. Ethnicity, forms of capital, and educational achievement. International Review of Education. 2001; 47(6): 513–538. doi: 10.1023/A:1013132009177

[7]Aiston S, Walraven G. A re-view of educational inequalities. Educational Review. 2024; 76(1): 1–12. doi: 10.1080/00131911.2023.2286849.

[8]Anna H, Anita K, Emmanuel S, et al. Equity in School Education in Europe—Structures, Policies and Student Performance. Publications Office of the European Union; 2020.

[9]OECD. Equity, Diversity and Inclusion in Early Childhood Education and Care. OECD Publishing; 2023.

[10]Driessen G. The Many Facets of Educational Disadvantage. Policies, Interventions, Effects. Eliva Press; 2023.

[11]EuroPEP. Comparing priority education policies to fight against educational inequalities in Europe. Available online: https://triangle.ens-lyon.fr/IMG/pdf/EUROPEP-en.pdf (accessed on 2 May 2024).

[12]Dorn E, Hancock B, Sarakatsannis J, et al. COVID-19 and education: An emerging K-shaped recovery. Available online: https://www.mckinsey.com/industries/education/our-insights/covid-19-and-education-an-emerging-k-shaped-recovery#/ (accessed on 5 May 2024).

[13]Farquharson C, McNally S, Tahir I. Education inequalities. Available online: https://ifs.org.uk/inequality/wp-content/uploads/2022/08/Education-inequalities.pdf (accessed on 5 June 2024).

[14]Hanushek E, Peterson P, Talpey L, et al. The achievement gap fails to close: Half century of testing shows persistent divide between haves and have-nots. Education Next. 2019; 9(3): 8–17.

[15]Heckman Equation. James Heckman changes the equation for American prosperity. Available online: https://heckmanequation.org/wp-content/uploads/2014/05/F_Heckman_Brochure_041515.pdf (accessed on 12 June 2024).

[16]Parra J, Edwards D. Challenging the gold standard consensus: Randomised controlled trials (RCTs) and their pitfalls in evidence-based education. Critical Studies in Education. 2024; 1–18. doi: 10.1080/17508487.2024.2314118

[17]Besharov D, Germanis P, Higney C, et al. 16 The High/Scope Perry Preschool Project. Available online: https://welfareacademy.umd.edu/pubs/early_education/pdfs/Besharov_ECE%20assessments_The_Abecedarian_Project.pdf (accessed on 22 May 2024).

[18]García J, Bennhoff F, Ermini Leaf D, et al. The Dynastic Benefits of Early Childhood Education. NBER Working Paper. 2021. doi: 10.3386/w29004

[19]Schweinhart L, Montie J, Xiang Z, et al. The High/Scope Perry Preschool Study Through Age 40. Available online: https://highscope.org/wp-content/uploads/2018/11/perry-preschool-summary-40.pdf (accessed on 22 June 2024).

[20]Besharov D, Germanis P, Higney C, et al. 2 The Abecedarian Project. Available online: https://welfareacademy.umd.edu/pubs/early_education/pdfs/Besharov_ECE%20assessments_The_Abecedarian_Project.pdf (accessed on 22 May 2024).

[21]Barnett W, Masse L. Comparative benefit–cost analysis of the Abecedarian Program and its policy implications. Economics of Education Review. 2007; 26(1): 113–125. doi: 10.1016/j.econedurev.2005.10.007

[22]Ramey C. The Abecedarian approach to social, educational, and health disparities clinical child and family. Psychology Review. 2018; 21(2018): 527–544. doi: 10.1007/s10567-018-0260-y

[23]Ramey C, Ramey S. Early childhood education that promotes lifelong learning, health, and social well-being: The Abecedarian project and its replications. Medical Research Archives. 2023; 11(11): 1–17. doi: 10.18103/mra.v11i11.4590

[24]Heckman J, Moon S, Pinto R, et al. Reanalysis of the High/Scope Perry Preschool Program. Available online: https://jenni.uchicago.edu/perry_reanalysis/general-090424-1808.pdf (accessed on 2 May 2024).

[25]Heckman J, Moon S, Pinto R, et al. Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program. Quantitative Economics. 2010; 1(1): 1–46. doi: 10.3982/QE8

[26]Heckman J. Policies to foster human capital. Research in Economics. 2000; 54(1): 3–56. doi: 10.1006/reec.1999.0225

[27]Heckman J, Moon S, Pinto R, et al. The rate of return to the HighScope Perry Preschool Program. Journal of Public Economics. 2010; 94(1–2): 114–128. doi: 10.1016/j.jpubeco.2009.11.001

[28]García J, Heckman J, Leaf D, et al. Quantifying the life-cycle benefits of an influential early-childhood program. Journal of Political Economy. 2020; 128(7): 2502–2541. doi: 10.1086/705718

[29]Heckman J. The economics of inequality: The value of early childhood education. American Educator. 2011; 35(1): 31–47.

[30]Bruhn J, Emick E. Lottery evidence on the impact of preschool in the United States: A review and meta-analysis. Available online: https://blueprintlabs.mit.edu/research/lottery-evidence-on-the-impact-of-preschool-in-the-united-states-a-review-and-meta-analysis/ly (accessed on 8 July 2024).

[31]Burchinal M, Foster T, Garber K, et al. Examining three hypotheses for pre-kindergarten fade-out. Developmental Psychology. 2020; 58(3): 453–469. doi: 10.1037/dev0001302

[32]DeAngelis C, Holmes Erickson H, Ritter G. What’s the state of the evidence on pre-K programmes in the United States? A systematic review. Educational Review. 2020; 72(4): 495–519. doi: 10.1080/00131911.2018.1520688

[33]Diamond K, Justice L, Siegler R, et al. Synthesis of IES Research on Early Intervention and Early Childhood Education. US Department of Education Press; 2013.

[34]Duncan G, Kalil A, Mogstad M, et al. Investing in Early Childhood Development in Preschool and at Home. National Bureau of Economic Research. 2022.

[35]Fukkink R, Jilink L, Oostdam R. A meta-analysis of the impact of early childhood interventions on the development of children in the Netherlands: An inconvenient truth? European Early Childhood Education Research Journal. 2017; 25(5): 656–666. doi: 10.1080/1350293X.2017.135657

[36]Gilliam W, Zigler E. A critical meta-analysis of all evaluations of all state-funded pre-school from 1977 to 1998: Implications for policy, service delivery and program evaluation. Early Childhood Research Quarterly. 2001; 15(4): 441–473. doi: 10.1016/S0885-2006(01)00073-4

[37]Hart E, Bailey D, Luo S, et al. Fadeout and Persistence of Intervention Impacts on Social-Emotional and Cognitive Skills in Children and Adolescents: A Meta-Analytic Review of Randomized Controlled Trials. EdWorkingPaper. 2024.

[38]Karoly L, Kilburn M, Cannon J. Early Childhood Interventions: Proven Results, Future Promises. RAND Corporation Press; 2005.

[39]Lowenstein A. Early care and education as educational panacea: What do we really know about its effectiveness? Educational Policy. 2011; 25(1): 92–114. doi: 10.1177/0895904810387790

[40]Melhuish E, Ereky-Stevens K, Petrogiannis K, et al. A Review of Research on the Effects of Early Childhood Education and Care (ECEC) on Child Development. Available online: ecec-care.org (accessed on 15 July 2024).

[41]Sawhill I, Welch M. Early Childhood Education What Do We Know and What Should We Do? Available online: https://www.brookings.edu/wp-content/uploads/2023/05/20230522_CCF_SawhillWelch_PreK_FINAL.pdf (accessed on 15 June 2024).

[42]Burchinal M, Auger A, Jenkins J, et al. Unsettled science on longer-run effects of early education. Science. 2024; 384(6695): 506–508. doi: 10.1126/science.adn2141

[43]Levačić R. How can we best use public funding for schools improve the educational outcomes of socially disadvantaged children? In: Proceedings of the International Conference on The Right to Education for Every Child; 2–3 June 2009; Belgrade, Serbia.

[44]Weikart D. Preschool programs: Preliminary findings. Journal of Special Education. 1966; 1(2): 163–181. doi: 10.1177/002246696600100208

[45]Heckman J, Pinto R, Shaikh A. Dealing with Imperfect Randomization: Inference for the Highscope Perry Preschool Program. Available online: https://docs.iza.org/dp16675.pdf (accessed on 6 June 2024).

[46]Whitehurst G. Does pre-k work? It depends how picky you are. Available online: https://www.brookings.edu/articles/does-pre-k-work-it-depends-how-picky-you-are/ (accessed on 2 May 2024).

[47]Washington J, Seidenberg M. Teaching reading to African American children: When home and school language differ. American Educator. 2021; 45: 26.

[48]Tabachnick B, Fidell L. Using Multivariate Statistics. Pearson Education Inc. Press; 2013.

[49]Farah M, Sternberg S, Nichols T, et al. Randomized manipulation of early cognitive experience impacts adult brain structure. Journal of Cognitive Neuroscience. 2021; 33(6): 1197–1209. doi: 10.1162/jocn_a_01709

[50]Evidence summary for the Abecedarian project. Available online: https://evidencebasedprograms.org/document/abecedarian-project-evidence-summary/ (accessed on 17 June 2024).

[51]Whitehurst G. Rigorous preschool research illuminates policy (and why the Heckman Equation may not compute). Available online: https://www.brookings.edu/articles/rigorous-preschool-research-illuminates-policy-and-why-the-heckman-equation-may-not-compute/ (accessed on 7 July 2024).

[52]Heckman J, Karapakula G. The Perry Preschoolers at Late Midlife: A Study in Design-Specific Inference. NBER Working Cambridge: National Bureau of Economic Research. 2019.

[53]Heckman J, Pinto R and Savelyev P. Understanding the mechanisms through which an influential early childhood program boosted adult outcomes. American Economic Review. 2013; 103(6): 2052–2086. doi: 10.1257/aer.103.6.2052

[54]Button K, Ioannidis J, Mokrysz C, et al. Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience. 2013; 14(2013): 365–376. doi: 10.1038/nrn3475

[55]Eckles D. The latest Perry Preschool analysis: Noisy data+noisy methods + flexible summarizing = big claims. Available online: https://statmodeling.stat.columbia.edu/2020/01/24/the-latest-perry-preschool-analysis-noisy-data-noisy-methods-flexible-summarizing-big-claims/ (accessed on 10 July 2024).

[56]Duncan G, Magnuson K. Investing in preschool programs. Journal of Economic Perspectives. 2013; 27(2): 109–132. doi: 10.1257/jep.27.2.109

[57]Slavin R, Smith D. The relationship between sample size and effect sizes in systematic reviews in education. Educational Evaluation and Policy Analysis. 2009; 31(4): 500–506. doi: 10.3102/0162373709352369

[58]Anderson M. Multiple inference and gender differences in the effects of early intervention: A reevaluation of the Abecedarian, Perry Preschool and Early Training Projects. Journal of the American Statistical Association. 2008; 103(484): 1481–1495. doi: 10.1198/016214508000000841

[59]Whitehurst G. Testimony on early childhood education to the House Committee on Education and the Workforce. Available online: https://www.brookings.edu/articles/whitehurst-testimony-on-early-childhood-education-to-the-house-committee-on-education-and-the-workforce/ (accessed on 12 July 2024).

[60]Eadie P, Page J, Levickis P, et al. Domains of quality in early childhood education and care: A scoping review of the extent and consistency of the literature. Educational Review. 2024; 76(4): 1057–1086. doi: 10.1080/00131911.2022.2077704

[61]Sammons P, Sylva K, Hall J, et al. Challenges facing interventions to promote equity in the early years: Exploring the ‘impact’, legacy and lessons learned from a national evaluation of Children’s Centres in England. Oxford Review of Education. 2023; 49(1): 114–135. doi: 10.1080/03054985.2022.2125371

[62]Schweinhart L. Long-term follow-up of a preschool experiment. Journal of Experimental Criminology. 2013; 9(4): 389–409. doi: 10.1007/s11292-013-9190-3

[63]National Research Council. Early Childhood Assessment: Why, What, and How. The National Academies Press; 2008.

[64]NAEYC, NAECS/SDE. Early childhood curriculum, assessment, and program evaluation. Available online: https://www.naeyc.org/sites/default/files/globally-shared/downloads/PDFs/resources/position-statements/pscape.pdf (accessed on 12 July 2024).

[65]Spitz H. Does the Carolina Abecedarian early intervention project prevent sociocultural mental retardation? Intelligence. 1992; 16(2): 225–237. doi: 10.1016/0160-2896(92)90006-D

[66]Olsen D, Snell L. Assessing Proposals for Preschool and Kindergarten: Essential Information for Parents, Taxpayers and Policymakers. Available online: https://reason.org/wp-content/uploads/files/b7abd1fc30bdf33cd824db3b102c4db0.pdf (accessed on 20 July 2024).

[67]Heckman J. Skill formation and the economics of investing in disadvantaged children. Science. 2006; 312(5782): 1900–1902. doi: 10.1126/science.1128898

[68]Van de Kuilen L, Van Dongen D. Voor- en Vroegschoolse Educatie. Available online: https://nl.wikipedia.org/wiki/Voor-_en_vroegschoolse_educatie?oldid=47128613 (accessed on 20 July 2024).

[69]Goldhaber D. In schools, teacher quality matters most: Today’s research reinforces Coleman’s findings. Education Next. 2015; 16(2): 56–62.

[70]King Rice J. Teacher quality understanding the effectiveness of teacher attributes. Available online: https://www.epi.org/publication/books_teacher_quality_execsum_intro/ (accessed on 21 July 2024).

[71]ChildCare.gov. Supervision: Ratios and group sizes. Available online: https://childcare.gov/consumer-education/ratios-and-group-sizes (accessed on 21 July 2024).

[72]Education Standards Board. Preschool ratios. Available online: https://www.esb.sa.gov.au/advice-and-guidance/preschool-ratios (accessed on 22 July 2024).

[73]Foley N. Staff to child ratios in early years childcare. Available online: https://commonslibrary.parliament.uk/research-briefings/cdp-2022-0195/ (accessed on 22 July 2024).

[74]García J, Heckman J, Ronda V. The Lasting Effects of Early Childhood Education on Promoting the Skills and Social Mobility of Disadvantaged African Americans. Available online: https://www.nber.org/system/files/working_papers/w29057/w29057.pdf (accessed on 15 July 2024).

[75]Farran D, Lipsey M. Misrepresented evidence doesn’t serve pre-K programs well. Available online: https://www.brookings.edu/blog/education-plus-development/ (accessed on 20 July 2024).

[76]Ponniah R. The Abecedarian Project. Available online: https://oece.nz/public/evidence/effects-of-childcare/abecedarian-project-shows-benefits-of-ece-programme-30-years-on/ (accessed on 20 August 2024).

[77]Whitaker A, Burchinal M, Jenkins J, et al. Why Are Preschool Programs Becoming Less Effective? Ed Working Paper. 2023; 23–885. doi: 10.26300/smqa-n695.annen

[78]Karoly L. The economic returns to early childhood education. The Future of Children. 2016; 6(2): 37–35.

[79]Masse L, Barnett W. A Benefit-Cost Analysis of the Abecedarian Early Childhood Intervention. National Institute for Early Education Research. 2002.

[80]Bruno E, Iruka I. Reexamining the Carolina Abecedarian project using an antiracist perspective: Implications for early care and education research. Early Childhood Research Quarterly. 2022; 58(2022): 165–176. doi: 10.1016/j.ecresq.2021.09.001

Published
2024-12-13
How to Cite
Driessen, G. (2024). The fragile foundation of pre- and early-school programs for disadvantaged children. Forum for Education Studies, 3(1), 1869. https://doi.org/10.59400/fes1869
Issue
Vol. 3 No. 1 (2025)
Section
Article

Copyright (c) 2024 Geert Driessen

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.