Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

Preschool quality can be measured, but states aren't getting it right

8/26/2013

 
It is known that quality preschool can improve academic outcomes for kids (Barnett, 2011). Getting a handle on measuring “quality” is challenging, but if states and the federal government are to support preschool, such measurement is vital.

More than half of US states have adopted Quality Rating and Improvement Systems (QRISs) in an attempt to quantify preschool quality at the level of individual programs.

States adopt different measures to go into the QRIS, but they are uniform in that they use input measures, not child outcome measures.

A study out in Science this week (Sabol et al, 2013) sought to evaluate whether QRISs work; do they identify quality preschools?

The study used two national data sets from the early 2000s to test whether the type of metrics most often included in QRISs are related to schooling outcomes. So the researchers ask “if you use the kinds of measures QRISs use to evaluate preschools and combine them as the QRISs do, are you probably measuring good learning outcomes for kids?”

The four characteristics of programs were  (1) qualifications and experience of teachers; (2) teacher-student ratio; (3) family partnerships and (4) how conducive the environment is to learning (as measured by the  Early Childhood Education Rating System, which evaluates both the physical classroom and interactions between teachers, students and parents).

The outcome measures included math, prereading, language, and social skills. These were measured at the end of the year, accounting for beginning-of-year-score, child, and family characteristics.

The figure shows difference between high-scoring and low-scoring preschools on the four metrics. The four qualities of preschools do not differentiate high vs. low quality on the outcomes for kids.
Picture
Next, in separate analyses for each state, the researchers aggregated the four qualities; they combined and weighted the metrics as each state does. That didn’t make much difference.
Picture
Why are QRISs such a flop? I suspect that the problem is not just that they are “input” measures. The problem is that most are quite distal from where the action takes place—the classroom. Measuring things like years of experience and parental partnership is inexpensive and easy, and that’s nice. Someone at the school can submit this sort of data online.

Classroom measures, in contrast, are expensive. Someone with training has to actually observe what’s going on. That's part of what goes into the "environment" measure, and it does look like that measure showed the most promise.

And indeed, a measure wholly focused on classroom interaction does much better. Sabol et al conducted another analysis, using the Classroom Assessment Scoring System (CLASS), (brainchild of the study’s third author, Bob Pianta), which evaluates interactions between teacher and child. As you can see , the CLASS does quite well.  (It’s labeled “interactions” in this graph.)
Picture
The phrase “high quality preschool” has been repeated to the point that it’s become almost meaningless. It’s not, and it’s not hopeless to characterize a high-quality classroom. Further, we don’t have to test every child to spot one. Sabol et al (2013) show that qualities of teachers (e.g. experience) and programs (e.g., parental involvement) may not mean much, but qualities of teacher-student interactions might be what we need.

References

Barnett, W. S. Effectiveness of Early Educational Intervention. Science, 333, 975-978.
Sabol, T. J., Hong, S. L. S., Pianta, R. C., & Burchinal, M. R. (2013). Can rating pre-k programs predict children's learning? Science, 341, 845-846.
Peggy Lehner
8/26/2013 07:14:45 am

Alicia Browder link
8/29/2013 07:57:59 pm

Thank you so much for sharing this information. I really do believe that it is very important that teachers and school management should make sure that their teachers are always updated and supplied with new knowledge. Other than that, it is essential that the teachers also knows how to connect with its students and its parents so that they will have a good learning environment and parents and teachers will help each other to elevate the education or the academic performance of the kids.


Comments are closed.

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    January 2024
    April 2022
    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory