Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

PreK research districts should know

2/3/2014

 
Last week Dave Grissmer and I published an op-ed on universal pre-k. We didn’t take it as controversial that government support for pre-K access is a good idea. As Gail Collins noted, when President Obama mentioned early education in his State of the Union address, it was one of the few times John Boehner clapped. Even better, there are good data indicating that, on average, state programs help kids get ready to learn math and to read in Kindergarten (e.g., Gormley et al, 2005; Magnuson et al, 2007).

Dave and I pointed out that the means do show gains, but state programs vary in their effectiveness. It’s not the case that any old preschool is worth doing, and that’s why everyone always says that preschool must be “high quality.” But exactly how to ensure high quality is not so obvious.
Picture
One suggestion we made was made was to capitalize on what is already known. The Department of Education has funded preK research for decades. Dave and I merely claimed that it had yielded useful information. Let me give an example here of the sort of thing we had in mind.

A recent study (Weiland & Yoshikawa, 2013) reported research that was notable in this respect: important decisions and procedures concerning the programs were made by the people and in the way such decisions will likely to be made as state preK programs expand or are initiated. The district was Boston Public Schools, and they offer preK for any child of age—there is no restriction based on income. The district:  

1.       picked the curriculum.
2.       figured out how to implement the curriculum at scale without any input from its developers.
3.       developed its own coaching program for teachers, meant to ensure that the curricula were implemented effectively.

The second and third points are especially important, as the greatest challenge in education research has been bringing what look like useful ideas to scale.  It’s not certain why that’s so, but one good guess is that as you scale up, the people actually implementing the curriculum have little or no contact with the person who developed it. So it’s harder to tell exactly how it’s supposed to go.

Naturally, schools and classrooms will want to tweak the program here and there to make it a better fit for their school or classroom. They will use their judgment as to which changes won’t affect the overall integrity of the program, but the voice of the developer of the curriculum is probably important in this conversation.

Picture
Boston Public Schools picked Opening the World of Literacy for their prereading and language program; there were few data for the program, and they were somewhat mixed. For mathematics, they picked Building Blocks, which had both more research and a stronger track record of success.

Weiland and Yoshikawa measured the progress of 2,018 children in 238 classrooms during the 2008/09 school year. They found moderate to large gains in language, pre-reading, and math skills. There was even a small effect in executive function skills, although the two curricula did not target these directly. Interestingly (and in contrast to other findings) they found no interaction with household income; poor and wealthy children showed the same benefit. There were some interactions with ethnicity: children from Hispanic homes showed larger benefits than others on some measures.

There are questions that could be raised. The comparison children were those who had just missed the age cut-off to attend the preschool. So those children are, obviously, younger, and might be expected to show less development during those 9 months than older children. Another objection concerns what those control kids were doing during the year. The researchers did have data on this question, and reported that many were in setting that typically do not offer much opportunities for cognitive growth, e.g., center-based care (although the researchers argued that Massachusetts imposes stricter regulations for quality on such settings than most states do.)

Despite these caveats, this study represents the kind of thing Dave and I had in mind when we said the Department of Education should make communicating research findings to states a priority. Boston faced exactly the problem that many districts will face, they solved it using their own limited resources as districts will have to, and by all appearances, it’s been a success.

References:

Gormley, W. T., Gayer, T., Phillips, D., & Dawson, B. (2005). The effects of universal pre-K on cognitive development. Developmental Psychology, 41, 872–884.

Magnuson, K., Ruhm, C., & Waldfogel, J. (2007). Does prekindergarten improve school preparation and per-formance? Economics of Education Review, 26,33–51.

Weiland, C. & Yoshikawa, H. (2013). Impacts of a prekindergarten program on children’s mathematics, language, literacy, executive function, and emotional skills. Child Development, 84, 2112-2130.

The classroom walkthrough and student achievement

1/7/2014

 
What does it mean for an administrator to be an instructional leader? As often as this phrase is repeated, you'd think there would be well-researched techniques with proven effectiveness. There is no shortage of authors offering protips: Amazon has over a thousand titles that include the phrase.

But there is less research on the topic than you'd think, and much of it (e.g., May, Huff, & Goldring, 2012) actually shows a weak or non-existent relationship between student achievement and the priority
administrators place on instructional leadership (as opposed to other aspects of a principal's job, e.g., close attention to administrative matters, inspirational leadership, focus on school culture, etc.).

A terrific new study by Jason Grissom, Susanna Loeb, and Ben Master shed light on the role of instructional leadership. It's the method that sets this study apart. Instead of simply asking principals "how important is instructional leadership to you?" or having them complete time diaries, researchers actually followed 100 principals  around for a full school day, recording what they did.

The researchers also had access to administrative data from the district (Miami-Dade county) about principals, teachers, and students that could be linked to the observational data. The outcome measure of interest was student learning gains, as measured by standardized tests.

The results showed that principals spent, on average, 12.6 percent of their time on activities related to instruction. The most common was classroom walkthroughs (5.4%) and the second was formal teacher evaluation (2.4%).
Picture
"Just pretend I'm not here."
Some school characteristics were associated with variations in the amount of time principals devoted to instructional leadership. More time was spent in schools with lower-achieving students, with students from lower-income homes, and with a higher percentage of students of color.

As to the primary question of the study, time spent on instructional leadership was NOT associated with student learning outcomes.

But once "instructional leadership" was made more fine-grained, the picture changed.

Time spent coaching teachers--especially in math--was associated with better student outcomes. So was time spent evaluating teachers and curriculum.

But informal classroom walkthroughs--the most common activity--were negatively associated with student achievement. This was especially true in high schools.

In a follow-up analysis, the researchers evaluated these data in light of what the principals said about how teachers view classroom walkthroughs. The negative association with student achievement was most evident where principals believed that teachers did not view walkthroughs as opportunities for professional development.  (Other reasons for walkthroughs might be to ensure that a teacher is following a curriculum, or to be more visible to faculty.)

Although the researchers suggest that their results should be considered exploratory, they do suggest a general principle of instructional leadership that fits well with one overarching principle of learning: feedback is essential. Instructional leadership activities that offer meaningful feedback to teachers may help. Those that don't, will not.

Grissom, J. A., Loeb, S., & Master, B. (2013). Effective instructional time use for school leaders: Longitudinal evidence from observations of principals. Educational Researcher, 42,  433-444.

May, H., Huff, J., & Goldring, E. (2012). A longitudinal study of principals' activities and student performance. School Effectiveness and School Improvement, 23, 417-439.

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    April 2022
    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory