Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

What happens when you teach children to make inferences while reading?

3/27/2017

 
Once children are fluent decoders, the most frequent problem in reading is poor comprehension due to a failure to make inferences. Even seemingly straightforward anaphoric inferences can elude these students: they might read “Bob gave Tamisa some of his snack because she was hungry” and still be unsure of the referent for “she.” Other inferences require bridging information from long term memory, and these are still more challenging. For example, “Kevin said he was cold. Zeke gave him his coat.” Even if these two sentences are understood, each on its own, deeper comprehension entails making the (probably accurate) inference that Zeke gave Kevin the coat because Kevin said he was cold, which requires knowing that putting on a coat is something one does when cold.

Educators have sought to improve inferencing. In some cases they can teach students reading comprehension strategies: create a summary, for example, or create a graphic organizer. The task provides some structure that will prompt the student to make the necessary inferences. Alternatively, students might be taught more directly to make inferences, usually by instruction to elaborate on what they read in the text,  to use cues in the text that provide clues to inferencing (e.g., words like “because,” or “so,”), and to monitor their comprehension.

​A new meta-analysis of inference instruction (Elleman, 2017) shows that it’s quite effective, but carries some important caveats…ones that I’ve mentioned before.

The overall mean effect size on comprehension of inference instruction was a healthy g = .58. Elleman also evaluated separately comprehension due to inferences, and literal comprehension, and observed a difference moderated by ability. 
Picture
As the figure shows, both skilled and less skilled readers improve in inference-making ability, but inference instruction provides a boost to understanding of things stated explicitly in the text only for less skilled readers.
​
Still more interesting to me was the report that the amount of instructional time had no impact on the effectiveness of the intervention, which I’ve shown in the graph below, compiled from a data table in the paper.
Picture
Each dot represents a study condition. Two things are notable: first, most studies entail rather little practice, but nevertheless show a large effect. Second, more practice does not lead to a larger effect.

​This finding is important because it provides an important clue to the mechanism by which this instruction helps. Practice usually helps, especially early in training. The curve looks like this
Picture
Performance improves with practice, and the curve is negatively accelerating. You get the most bang for the buck from practice early in training. The data from this meta-analysis don’t show either effect. It’s true that the range is relatively small…most studies use very little practice, so it’s harder to observe any effect of practice. That still doesn’t explain why you get such a big effect with very little practice.

​This failure to observe a practice effect is more understandable if the relationship of practice and performance for inference generation look more like this: 
Picture
The plot would look like this if what kids learn during inference instruction is easy to learn, and easy to implement, but carries a one-time benefit. For example, this instruction might prompt children to better understand the importance of making the effort to coordinate meaning across sentences. It might teach them to look for cues to inference possibilities like the word “because,” or time cues like “later.”

As Elleman notes, theories of reading have centered on the knowledge from long-term memory needed to make inferences (Kintsch, 1998) and/or the working memory capacity needed to hold information in mind simultaneously so meanings can be compared (Daneman & Carpenter, 1980). Neither of these is going to change over the course of 10 hours of instruction.

And that’s the practical implication of this meta-analysis. There’s a big benefit to inference instruction, but all of the benefit accrues rapidly. There seems to be no point in spending extended classroom time on the practice.

Similar results have been observed in meta-analyses of studies examining the impact of reading comprehension strategy instruction. Gail Lovette and I (2014) reported on nine meta-analyses of typically developing readers and of readers either identified with a reading disability, or at risk. In each case, the pattern was the same: a large effect with few hours of instruction, and no benefit to more instruction. (This piece was published as a commentary in Teachers College Record and seems to have disappeared from the website. Email me if you’d like a copy.)

This interpretation is also consistent with theories of reading comprehension. Inferences are situation specific: you can’t really teach how to make inferences because the inference to be made depends on the content of the text. Rather, you can teach them to seek and use some cues (probably a causal connection here) and you can teach them that it’s important to make inferences. But making them requires broad background knowledge in long term memory.

That is an essential goal to improve reading comprehension, but it is a goal requiring years of planning, not hours. 
caren fahey link
3/27/2017 10:02:02 am

(This piece was published as a commentary in Teachers College Record and seems to have disappeared from the website. Email me if you’d like a copy.)

Bronwyn Parkin
3/27/2017 06:43:21 pm

Thank you for this insight from Australia, where the practice of explicitly teaching comprehension strategies as an isolated activity is a relatively new phenomenon.(We love to appropriate educational strategies from the US.) I work with remote Indigenous schools, and the differences in world view are glaring. Confirming of your blog are the insights from cognitive psychologists that participant ability to make inferences about other participant behaviour (including written text) is dependent on whether those people share intentionality in their behaviours and communication (Sperber and Wilson, Clark). The implication for classroom practice is that we have to carry out in depth analysis of author's intent in every aspect of the text, from why the author chose to write a narrative, to the fact that this is fiction and not truth, to why the author includes a complication and resolution, and why the author chose a particular verb. This is long-term work.

Fred
4/3/2017 11:58:10 am

This is a really interesting article, but I wonder if the shape of the
graph of effect size against instruction time is a consequence of a different issue. Lots of people, notably Cheung and Slavin (https://tinyurl.com/h7wr6zc), have found a link between effect size and sample size (bigger samples associated with smaller effect sizes) and I wonder if simply bigger, better resources studies have both bigger samples and longer instruction periods. In essence, people like Simpson (https://tinyurl.com/zhzbnwx) argue that effect size is a really poor measure of comparative educational importance of interventions, since it is better thought of as a measure of the clarity of the experiment, not the importance of the intervention. So longer studies may be much noisier experiments; but this does not mean anything about whether or not longer interventions are better or worse.


Comments are closed.

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory