Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

Who to Believe on Twitter

10/13/2019

 
A recent tweet caught my attention. It was posted by Sherry Sanden, a professor at Illinois State, in response to a thread from APM reporter Emily Hanford, well known to educators for her reporting in the last 18 months on the best way to teach reading and the state of reading instruction in the US. Hanford was responding (I think) to an abstract of a talk Sanden and colleague Deborah MacPhee were to present at ILA, which Hanford thought was inaccurate and possibly a response to her reporting. Hanford posted a series of 14 tweets supporting various aspects of her claims about reading, many with links to the scientific research she cited.

I know this is convoluted and honestly I don't think it matters much, but I'm trying to provide some context. Here's what I really wanted to get at.
This is one of Sanden’s tweets in reply to Hanford.
Picture
I won’t take the time here to defend Hanford’s reporting—I’ve recommended her reports in the past and think they are solid, and she did a fine job of defending herself.

I’d like to comment on the obvious implication that Sanden should be taken more seriously because of her job; she’s a professor of education at Illinois State. She has credentials: she has a PhD in the relevant discipline, she publishes research on the topic, presents at professional conferences, and so on.

This is called argument from authority. In this instance, here’s the form Sanden is hoping it will take.

Proposition 1: Sanden has research-based reasons for believing that X is true about early literacy.
Proposition 2: Random tweeters don’t understand research very well, but have good reason to believe Proposition 1 is true (because of Sanden’s credentials).
Conclusion: Random tweeters believe that conclusion X is supported by research.
 
I considered argument from authority at more length in When Can You Trust the Experts, but here’s a short version.
​
Believing something because someone else believes it rather than demanding and evaluating evidence makes you sound either lazy or gullible. But we yield to the authority of others all the time. When I see my doctor I don’t ask for evidence that the treatments he prescribes are effective, and when an architect designed a new deck for my house I didn’t ask for proof that it could support the weight of my grill and outdoor furniture. I believed what they told me because of their authority.

I think education researchers don’t speak with that kind of authority and (apparently unlike Sanden) I don’t think we deserve it. I can point to two key differences between a doctor (or architect, or accountant, or electrician, etc) and education researchers.

First, I yield authority to someone who has been vetted by a credible entity. I know that, unless you break the law, you cannot practice medicine (or follow the other professions named) without being licensed by the state of Virginia. I haven’t looked into the matter, but I have no reason to think that the accrediting agencies aren’t doing an acceptable job. For one thing, most of the professionals I hire achieve what I expect them to achieve.
Education researchers, in contrast, are not licensed by a credible authority.

Anyone can take the title “education researcher.” That’s why we must point to earmarks of authority like academic degrees, training, and publications ; these make the silent claim “people with expertise think I’m an expert too,” which is, of course, a bit circular. Sometimes researchers mention television, radio and public speaking appearances. That’s called “social proof,” boiling down to “other people think I’m worth listening to.

The problem is that these earmarks of authority are not very reliable. The marketplace is cluttered with purveyors of snake oil who bear degrees, and even some who have published articles in “peer-reviewed” journals. As readers of this blog know, the idea that “peer review” is a guarantee of high quality in a journal does not bear close scrutiny.

But there’s a second, more important difference between education research and professions where people readily accept argument from authority. Those other fields have more accepted truths.

When I get an electrician to figure out why the breaker in my living room keeps flipping, I understand she may be more or less skillful in diagnosis and repair than another licensed electrician. What I don’t expect is that she could have wildly different—perhaps completely opposing—ideas about how electricity works and how to wire a house compared to someone else I might have called.

Education researchers do not speak with one voice, and that makes it hard to expect an argument from authority will work, as they take this form:

Proposition 1: Sanden says that when it comes to early reading, scientific research suggests “X” is true.
Proposition 2: Willingham says that when it comes to early reading, scientific research suggests “not X” is true.
Proposition 3: Random tweeter has equally good reason to believe (based on their credentials) that Proposition 1 and Proposition 2 are true.
Conclusion: ??????

We can’t make arguments from authority if equally authoritative people disagree.

Part of the problem is that people who enter these arguments actually come at the problems with different assumptions and understandings about what constitutes evidence, and indeed, what it means to know something. That’s most obvious when we have had very different training. Cognitive psychologists and researchers in critical theory address aspects of education that are largely non-overlapping, and you’ll find some of each
these folks in most schools of education, with similar credentials.

I’ve argued elsewhere that those of us in education research would do ourselves a favor if we would make our assumptions more explicit, as well as the limitations of the tools in our analytic toolbox—what problems are our methods well suited to answer and what can’t we answer? I think you don’t hear that often enough.

A final note. Later in the thread Sanden posted this
Picture
​And then this…
Picture
​Understood, but that’s social media. It may be frustrating and seem ludicrous that teachers use it to inform themselves, but here we are. If you want people to believe you, it's incumbent on you to explain your reasoning. 

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    April 2022
    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory