Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

Did Michael Gove Get the Science Right?

11/19/2012

 
Michael Gove, Secretary of State for Education in Great Britain, delivered a speech on education policy last week called "In Praise of Tests" (text here),  in which he argued for "regular, demanding, rigourous examinations."

The reasons offered included arguments invoking scientific evidence, and cited my work as examples of such evidence. That invites the question "Does Willingham think that the scientific evidence supports testing, as Gove suggested?"

This question really has two parts. Did Gove get the science right? And did he apply it in a way that is likely to work as he expects?

The answer to the first question is straightforward: yes, he got the science right. The answer to the second question is that I agree that testing is necessary, but have a different take on the scientific backing for this claim than Gove offered.

First, the science. Gove made three scientific claims. First, that people enjoy mental activity that is successful--it's fun to solve challenging problems. Much of the first chapter of Why Don't Students Like School is devoted to this idea, but it's a commonplace observation; that's why people enjoy problem-solving hobbies like crossword puzzles or reading mystery novels.

Second, Gove claimed that background knowledge is critical for higher thought, a topic I've written about in several places (e.g., here).

The only quibble I have with Gove on this topic is when he says "Memorisation is a necessary precondition of understanding." I'd have preferred "knowledge," to "memorisation" because the latter makes it sound as though one must sit down and willfully commit information to memory. This is a poor way to learn new information--it's much more desirable that the to-be-learned material is embedded in some interesting activity, so that the student will be likely to remember it as a matter of course.

It's plain that Gove agrees with me on this point, because he emphasized that exam preparation should not mean a dull drilling of facts, but rather should happen through "entertaining narratives in history, striking practical work in science and unveiling hidden patterns in maths." I think the word "memorisation" may be what led the Guardian to use a headline suggesting Gove was advocating rote learning.

Third, Gove argued that people (teachers and others) are biased in their evaluations of students, based on the student's race, ethnicity, gender, or other features that have nothing to do with the students actual performance. A number of studies from the last forty years show that this danger is real.

So on the science, I think Gove is on firm ground. What of the policy he's advocating?

I lack expertise in policy matters, and I've argued on this blog that the world  of education might be less chaotic if each of us stuck a little closer to the home territory of what we know. Worse yet, I know little about the British education system nor about Gove's larger policy plans. With those caveats in place, I'll tread on Gove's territory and offer these thoughts on policy.

It's true that successful thought brings pleasure. The sort of effort I (and others) meant was the solving of a cognitive problem. Gove offers the example of a singer finishing an aria or a craftsman finishing an artefact. These works of creative productivity likely would bring the sort of pleasure I discussed. It's less certain that the passing of examination would be "successful thought" in this sense.

Why? Because exams seldom call for the creative deployment of knowledge. Instead, they call for the straightforward recall of knowledge. That's because it's very difficult to write exams that call for creative responses, yet are psychometrically reliable and valid.

There is a second manner in which achievement can bring pleasure; I haven't written about it, but I think it's the one Gove may have in mind. It's the pleasure of overcoming a formidable obstacle that you were not sure you could surmount.

I agree that passing a difficult test could be a profound experience. Some children really don't see themselves as students. They have self-confidence, but it comes from knowing that they are effective in other activities. Passing a challenging exam might prompt child who never really thought of himself as "a student" to recognize that he's every bit as able as other children, and that might redirect the remainder of his school experience, even his life.

But there are some obvious difficulties in reaching this goal. How do we motivate the student to work hard enough to actually pass the difficult test? The challenge of the exam is unlikely to do it--the child is much more likely to conclude that he can't possibly pass, so there is no point in trying.

The clear solution is to engage creative teachers who have the skill to work with students who begin school poorly prepared and who may come from homes where education is not a priority. But motivation was the problem we began with, the one we hoped to address. It seems to me that the motivational boost we get from kids passing a tough exam might be a good outcome of successfully motivating kids. It's not clear to me that it will motivate them.

My second concern in Gove's vision of testing is how teachers will believe they should best prepare kids for a difficult exam that demands a lot of factual recall.

Gove is exactly right when he argues that teachers ought not to construe this as a call for rote learning of lists of facts, but rather should ensure that rich factual content is embedded in rich learning activities.

My concern is that some British teachers--in particular, the ones whose performance Gove hopes to boost--won't listen to him.

I say that because of the experience in the US with the No Child Left Behind Act. In the face of mandatory testing for students, some teachers kept doing what they had been doing, which is exactly what Gove suggests; rich content interwoven with a demand for critical thinking, delivered in a way that motivates kids. These teachers were unfazed by the test, certain that their students would pass.

Other teachers changed lesson plans to emphasize factual knowledge, and focused activities on test prep. I've never met a teacher who was happy about this change. Teachers emphasize facts at the expense of all else and engage in disheartening test prep because they think it's necessary.

Teachers believed it was necessary because (1) they were uncertain that their old lesson plans would leave kids with the factual knowledge base to pass the test; or (2) they thought that their students entered the class so far behind that extreme measures were necessary to get them to the point of passing; or (3) they thought that the test was narrow or poorly designed and would not capture the learning that their old set of lesson plans brought to kids; or (4) some combination of these factors. So pointing out that exam prep and memorization of facts is bad practice will probably not be enough.

Despite these difficulties, I think some plan of testing is necessary.  Gove puts it this way: "Exams help those who need support to better know what support they need." A cognitive psychologist would say "learning is not possible without feedback." That learning might be an individual student mastering a subject, OR a teacher evaluating whether his students learned more from a new set of lesson plans he devised compared to last year, OR whether students at a school are learning more with block scheduling compared to their old schedule. In each case, you want to be confident that the feedback is valid, reliable, and unbiased. And if social psychology has taught us anything in the last fifty years, it's that people will believe their informal judgments are valid, reliable, and unbiased, whether they are or not.

There's more to the speech and I encourage you to read all of it. Here I've commented only on some of the centerpiece scientific claims in it. Again, I emphasize that I don't know British education and I don't know Gove's plans in their entirety, so what I've written here may be inaccurate because it lacks broader context.

I can confidently say this: hard as it is, good science is easier than good policy. 



Jason link
11/18/2012 10:39:50 pm

Dan,

Excellent anlaysis as usual! I'd agree with every assertion made in this post.

I'd like to point out that as far as memorization versus knowledge it is clear that repetitive and dispersed exposure to knowledge aids in memorization as you've clearly written about in the past.

With regards to how/when to use testing, I've come across some, what I think to be, good information regarding the topic.

Richard Marzano writes extensively on the use of formative assessments that do not necessarily correlate with grades in a classroom but are ongoing assessments which allow teachers to "check-in" and even chart progress made by students, thus allowing greater efficacy of future lessons and targeted interventions/content review periods for those students not meeting teacher-creatd benchmarks in a classroom.

David Wees link
11/19/2012 02:04:23 am

I'm not sure standardized testing achieves the aim of counteracting low expectations by teachers.

There is some research, of which I am sure you are no doubt aware, that shows a close correlation (which is obviously not causation, but bear with me here) between family income and student outcomes on their SAT. so it seems to me that the most likely outcome of blanket standardized testing is to re-enforce teachers' prejudices around the capability of their students. For this reason, I'd prefer less standardized testing, not more - and I think if it does happen, it should be done with random samples, rather than assessing absolutely every student.

I know of a teacher who thinks that if his students do significantly better than the pre-test he gives them at the beginning of the year on any assessment during the year, they must have cheated. Surely we can work directly against this misconception that he is powerless to improve the educational outcomes of his students more efficiently!

The money (and time) saved from not testing every student could be used to improve the educational outcomes of students... while at the same time keeping a layer of "accountability" on the schools in the system to work hard to improve educational outcomes of their students.

Bella Meers
11/19/2012 07:07:32 am

I think there might be more room for creativity in some British exams - although I don't know much about American ones. At age 16 and after exams in humanities subjects have open ended essays and although mark schemes in recent years mean there is much hoop jumping there is certainly some room to be creative

Eli
11/19/2012 05:47:58 pm

Modular exams provide early feedback that students can pass exams. They work harder thereafter and, since the introduction of modular exams, the motivation/attendance of lower than average students has been much harder. Their final grades have been better too.

Getting rid of modular exams will, at a stroke, reduce the motivation/attendance/achievement of lower ability students.

James Wilding link
11/19/2012 06:20:17 pm

Michael Give has chosen to take the UK assessment system for 16 year olds back to a terminal examination process after 2 years. Faced with the daunting large scale knowledge requires lower ability children are once again doomed to the failures of the 50sto1988. Feedback that they have overcome some of the assessments during a course is essential for all learners. The trouble with Give is that he so extreme in his policy execution.

Eli
11/19/2012 05:49:46 pm

'Higher' not 'harder' - sorry

David Harbourne link
11/21/2012 05:13:53 am

Thanks, Daniel - a very interesting analysis.

On the whole, Michael Gove believes exams should last three hours and take place at the end of two years' study. Furthermore, his "English Baccalaureate" recognises good passes in English, maths, science, a foreign language and either history or geography. He has rejected requests to include artistic subjects and technical subjects such as design & technology and engineering in the English Baccaluareate.

Mr Gove has also made plain his belief that tests should focus more on what young people remember (so "memorisation" isn't far from the truth) and less on how they use and interpret knowledge. He is even less interested in what young people can make and do, despite his comment about a craftsman finishing an artefact.

Fortunately, however, his education reforms allow room for some discretion over teaching methods - provided teachers have the courage to use this freedom. For example, University Technical Colleges (14-18 high schools) combine hands-on technical subjects - engineering, for example - with core academics. Although UTCs are in their infancy, there are signs that students respond very well to this mix. They understand maths much better when they have to solve an actual engineering problem, and results in exams start to rise. The challenge is, as you say yourself, to make sure teachers trust their judgement instead of simplistically "teaching to the test".


Comments are closed.

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory