Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

Objections to Jo Boaler's Take on Neuroscience and Math Education

3/13/2019

 
Guest post with Daniel Ansari, Professor and Canada Research Chair in Developmental Cognitive Neuroscience in the Department of Psychology and the Brain & Mind Institute at the University of Western Ontario in London, Ontario, where he heads the Numerical Cognition Laboratory.

On February 28th Stanford Professor Jo Boaler and one of her students, Tanya Lamar, published an article that we think is a fine example of how not to draw educational conclusions from neuroscientific data. While we’re more interested in applauding great work than pointing out problems, we feel we can’t ignore an article in a high-profile venue like Time Magazine.
The backbone of their piece includes three points:
  1. Science has a new understanding of brain plasticity (the ability of the brain to change in response to experience), and this new understanding shows that the current teaching methods for struggling students are bad. These methods include identifying learning disabilities, providing accommodations, and working to students’ strengths.
  2. These new findings imply that “learning disabilities are no longer a barrier to mathematical achievement” because we now understand that the brain can be changed, if we intervene in the right way.
  3. The authors have evidence that students who thought they were “not math people” can be high math achievers, given the right environment.
 
There are a number of problems in this piece.
 
First, we know of no evidence that conceptions of brain plasticity or (in prior decades) lack of plasticity, had much (if any) influence on educators’ thinking about how to help struggling students. More to the point, conceptions of cellular processes should not influence specific educational plans or general educational outlook. The notion of the brain lacking plasticity obviously was not taken at face value by educators, nor should it have been—an unchangeable brain would be a brain incapable of learning. (For more on the difficulty of drawing educational implications from neuroscientific findings, see here and here)

Second, Boaler and Lamar mischaracterize “traditional” approaches to specific learning disability. Yes, most educators advocate for appropriate accommodations, but that does not mean educators don’t try intensive and inventive methods of practice for skills that students find difficult. Standard practice for students with a specific reading disability, for example, includes intensive practice in decoding and yes, educators have thought of the idea of trying methods other than the ones that a student seems not to learn from—methods that the authors, at the end of the article, mention were suggested for her daughter with dyslexia and auditory processing difficulties.

Third, Boaler and Lamar advocate for diversity of practice for typically developing students that we think would be unremarkable to most math educators: “making conjectures, problem-solving, communicating, reasoning, drawing, modeling, making connections, and using multiple representations.” More surprising is their charge that “There are many problems with the procedural approach to mathematics that emphasizes memorization of methods, instead of deep understanding.“ We agree with the National Mathematics Advisory Panel report that students should learn (and memorize) math facts and algorithms. We also agree with the Panel (and with Boaler and Lamar) that American students struggle with conceptual understanding. Deep understanding is always more difficult than memorization, and it’s the aspect of mathematics that most kids struggle with, but that doesn’t mean that most math educators don’t care if their students understand math. In our view there is no need to reinvigorate the math wars since an overwhelming body of scientific evidence has demonstrated that students need both – procedural fluency and conceptual understanding. One cannot develop one without the other. In our view it is best to lay this false dichotomy to rest and avoid emotive and value laden arguments such as that students who are strong in conceptual understanding of math are more creative.

Fourth, we think it’s inaccurate to suggest that “A number of different studies have shown that when students are given the freedom to think in ways that make sense to them, learning disabilities are no longer a barrier to . Yet many teachers have not been trained to teach in this way.”  We have no desire to argue for student limitations and absolutely agree with Boaler and Lamar’s call for educators to applaud student achievement, to set high expectations, and to express (realistic) confidence that students can reach them. But it’s inaccurate to suggest that with the “right teaching” learning disabilities in math would greatly diminish or even vanish. For some students difficulties persist despite excellent education.  We don’t know which article Boaler & Lamar meant to link to in support of this point—the one linked to concerns different methods of research for typical students vs students identified with a disability.

Do some students struggle with math because of bad teaching? We’re sure some do, and we have no idea how frequently this occurs. To suggest, however, that it’s the principal reason students struggle ignores a vast literature on learning disability in mathematics. This formulation sets up teachers to shoulder the blame for “bad teaching” when students struggle.

As to the final point—that Boaler & Lamar have evidence from a mathematics camp showing that, given the right instruction, students who find math difficult can gain 2.7 years of achievement in the course of a summer—we’re excited! We look forward to seeing the peer-reviewed report detailing how it worked.

In sum, we think that findings from studies of brain plasticity do not support the implications that Boaler and Lamar suggest they do. Further, we think they have mischaracterized both the typical goals of math instructors, and the typical profile of a student with math disability. 
Douglas Hainline
3/13/2019 07:24:47 am

Change this typo: "To suggest, however, that it’s the principle reason students struggle ..." "principal".

Jo Boaler has written some great books on ways to make one's math classes more interesting, and, hopefully, to get students more engaged in real mathematical thinking, i.e. 'deep understanding'. (She did once say, in an interview, that children did not need to learn their times tables, but surely this is not her settled opinion.)

Much of what she has said recently is a case of the wish being parent to the thought, and seems to be motivated by a strong committment to egalitarianism -- not of rights, but of actual endowments. Sadly, although humans can grant rights, only Nature can grant endowments -- so far -- and she is not an egalitarian.

My personal fear is that the next step is to declare that all mathematical results are equal, and that insisting on 'right answers' is oppressive. Given the rapid decline of sections of the American Academy, I wouldn't be surprised at this development.

Daniel Lee
3/16/2019 01:34:14 pm

There is no typo. "Principal" is the correct word choice. See https://www.merriam-webster.com/dictionary/principal

Daniel Willingham
3/16/2019 02:25:31 pm

There's not typo because I corrected it :)

mike g
3/14/2019 01:11:30 pm

Great blog.

one quibble. "procedural fluency and conceptual understanding. One cannot develop one without the other."

I agree that one cannot develop the latter without the former. But isn't it common for kids to develop procedural fluency without conceptual understanding?

R. Craigen
3/14/2019 01:53:01 pm

I think this is a good point, Mike, and I'll add a bit of nuance.

I take Dr. Ansari's statement to be about the arc of learning mathematics over one's whole education, not about individual learning outcomes. In that setting he's absolutely right (I am speaking only as one experienced in teaching and learning math, as a professional mathematician and professor, not as a cognitive scientist).

Observationally many individual learning outcomes can be learned entirely procedurally, and it is quite common for this to happen, followed by a development of understanding, or for the understanding phase to be dispersed over a longer time, with some delay. Often understanding comes through the execution of procedures; as anyone familiar with any kind of learning (sports, music, auto mechanics, reading, cooking, games, etc) knows, you learn by doing, and this is particularly true in the domain of math.

The point here is that while procedure and understanding mutually scaffold, one cannot simply relegate the origin of these skills to the domain of a chicken-and-egg problem. Something has to come before all else. We start playing number games with small children before they can walk. Toddlers learn to love the one-two-THREE! game where "three" has some reward or surprise or feedback effect. They eagerly recite along with the adults. By they have NO IDEA what that little verse signifies.

Later they learn to recite the numbers from 1 to 10. My 1 year-old granddaughter listens to you count and inserts "three" and "four" and if prompted, the triumphant "ten!". My four-year-old grandson proudly recites the numbers to 20, often with a few misfires, with a bit better than vague awareness of what it's all about, and has long since mastered the game we teach in late toddle-escnce of systematically pointing at objects while reciting the rote-learned magic formula, to "count", a concept which slowly grows.

By kindergarten the concept of counting as a backbone for evaluating number, and the abstract notion of number, are well on their way to development. All this takes time, and is built upon the foundation of the rote-learned skills and procedure of counting, which provides a nutrient-filled container in which the seeds of understanding can grow and bear fruit.

Daniel Willingham
3/16/2019 02:27:16 pm

agree with all this, & more generally gets at math wars question about which to teach first, w/ answer "each supports the other"

Barry Garelick
3/17/2019 12:16:28 pm

Agree with the above. Sometimes understanding comes first, and sometimes the procedure. Students tend to gravitate to the procedure ("just tell me how to do it") and over time, work with the procedure can make one more receptive to the conceptual underpinning. It depends on what procedure is being taught--some procedures are part and parcel with the conceptual underpinning, like multidigit addition and subtraction. Others, like fraction multiplication and division are more removed/abstract. Interestingly, the "understanding" behind some of the more abstract procedures of arithmetic are more accessible when one has more mathematical tools, which one acquires in algebra. Algebra allows for a more generalized representation.

I just gave a talk about this at researchED in Vancouver. The slides of my talks (which contain the script when viewed in "notes" format) can be downloaded from here: https://researched.org.uk/2018-19-sessions/sessions-vancouver-2019/

mike g
3/17/2019 12:54:26 pm

thanks guys. barry those slides are great.

R. Craigen
3/14/2019 01:37:24 pm

Hello Douglas. Boaler has repeated her claim that memorization of times tables is unnecessary on numerous occasions. I believe I could cite six or more separate instances without much difficulty but it tends to be a point she raises consistently in any long-format discussion of math education. I'm not exactly sure what you mean by "surely this is not her settled opinion", but I can't imagine someone who's heard it repeated in her mouth as often as I had could say anything of the sort.

Boaler has a longstanding bad habit of claiming research says things which ... the research she cites does not say.

A few years ago she was citing an OECD study she said showed from PISA data that "memorizers" do not perform as well at mathematical tasks then those who do not memorize. I have no idea how many people looked up her source, but I was among them. The term "memorizers" does not appear in that article. Nor does any mention of "memory". Nor did the article substantiate 3 or 4 other things she claimed in her piece, such as that the U.S. is some sort of a hotbed of "memorizers".

Another time, and over a period of a year or so in several fora she declared that cognitive scientists have "discovered" that making errors -- even when one doesn't know one is making an error -- makes one's synapses fire!

News flash: there's a word for someone whose synapses are not firing, namely "dead". The claim is ludicrous on its face, and to my knowledge has never received as much as a literature citation by Boaler; apparently she considers herself enough of an authority on what cognitive scientists have found that she needn't cite anyone else. I'd be interested to learn otherwise as I'd really like to see what the papers she has in mind *actually* say. Dr. Ansari has also condented with her online about this point, as have other cognitive scientists, and as far as I know she has neither walked back her assertion nor explained it more fully.

Her interest in making the latter point appears to be that she wants to encourage teachers to get students doing more open-ended explorations of problems in which, not having mastered sufficient tools, they are likely to fail repeatedly. It is an answer to the obvious challenge "If you do that will you not just discourage a lot of students?" But if "science" says making mistakes makes your synapses fire well ... of course it is good for them (she would argue). It strikes me as wish fulfilment: she really wants scientists to justify the methods she advocates, strongly enough to consciously or unconsciously read things into their research what is not, to an unbiased observer, evident in it.

I'm a professional mathematician and I've seen far more of the "interesting mathematical exercises" that may be proferred in the classroom than probably 90% of most teachers. Although I do research in math at a much higher level, I am also engaged deeply in mathletics (I am the director of our provincial mathematics competition) and so I interact with the "interesting" stuff on a daily basis. And I can say with certainty that the easiest thing in the world is to compile interesting and engaging problems for classroom enrichment. Collections of these for teachers are a dime a dozen -- my own teachers' shelves from the time I was in Junior High School in the 1970s were loaded down with great collections of this sort. Good for Boaler for collecting such problems but it is hardly a unique, novel or particularly noteworthy contribution. The reason she gets so much airtime is because she's on the warfront as a champion of so-called "progressive education" ideology, and she's articulate and peppers her assertions with claims that everything she says is backed by solid research.

Matthew Gudenius link
4/7/2019 12:36:02 pm

Yep.

Sadly, many people (even powerful decision-makers and policy influencers) will read works by “academics” such as Boaler, and simply accept the claims at face value, without doing any critical evaluation of their own or following the breadcrumbs to the research being (purportedly) cited.

It’s troubling how educators say and accept that “critical thinking” is one of the 4 C’s of 21st century skills... but refuse to employ it themselves when consuming works by prominent progressives/reformists and the like.

Not that I am a traditionalist — I think a lot needs to change — but I think that change needs to come from scientific findings and an honest evaluation of what they conclude, which I found NOT to be the case when my district made “Mathematical Mindsets” mandatory reading. I read it very carefully... and found several things to be surprising, intriguing, or confusing, that I dug deeper... and found that “facts” were unsupported and research conclusions. I felt the need to write a lengthy blog post detailing these: “Jo Boaler is (Half) Wrong - The Many Myths in Mathematical Mindsets”

Interestingly, all of the colleagues I shared it with acknowledged the veracity of the problems I had highlighted (including Boaler’s use of a misleading truncated-axis graph directly relating to this concept vs. procedure debate above)... yet, shockingly, none had thought to originally question the Boaler’s conclusions of their own accord.

That is a troubling state of science, academia, and its consumption, indeed.

sandra stotsky
3/14/2019 01:58:00 pm

https://www.nonpartisaneducation.org/Review/Essays/v8n5.htm
Read what Jim Milgram has to say about Jo Boaler's research. Also see what Wayne Bishop says.

Matthew Gudenius link
4/7/2019 01:01:14 pm

And her response to their shedding light on the methodological problems was that she accused them of “academic bullying” and went on an ad hominem assault, instead of actually defending her research in any way.

When I dug deeper into her book “Mathematical Mindsets” I found that there were several examples of misrepresenting research findings and data (in some cases, the sources she cited literally said the opposite of the conclusions she stated!):

http://www.sanctuarymedia.com/paperlessmojo/jo-boaler-is-half-wrong-the-many-fallacies-of-mathematical-mindsets/

Sandra Stotsky
3/17/2019 01:28:47 pm

https://www2.ed.gov/about/bdscomm/list/mathpanel/report/final-report.pdf
“...the curriculum must simultaneously develop conceptual understanding, computational fluency, and problem-solving skills. Debates regarding the relative importance of these aspects of mathematical knowledge are misguided.”
See Recommendation #10

Susan P Gurganus
3/17/2019 06:50:21 pm

Thanks for putting out this piece. I often cite Rittle-Johnson, Schneider, & Star (2015)--review of literature in Educational Psychology Review (27, 587-597)-- for their discussion of and support for the bidirectional relationship between conceptual understanding and procedural knowledge. These competencies support each other, however the iterative sequence may depend on the specific content and student. (Thus the need for teachers who can assess learning and modify instruction.)

Young children are developing concepts concurrent with "rote learning" or procedural learning. With young children, this learning is embedded more in everyday experiences and may not be recognized as concept understanding. "There are things that can be enumerated" is one concept related to 1, 2, 3, 4 "rote" learning. "There are more here than over there"--another important concept.

There's plenty of support for developing fluency with number combinations, especially multiplicative ones. Fluency eases working memory, provides confidence, allows the learner to notice relationships and move between problem types or representations, and many other benefits. I just dislike the phrase "memorize the multiplication tables" because that is not how the combinations are learned or recalled. The phrase has been used by several state legislatures for "conservative" or "back to the basics" bills promulgated by ALEC. Another pretend math war.

GailB
4/4/2019 06:32:25 pm

Dear Dan, I'm definitely a fan of your blog, and your publications, and thanks for this post!
I'm asking if you've had a look at the online Coursera Course, "Learning How to Learn" by Barbara Oakley and Terence Senjowski,
on this link:
https://www.coursera.org/learn/learning-how-to-learn/home/welcome
I'd be interested to hear your thoughts about this MOOC?


Comments are closed.

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    January 2024
    April 2022
    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory