Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

New studies show the cost of student laptop use in lecture classes

4/2/2017

 
It's been about ten years since college students on most campuses began to take notes on a laptop in lecture classes. So that's about 10 years of professors fretting about it.

It seems obvious that students are, at the least, themselves distracted during lectures--supporting anecdotal evidence can be collected by popping into the back of any large lecture hall and observing laptop content; you'll see plenty of social media websites open, students responding to messages or email, and a surprising number of people shopping.
Picture
Photo credit: http://www.commonwealthtimes.org/2012/09/09/social-studies-does-facebook-distract-students/
​More insidious, some data indicate that using a laptop is distracting to students sitting behind the multi-tasking student.

But most data on the consequences of laptop use are correlational; for example, students who report taking notes on laptops earn lower grades than those who don't, and observational data show that students have non-course related software open during class (e.g., Kraushaar & Novak, 2010). The obvious problem is that laptop use may not be causing low grades; laptop use may be more appealing to those who would earn lower grades anyway. 

Two new studies using different methods suggest that laptop use does, indeed, incur a cost to students.

In one (Carter et al., 2017) students in sections of a required introductory economics course were randomly assigned to use a laptop or to refrain from doing so. In a clever twist, some classrooms were asked to take notes on tablets with the tablet lying flat, hence reducing the likelihood that the screen would distract neighboring students.
Picture
The final examination was the same across sections, so scores on the exam served as the outcome measure for the study. Laptop (or tablet) use was associated with lower scores, d = -.18 (controlling for demographic variables, GPA, and ACT scores at admission). It is noteworthy that all of the effect was carried by performance on the multiple choice and short-answer portion of the exam, with no effect on essay grade. The researchers noted that essay grading is not objective and professors might center their grades on student performance. 

We can have greater confidence that laptop use is really causal here, given that class sections were randomly assigned to use them or not. But there are some other caveats of interpretation. It's possible that teachers teach differently when they know their students are taking notes on devices. We should also be cautious in generalizing beyond the institution (West Point) and the class (economics). For example, perhaps economics requires the drawing of many figures and graphs, a process that's clumsy on a device. Perhaps the same experiment conducted in an English literature class would show no effect. Or maybe laptop use offers a small benefit to most students, but there's a minority for whom the forced use of a laptop incurs a big cost.

The second study (Patterson & Patterson, 2017) uses a different, complimentary method that avoids these problems (but has others).

​The researchers noted that, at their institution, different classes required laptops (15%), forbade them (2%), or made them optional (83%). The researchers reasoned that a student who had a laptop-optional class might be nudged into using one if she had a laptop-required class the same day. After all, she would already have the laptop with her, so why not use it? And indeed, their survey showed that students were about 20% more likely to use a laptop under those circumstances.

And students were 48% less likely to use laptop in a laptop-optional class if they had another class the same day that forbade laptop use. 

So researchers compared grades in a class where some students are biased to use laptops and others were biased not to use them--biased, not forced, so if a student believes he really takes better notes on a laptop, he can use it. And both the laptop-user and non-user are in the same class, with the same opportunities to be distracted by other students, and experiencing the same lecture from the professor. 

Researchers analyzed about 5,500 grades in lap-top optional courses from undergraduate and masters students over the course of six semesters. All were enrolled at the same liberal arts college. 

The effect of having a laptop-required course at another time was d = -.32 to -.46.  Having a laptop-prohibited course the same day was associated with a positive effect, d = .14 to .25. (These effects controlled for gender, ethnicity, age, course load, course schedule difficulty, major, and GPA.)

Patterson & Patterson found that the negative effect was larger for weaker students--in fact, there was little or no effect for stronger students. They also found that laptop use (or more precisely, having a laptop-required course the same day) had a larger negative effective in quantitative classes. 
​
So we have two studies--a randomized control trial, and a quasi-experimental design--to add to the correlational studies showing that students are better off taking notes by hand than doing so on a laptop. None is perfect, but different designs have different flaws. This desirable state of affairs is referred to as converging operations--different types of experiments all point to the same conclusion. ​

In closing, it's worth remembering that this study does not concern all classroom laptop use, but rather one function: taking notes in a lecture course. Still, considering that most time in introductory college courses is spent listening to lectures, the impact of this work ought to be consequential. 
Erica Kleinknecht
4/3/2017 08:35:01 pm

Do you think the effect has more to do with the rich vs. poor movement of the hands (as implied in the 2013 Sci AM article) or more to do with the benefits of paraphrasing that are more easily achieved via handwriting, but that strong students can achieve in later studying, even if they type their notes? I ask because I read this work and then am left wondering how to best advise students who need to type, for example students with dysgraphia, or how to best advise students who don't take notes at all, as an accommodation for an LD. What might such students do to make sure they maximize their learning experience? Curious to know how you might advise, in such cases.

Valerie Martin
4/4/2017 10:55:04 am

The best accomodation here would be to maximize the listening. For a student with dysgraphia, recording the lecture and then, at a later moment, listening and type notes would be the best approach. For a student with LD, listening is also the best. If he has a note taker, he will then read the notes and can add or adjust depending on what he remerbers.

Miriam Kurtzig Freedman, author of Special Education 2.0 link
4/5/2017 11:38:44 am

This result doesn't surprise me--based on my own life experience. I'm not a researcher or a psychologist, but do believe that when I actively listen, perhaps jotting down notes, I hear more. When I tap on a keyboard--a seemingly more passive--and not brain connected-- activity--I hear less. I appreciate this confirming (though incomplete) new research. Thank you!

Mike G
4/22/2017 02:46:42 pm

Good post. Thank you.

The West Point study concludes with wondering about the cause. They speculate it's one of these 3:

1. "worse note taking" per Miriam above

2. "professors teaching differently" b/c laptops are there.

3. distraction. facebook, etc. (to which I'd add even offline temptations - working offline on Word, Excel, on "something else"...like homework in another class due in a couple hours.

I'd bet on combo of mostly 3, and some 2. Professors w distracted students do two things

a. less cold-calling (seeking to avoid conflict)

b. ask less rigorous questions (Horace's Compromise)


Comments are closed.

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory