Daniel Willingham--Science & Education
Hypothesis non fingo
  • Home
  • About
  • Books
  • Articles
  • Op-eds
  • Videos
  • Learning Styles FAQ
  • Daniel Willingham: Science and Education Blog

Facebook makes us gullible

6/10/2017

 
Educators have been concerned about students' ability to vet information they find on the internet. Better put, the problem lies not just in students’ ability to vet information, but the extent to which they see the need to do so. This issue took on new urgency during the 2016 Presidential campaign, amidst charges that individuals and groups were willfully spreading false stories about candidates they opposed—stories that were accepted by readers and spread on social media.

​A new study indicates that people are somewhat more prone to be credulous when they think they are part of a group of readers.

​Subjects read purported headlines from a news organization. The headlines covered a variety of topics, and they were evenly split for veracity. Subjects were asked to mark them as True or False, or to “flag” the fact, which indicated they would find out the truth or falsehood of that statement at the end of the series. Subjects got a small monetary reward when they were right and a same-size penalty when they were wrong. Raising the flag paid nothing in one experiment and a small reward in another.

​The critical variable of interest is whether subjects thought they performed this task alone or with others, in which case they saw 100 or so other names of people they were told were doing the task at the same time. They were told their performance was not influenced by these other people; they just happened to be doing the task at the same time.

​Across 8 experiments, there was a small but consistent bias to check facts less often if subjects thought other people performed the task too. Of the 8, the most interesting experiment was one where researchers changed the presentation format to make the headlines look like part of a Facebook feed. In that case, it didn’t matter whether they told subjects they were alone; the format was enough to make it feel social, as shown on the graph below. 
Picture
The authors considered (and tested) several hypotheses about what’s going on.

1) Flagging something doesn’t signal “I want to know the answer.” It signals “I’m not sure.” So being in a group, you’re less sure of your answers because you unconscious think “in this big group, someone else really knows the answer, so I won’t pretend to know.” But the researchers collected confidence ratings when people said “true” or “false” and those didn’t differ between the answering alone and answerd with others conditions.

2)  Social loafing. When you’re in a crowd, you figure others are doing at least some of the work (in this case, checking facts) so you don’t feel the need. To check on this, the researchers tried to make subjedts feel like they stood out in the group by making the subjects name on the screen red. This had no impact on the effect.

3) The presence of others makes it a social context, and taking people at their word is a social norm. But you would predict this would also make subjects say that more statements are true and they didn’t do this.

The researchers of a safety-in-numbers interpretation. When people are in a crowd, they feels safe; “there are lots of people here, so there’s no need to be vigilant, to gather more information. If there were a problem, someone would notice it.” The researchers offer some evidence for this: they found that people performed worse on a proof-reading task when they believed they were in a group.

This theory is certainly plausible. It calls to mind Jerry Clore's theory about the impact of emotion on cognition. Clore suggests that negative emotions (anger, sadness) put you in a mode to collect more information—things are not going well (hence the negative emotion) so you need more information, and to focus on details, to figure out what’s going wrong. When you’re happy, in contrast, you’re content to do the sort of thing you usually do in the current circumstance, i.e., to rely on memory and don’t worry so much about collecting new information. Everything is fine, so you keep doing what you’re doing.

That’s all very logical, but it certainly seems to create a difficult situation. If true, the we are all of us slightly more ready to believe anything we read on social media. No, logging into Instagram does not turn you into a credulous zombie—spend five minutes on Twitter, for example, and you’ll see as much disbelief (and anger) as you care for in a day. But the social nature of social media may be one of many contributing factors.

​It highlights the fact that we are still working out the kinks in new media, trying to take advantage of the enormous increase in the our ability to create and to consume content while identifying and thwarting the drawbacks attendant to those increases. 

Is Listening to an Audio book "Cheating?"

7/24/2016

 
I've been asked this question a lot and I hate it.  I’ll describe why in a bit, but for now I’ll just change it to “does your mind do more or less the same thing when you listening to an audio book and when you read print?”

The short answer is “mostly.”
Picture
An influential model of reading is the simple view (Gough & Tumner, 1986), which claims that two fundamental processes contribute to reading: decoding and language processing. “Decoding” obviously refers to figuring out words from print. “Language processing” refers to the same mental processes you use for oral language. Reading, as an evolutionary late-comer, must piggy-back on mental processes that already existed, and spoken communication does much of the lending. 

So according to the simple model, listening to an audio book is exactly like reading print, except that the latter requires decoding and the former doesn’t.

Is the simple view right?

Some predictions you’d derive from the simple view are supported. For example, You’d expect that a lot of the difference in reading proficiency in the early grades would be due to differences in decoding. In later grades, most children are pretty fluent decoders so differences in decoding would be more due to processes that support comprehension. That prediction seems to be true (e.g., Tilstra et al, 2009).

Especially relevant to the question of audiobooks, you’d also predict that for typical adults (who decode fluently) listening comprehension and reading comprehension would be mostly the same thing. And experiments show very high correlations of scores on listening and reading comprehension tests in adults (Bell & Perfetti, 1994; Gernsbacher, Varner, & Faust, 1990).

The simple view is a useful way to think about the mental processes involved in reading, especially for texts that are more similar to spoken language, and that we read for purposes similar to those of listening. The simple view is less applicable when we put reading to other purposes, e.g., when students study a text for a quiz, or when we scan texts looking for a fact as part of a research project. 

The simple view is also likely incomplete for certain types of texts. The written word is not always similar to speech. In such cases prosody might be an aid to comprehension. Prosody refers to changes in pacing, pitch, and rhythm in speech. “I really enjoy your blog” can either be a sincere compliment or a sarcastic put-down—both look identical on the page, and prosody would communicate the difference in spoken language.

We do hear voices in our heads as we read...sometimes this effect can be notable, as when we know the sound of the purported author's voice (e.g., Kosslyn & Matt, 1977). For audio books, the reader doesn't need to supply the prosody--whoever is reading the book aloud does so. 
Picture
For difficult-to-understand texts, prosody can be a real aid to understanding. Shakespearean plays provide ready examples. When Juliet says “Wherefore art thou Romeo?” it’s common for students to think that “wherefore” means “where,” and Juliet (who in fact doesn't know Romeo is nearby at that moment) is wondering where Romeo is. "Wherefore" actually means “why” and she's wondering why he's called Romeo, and why names, which are arbitrary, could matter at all. An actress can communicate the intended meaning of “Wherefore art thou Romeo” through prosody, although the movie clip below doesn't offer a terrific example. 

​So listening to an audio book may have more information that will make comprehension a little easier. Prosody might clarify the meaning of ambiguous words or help you to assign syntactic roles to words.  

But most of the time it doesn’t, because most of what you listen to is not that complicated. For most books, for most purposes, listening and reading are more or less the same thing.  

So listening to an audiobook is not “cheating,” but let me tell you why I objected to phrasing the question that way. “Cheating” implies an unfair advantage, as though you are receiving a benefit while skirting some work. Why talk about reading as though it were work?

Listening to an audio book might be considered cheating if the act of decoding were the point; audio books allow you to seem to have decoded without doing so. But if appreciating the language and the story is the point, it’s not.  ​Comparing audio books to cheating is like meeting a friend at Disneyland and saying “you took a bus here? I drove myself, you big cheater.” The point is getting to and enjoying the destination. The point is not how you traveled. 

"No screen time" study doesn't allow firm conclusion.

9/1/2014

 
NPR, the Daily Mail, and other outlets are trumpeting the results of a study published  in Computers and Human Behavior: The spin is that digital devices leave kids emotionally stunted. But that conclusion is not supported by the study which is, in fact, pretty poorly designed.

Researchers examined kids' ability to assess non-verbal emotion cues from still photos and from video scenes from which dialog had been removed. These assessments were made pre- and post-intervention.

The intervention is where things get weird. The press has it that the main intervention was the removal of electronic devices from children's lives for five days. In fact, the experimental group went to a sort of educational nature camp call the Pali Institute. While control subjects went to their regular school, experimental subjects participated in activities like these:
Picture
This study could almost serve as a test question in an undergraduate research methods course. In the results section, the authors conclude "We found that children who were away from screens for five days with many opportunities for in-person interaction improved significantly in reading facial emotion." As should be obvious from the Table, there were a host of differences between what the experimental kids and the control kids experienced.

In the discussion the authors do allow "
We recognize that the design of this study makes it challenging to tease out the separate effects of the group experience, the nature experience, and the withdrawal of screen-time." But then go on to say "but it is likely that the augmentation of in-person communication necessitated by the absence of digital communication significantly contributed to the observed experimental effect." That's a mere wish. We in fact cannot draw any conclusions about the source of effect.

It's a shame that news outlets are not more discriminating in how they report this sort of work. 

Is Web reading leaving us unable to read longer pieces?

5/7/2014

 
This piece first appeared on RealClearEducation.com on April 16, 2014.
If you would like an email notification when I post a new column at RealClear, send me an email, and I'll add you to my list.

A recent article in the Washington Post sounds a warning klaxon for our ability to read deeply. You’ve probably heard this argument elsewhere, made most forcefully by Nick Carr in the The Shallows: frequent users of the Web (i.e., most of us) are so in the habit of skittering from page to page, scanning for juicy bits of information but not really reading, that they have lost the ability to sit down and read prose from start to finish. I think the suggestion is probably wrong.

The first thing to make clear is that anyone who comments on this issue (including me) is guessing. There are simply not any data that address it directly. We might predict, for example, that scores on standardized reading tests would have dropped in the last fifteen years or so (they haven’t) but such data are hardly definitive, as reading comprehension test scores are a product of many factors.

The Post article cites studies comparing reading on paper versus reading on screens, but that won’t address the issue, which concerns the long-term consequences of a particular type of reading. The Post also incorrectly says that paper is superior. Most studies indicate no difference between screens and paper for pleasure reading. For textbook reading, students take longer to read on screens, although comprehension is about the same. (Daniel & Willingham, 2012).

The article, like all the pieces I’ve seen on this topic, is short on data and long on individual’s impressions. For example, teachers aver that students can no longer read long novels. Well, if we’re swapping stories, I (and most of my classmates) had a hard time with Faulkner and Joyce back in the early ‘80’s, when I was an English major.

The truth is probably that the brain is simply not adaptable enough for such a radical change. Yes, the brain changes as a consequence of experience, but there are likely limits to this change, a point made by both Steve Pinker and Roger Schank when commenting on this issue. If our ability to deploy attention or to comprehend language processes were to undergo substantial change, the consequences would cascade through the entire cognitive system, and so the brain is probably too conservative for large-scale change.

For example, there’s a lot of overlap in the processes of reading and the processes used for understanding spoken speech—processes that assign syntactic roles to words. Do we see any evidence that people are having a harder time understanding spoken language? Or does the problem lie in the mental processes that build understanding of larger blocks of language, as when we’re comprehending a story? If so, habitual Web users should have a hard time understanding complex narratives not just when they read, but in television and movies. No one should have watched The Sopranos, with its complicated, interweaving plotlines.

A more plausible possibility is that we’re not less capable of reading complex prose, but less willing to put in the work. Our criterion for concluding “this is boring. This is not paying off” has been lowered because the Web makes it so easy to find something else to read, watch, or listen to. (I explore the possibility in some detail in my upcoming book, Raising a Reader in an Age of Distraction.) If I’m right, there’s good news and bad news. The good news is that our brains are not being deep-fried by the Web; we can still read deeply and think carefully. The bad news is that we don’t want to.

Reference

Daniel, D. B. & Willingham, D. T. (2012). Electronic textbooks: Why the rush? Science, 335, 1569-1571.

New college promises a new model of education

3/14/2013

 
We are in the midst of an effort to explore what the new technologies enabled by powerful computing and reliable long-distance connection will mean to higher education. (There is, of course, a parallel effort in K-12, but that’s another topic.)

A new entrant is poised to make a bid, and it’s worth some study.

The Minerva Project was initiated by Ben Nelson, the man behind Snapfish (a photo website). His vision is of a university that offers an “uniquely rigorous and challenging university education." (At a price, we might add, that is a relative bargain--reportedly, the target cost is something like half of what the Ivys charge).

The idea is that classes will be delivered via video, and students will then engage in discussion and debate. Importantly, and in pointed contrast to MOOCs, class size will be limited to 25.
Picture
Because the university is virtual, students can live anywhere, but they will be encouraged to live in a different world city each semester, perhaps living together to gain some of the face-to-face interactions that many observers consider a significant advantage of bricks-and-mortar university life.

The curriculum will not rest on traditional academic subject divisions (some English, some math, some science) but rather on four essential skills: critical thinking, use of data, understanding complex systems, and effective communication. If that sounds squishy, be forewarned that the courses are planned to be demanding, and students who do not perform well will (gasp) fail the course.

Minerva is trying something quite different than other online higher ed options. Online universities exist, but their appeal has been their low price and low academic standards and, to a lesser extent, flexibility in scheduling. They claim to offer a degree that is comparable to a traditional degree, though few believe that they do.

It’s still not completely obvious how MOOCs (as implemented in Coursera and edX) will evolve, but no one thinks the long-term purpose is to give away courses. The interpretation I hear most often is that they will not seek replace standard degrees, but will offer more of an a la carte education; you take, say, 12 engineering courses (earning certificates showing that you’ve done the work) in the hopes that the reputation of the participating institutions will be enough to persuade an employer that passing the courses means you’ve got the chops for a job—and you’ve paid just a tiny fraction of what a traditional engineering degree would have cost.

Minerva seeks a third way. It promises an elite education, comparable to the most selective schools in the US. They are gambling that this option will appeal to students who were qualified to attend a big-name university, but didn’t get in.

It’s a darn good bet that there are plenty of frustrated students who thought they had the record for admission to Big-Name U; these places reject 75% or more of their applicants.

It’s no accident that the Minerva website notes that admissions decisions will disregard “lineage, state or country of origin, athletic prowess, or ability to donate.” In other words, "if you fear that you will be jostled by affirmative action targets, athletic admissions, legacies, etc., apply here."

Picture
The question is whether these students will see Minerva as a viable alternative to traditional schools.  

Naturally, that will depend on the quality of the courses and the curriculum. Minerva has not hired any faculty yet, but Nelson has some high profile members on his board (Larry Summers, Bob Kerrey) and they just hired Steve Kosslyn as the founding Dean of the College. Kosslyn has been a Dean at Harvard and was most recently Director of the Center for Advanced Study of Behavioral Sciences at Stanford. To lure someone that capable to devote all of his energies to Minerva bodes well for the project.

We may be seeing the first of new wave of elite colleges. In the colonial era and following, this country saw elite colleges founded to train clergy (Harvard, Yale, Princeton). Better than a century later there was another spate, as wealthy industrialists founded new schools or heavily endowed existing ones (U of Chicago, Stanford, Vanderbilt).

There may well be room for a new model of elite higher education, and Minerva, as the first one out of the gate, holds a significant advantage.  

Note:  Thanks to Chris Chabris, whose Facebook post made me aware of Minerva.

Is technology changing how students learn?

11/1/2012

 
Is technology changing how students learn, that is, the workings of the brain?

An article in today's New York Times reports that most teachers think the answer is "yes," and this development is not positive.

The article reports the results of two surveys of teachers, one conducted by the Pew Internet Project, and the other by Common Sense Media. Both report that teachers believe that students' use of digital technology adversely affects their attention spans and makes them less likely to stick with challenging tasks.

In interviews, many teachers report feeling that they have to work harder than they used to in order to keep students engaged.
Picture
As the article notes, there have not been any long-term studies that show whether student attention span has been affected by digital media.

Still, a lot of psychologists are actually skeptical that digital media are likely to fundamentally change the fundamentals of human cognition.

Steven Pinker has written "Electronic media aren't going to revamp the brain's mechanisms of information processing." I made the same argument here.

The basic architecture is likely to be relatively fixed, and in the absence of extreme deprivation, will develop fairly predictably. Sure, it is shaped by experience but those changes will just tune to experience what's already there--it might change the dimensions of the rooms, without altering the fundamental floor plan, so to speak.

Does that view conflict with teacher's impressions? Not necessarily.

When we talk about a student's attention span, I suspect we're really talking about a particular type of attention. It's not their overall ability to pay attention: kids today can, I think, get lost for hours in a movie or a book or a game just as readily as their parents did. Rather, the seemingly shorter attention span is their ability to maintain attention on a task that is not very interesting to them.

But even within that situation, I suspect that there are two factors at work: one is the raw capacity to direct one's attention. The second is the willingness to do so.

I doubt that technology affects the first, but I'm ready to believe that it affects the second.

Directing attention--forcing yourself to think about something you'd rather not think about--is effortful, even mildly aversive. Why would you do it? There are lots of possible reasons. Among them would be previous experiences leading you to believe that such sustained attention leads to a payoff.

In other words, if you've grown up in circumstances where very little effort  usually led to something that was stimulating and interesting, then you likely have an expectation that that's the nature of the world: I do just a little something, and I get a big payoff. (And the payoff is probably immediate.)

The process by which children learn to expect a lot of cool stuff to happen based on minimal effort may start early.

When a toddler is given a toy that puts on a dazzling display of light and sound when a button is pushed, we might be teaching him this lesson.
In contrast, the toddler who gets a set of blocks has to put a heck of a lot more effort (and sustained attention) into getting the toy to do something interesting--build a tower, for example, that she can send crashing down.

It's hard for me to believe that something as fundamental to cognition as the ability to pay attention can moved around a whole lot. It's much easier for me to accept that one's beliefs--beliefs about what is worthy of my attention, beliefs about how much effort I should dispense to tasks--can be moved around, because beliefs are a product of experience.

I actually think that much of what I've written here was implicit in some of the teachers' comments--the emphasis on immediacy, for example--but it's worth making it explicit.

The "human touch" in computer-based instruction.

9/12/2012

 
The importance of a good relationship between teacher and student is no surprise. More surprising is that the "human touch" is so powerful it can improve computer-based learning.

In a series of ingenious yet simple experiments, Rich Mayer and Scott DaPra showed that students learn better from an onscreen slide show when it is accompanied by an onscreen avatar that uses social cues.
Picture
Eighty-eight college students watched a 4-minute Powerpoint slide show that explained how a solar cell converts sunlight to electricity. It  consisted of 11 slides and a voice-over explanation.

Some subjects saw an avatar which used a full compliment of social cues (gesturing, changing posture, facial expression, changes in eye gaze, and lip movements synchronized to speech) which were meant to direct student attention to relevant features of the slide show.

Other subjects saw an avatar that maintained the same posture, maintained eye gaze straight ahead, and did not move (except for lip movements synchronized to speech).

A third group saw no avatar at all, but just saw the slides and listened to the narration.

All subjects were later tested with fact-based recall questions and transfer questions (e.g. "how could you increase the electrical output of a solar power?") meant to test subjects ability to apply their knowledge to new situations.

There was no difference among the three groups on the retention test, but there was a sizable advantage (d = .90) for the high embodiment subjects on the transfer test. (The low-embodiment and no-avatar groups did not differ.)

A second experiment showed that the effect was only obtained when a human voice was used; the avatar did not boost learning when synchronized to a machine voice.

The experimenters emphasized the social aspect of the situation to learning; students process the slideshow differently because the avatar is "human enough" for them to treat it prime interaction like those learners would use with a real person. This interpretation seems especially plausible in light of the second experiment; all of the more cognitive cues (e.g., the shifts in the avatar's eye gaze prompting shifts in learner's attention) were still present in the machine-voice condition, yet there was no advantage to learners.

There is something special about learning from another person. Surprisingly, that other person can be an avatar.

Mayer, R. E. & DaPra, C. S. (2012). An embodiment effect in computer-based learning with animated pedagogical agents. Journal of Experimental Psychology: Applied, 18,  239-252.

Is the internet killing books?

4/12/2012

 
A lot of people have been tweeting or posting to Facebook a link to a graph which was posted to the Atlantic Monthly website on April 6, with this provocative headline:
Picture
And here's the chart you are urged to show, derived from Gallup poll numbers over the years.
Picture
We're invited to conclude that because the percentage of readers increased after the advent of the Internet, the Internet did not have a negative impact on book reading.

All of the postings I've seen have apparently taken this conclusion at face value, so it seems like it's worth going through why this conclusion is not justified.

First, lots of stuff happened between 1949 and 2005. For example, household income increased for middle- and high-income families. It could be that the internet has negatively affected book reading, but a number of other factors have increased it, so overall we see an increase. The idea that other factors are having a big impact on reading seems legitimate, given the big increase in reading from 1957 to 1990, a year in which very few people had internet access. So perhaps those factors are continuing to boost reading, despite the negative impact of the internet.

The type of analysis we're being asked to perform implicitly is a variety of time series analysis. It's useful in situations where one can't conduct an experiment with a control group. For example, I might track classroom behavior daily for one month using a scale that runs from 1-10. I find that it ranges from 4 to 6 every day. The teacher implements a new classroom management scheme, and from that day forward, classroom behavior ranges from 7 to 9 every day.

Interpreting the new classroom management scheme as the cause of the change is still not certain--some outside-of-class-factor could have just happened to have occurred on that same day that prompted the change in classroom behavior. But the fact that the change in behavior happened over such a narrow time window makes us more confident that such a coincidence is unlikely.

And of course it helps my confidence that it's the same class. In the chart above, we're looking at events that happened over years, with different people who we hope had similar characteristics.

To really get at the effect of the internet on reading habits, you need more finely controlled data. A number of studies were done in the 1950s, examining the effect of television on reading habits. The best of these (see Coffin, 1955) measured reading habits in a city that did not have a television station but was poised to get one, and then measured reading habit again after people in the city had access to television. (The results showed an impact on reading, especially light fiction. Newspaper reading was mostly unaffected, as television news was still in its infancy. Radio listening took a big hit.)

Second, we might note that the most recent year on the chart is 2005. According to the Pew Internet and American Life Project, only 55% of Americans had internet access at that point, and only 30% had broadband. So perhaps the negative impact wouldn't be observed until more people had internet access.

This brings us to more serious studies of whether use of the Internet displaces other activities. The studies I know of (e.g., Robinson, 2010) conclude that Internet use does not displace other activities, but rather enhances them. The data are actually a bit weird--IT use is associated with more of everything: more leisure reading, more newspaper reading, more visits to museums, playing music, volunteering, and participating in sports.

The obvious explanation would be that heavy IT users have higher incomes and more leisure time, but the relationships held after the author controlled for education, age, race, gender, and income--though most of these effects were much attenuated.

This research is really just getting going, and I don't think we're very close to understanding problem.

In sum, the question of what people do with their leisure time and how one activity influences another is complicated. One chart will not settle it.




Coffin, T. E. (1955) Television's impact on society. American Psychologist, 10, 630-641.
Robinson, J. P. (2011) Arts and leisure participation among IT users: Further evidence of time enhancement over time displacement. Social Science Computer Review, 29,  470-480.

Electronic textbooks: What's the rush?

4/2/2012

 
David Daniel and I have a letter in latest issue of Science. It's behind a paywall, so I thought I'd provide a summary of the substance.

David and I note that there is, in some quarters, a rush to replace conventional paper textbooks with electronic textbooks. It is especially noteworthy that members of the Obama administration are eager to speed this transition. (See this report.)

On the face of it, this transition is obvious: most people seem to like reading on their Nook, Kindle or iPad--certainly sales of the devices and of ebooks are booming. And electronic textbooks offer obvious advantages that traditional textbooks don't, most notably easy updates, and embedded features such as hyperlinks, video, and collaboration software.

Picture
But David and I urged more caution.

We should note that there are not many studies out there regarding the use of electronic textbooks, but those that exist show mixed results. A consistent finding is that, given the choice, students prefer traditional textbooks. That's true regardless of their experience with ebooks, so it's not because students are unfamiliar with them (Woody, Daniel & Baker, 2010). Further, some data indicate that reading electronic textbooks, although it leads to comparable comprehension, takes longer (e.g., Dillon, 1992; Woody et al, 2010).

Why don't students like electronic textbooks if they like ebooks? The two differ. Ebooks typically often have a narrative structure,  they are usually pretty easy to read, and we read them for pleasure. Textbooks in contrast, have a hierarchical structure, the material is difficult and unfamiliar, and we read them for learning and retention. Students likely interact with textbooks differently than books they read for pleasure.

That may be why the data for electronic books are more promising for early grades. Elementary reading books tend of have a narrative structure, and students are not asked to study from the books as older kids are.

Further, many publishers are not showing a lot of foresight in how they integrate video and other features in the electronic textbooks. A decade of research (much of it by Rich Mayer and his collaborators and students) show that multimedia learning is more complex than one would think. Videos, illustrative simulations, hyperlinked definitions--all these can aid comprehension OR hurt comprehension, depending on sometimes subtle differences in how they are placed in the text, the specifics of the visuals, the individual abilities of readers, and so on.

None of this is to say that electronic textbooks are a bad thing, or indeed to deny that they ought to replace traditional textbooks. But two points ought to be kept in mind.
(1) The great success of ebooks as simply the porting over of traditional books into another format may not translate to electronic textbooks. Textbooks have different content, different structure, and they are read for different purposes.
(2) Electronic textbooks stand a much higher chance of success if publishers will exploit the rich research literature on multimedia learning, but most are not doing so.

For these two reasons, it's too early to pick the flag and shout "Hurrah!" on electronic textbooks.


A. Dillon, Ergonomics 35, 1297 (1992).
W. D. Woody, D. B. Daniel, C. Baker , Comput. Educ. 55, 945 (2010)

Do kids learn from video games?

3/30/2012

 
Picture
A new review takes on the question "Does video gaming improve academic achievement?"

To cut to the chase, the authors conclude that the evidence for benefit is slim: they conclude that there is some reason to think that video games can boost learning in history, language acquisition, and physical education (in the case of exergames) but no evidence that gaming improves math and science.

It's notable that the authors excluded simulations from the analysis--simulations might prove particularly effective for science and math. But the authors wanted to examine gaming in particular.

Lest the reader get the impression that the authors might have started this review with the intention of trashing gaming, they authors describe themselves as "both educators and gamers (not necessarily in that order)" and even manage to throw a gamer's inside joke in the article's title: "Our princess is in another castle." (If this doesn't ring a bell, an explanation is here.)

And they did try to cast a wide net to capture positive effects of gaming. They did not limit their analysis to random-control trials, but included qualitative research as well. They considered outcome measures not just of improved content knowledge (history, math, etc.) but also claims that gaming might build teams or collaborative skills, or that gaming could build motivation to do other schoolwork. Still, the most notable thing about the review is the paucity of studies: just 39 went into the review, even though educational gaming has been around for a generation.

Making generalizations about the educational value of gaming is difficult because games are never played the same way twice. There's inherent noise in the experimental treatment. That makes the need for systematicity in the experimental literature all the more important. Yet the existing studies monitor different player activities, assess different learning outcomes, and, of course, test different games with different features.

The authors draw this rather wistful conclusion: “The inconclusive nature of game-based learning research seems to only hint at the value of games as educational tools.”

I agree. Although there's limited evidence for the usefulness of gaming, it's far too early to conclude that gaming can't be of educational value. But for researchers to prove that--and more important, to identify the features of gaming that promote learning and maintain the gaming experience--will take a significant shift in the research effort, away from a piecemeal "do kids learn from this game?" to a more systematic, and yes, reductive analysis of gaming.

Young, M. F. et al. (2012). Our princess is in another castle: A review of trends in serious gaming for education. Review of Educational Research, 82, 61-89.
Picture
<<Previous

    Enter your email address:

    Delivered by FeedBurner

    RSS Feed


    Purpose

    The goal of this blog is to provide pointers to scientific findings that are applicable to education that I think ought to receive more attention.

    Archives

    April 2022
    July 2020
    May 2020
    March 2020
    February 2020
    December 2019
    October 2019
    April 2019
    March 2019
    January 2019
    October 2018
    September 2018
    August 2018
    June 2018
    March 2018
    February 2018
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    April 2017
    March 2017
    February 2017
    November 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    December 2015
    July 2015
    April 2015
    March 2015
    January 2015
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012

    Categories

    All
    21st Century Skills
    Academic Achievement
    Academic Achievement
    Achievement Gap
    Adhd
    Aera
    Animal Subjects
    Attention
    Book Review
    Charter Schools
    Child Development
    Classroom Time
    College
    Consciousness
    Curriculum
    Data Trustworthiness
    Education Schools
    Emotion
    Equality
    Exercise
    Expertise
    Forfun
    Gaming
    Gender
    Grades
    Higher Ed
    Homework
    Instructional Materials
    Intelligence
    International Comparisons
    Interventions
    Low Achievement
    Math
    Memory
    Meta Analysis
    Meta-analysis
    Metacognition
    Morality
    Motor Skill
    Multitasking
    Music
    Neuroscience
    Obituaries
    Parents
    Perception
    Phonological Awareness
    Plagiarism
    Politics
    Poverty
    Preschool
    Principals
    Prior Knowledge
    Problem-solving
    Reading
    Research
    Science
    Self-concept
    Self Control
    Self-control
    Sleep
    Socioeconomic Status
    Spatial Skills
    Standardized Tests
    Stereotypes
    Stress
    Teacher Evaluation
    Teaching
    Technology
    Value-added
    Vocabulary
    Working Memory