Executive functions are quite hot in education lately, check e.g. this evidence-based guide. But do they really work? A federally funded meta-analysis of 25 years’ worth of research finds no conclusive evidence that developing students’ executive function skills leads to better academic performance. It seems to be a case of correlation versus causal relationship and maybe a case of ‘not yet’ proven results.
From the press release:
The meta-analysis, by researchers Robin Jacob of the University of Michigan and Julia Parkinson of the American Institutes for Research, analyzed 67 studies published over the past 25 years on the link between executive function and achievement. The authors critically assessed whether improvements in executive function skills–the skills related to thoughtful planning, use of memory and attention, and ability to control impulses and resist distractions–lead to increases in reading and math achievement, as measured by standardized test scores, among school-age children from preschool through high school. More than half of the studies identified by the authors were published after 2010, reflecting the rapid increase in interest in the topic in recent years.
While the authors found that previous research indicated a strong correlation between executive function and achievement, they found “surprisingly little evidence” that the two are causally related.
“There’s a lot of evidence that executive function and achievement are highly correlated with one another, but there is not yet a resounding body of evidence that indicates that if you changed executive functioning skills by intervening in schools, that it would then lead to an improvement in achievement in children,” said Jacob. “Although investing in executive function interventions has strong intuitive appeal, we should be wary of investing in these often expensive programs before we have a strong research base behind them.”
“Studies that explore the link between executive function and achievement abound, but what is striking about the body of research is how few attempts have been made to conduct rigorous analyses that would support a causal relationship,” said Jacob.
The authors note that few studies have controlled for characteristics such as parental education, socioeconomic status, or IQ, although these characteristics have been found to be associated with the development of executive function. They found that even fewer studies have attempted randomized trials to rigorously assess the impact of interventions.
“Although the link between the two may well be causal, the link needs to be clearly established before programs designed to improve executive function in school-age children are taken to scale,” said Jacob.
Co-author Robin Jacob discusses key findings:
The meta-analysis provided several findings on the correlation between executive function and academic function:
- The correlation is highly consistent whether measured at a single point in time or as a predictor of future achievement.
- The correlation is approximately the same for different age groups–three-to-five year olds, six-to-11 year olds, and 12-to-18 year olds.
- The correlation is about the same for achievement in both reading and math, countering the common assumption that executive function is more closely associated with success in math.
- The correlation is consistent across subcomponents of executive function (inhibition, attention control, attention shifting, and working memory).
Abstract of the study:
This article systematically reviews what is known empirically about the association between executive function and student achievement in both reading and math and critically assesses the evidence for a causal association between the two. Using meta-analytic techniques, the review finds that there is a moderate unconditional association between executive function and achievement that does not differ by executive function construct, age, or measurement type but finds no compelling evidence that a causal association between the two exists.
[…] paar jaar wordt er druk onderzocht hoe je deze functies bij kinderen kan stimuleren en verbeteren, met voorlopig wisselend succes. Nu is er een nieuw onderzoek dat er in slaagde om positieve resultaten op te leveren, maar de […]
[…] Oops: little evidence yet that executive function interventions boost student achievement […]
[…] Oops: little evidence yet that executive function interventions boost student achievement […]
[…] In the latest issue of this fine newsletter, this study caught my eye because it suggests a long term impact of working on executive functions which has been an issue in the past. […]
[…] While this quote from the conclusion hints an important element of nurture, I do think the most important question actually remains: what is the influence of the schools themselves in this and what is the influence of the students, aka nature-nurture. In their introduction the researchers mention a lot of elements such as perseverance and impulse control that we’ve known already from executive-function research. How these functions can be trained with a long standing effect has still to be proven without any do…. […]
[…] 2015 I wrote this blogpost on a meta-analysis on the training of executive functions. The results were a bit depressing. Today I found a new meta-analysis via Jeroen Jansen and the […]