Sometimes I have to read a lot of research before I find something worth blogging about. That was the case this time, to be honest. But then I came across this study, which is both very recognisable and has quite far-reaching implications. The press release summarises it like this: on days when people are mentally sharper, they get more done. True. But what sits behind that is much more interesting and nuanced.

In this study, Wilson and Hutcherson followed 184 students for 12 weeks. Every day, these students completed a series of short cognitive tasks on their smartphones, think variations of the Stroop, Go/No-Go, and working memory tasks, taking about 10 minutes in total. Based on these, the researchers calculated a composite measure of what they call “mental sharpness”: how precisely and efficiently someone processes information at a given moment.

In addition, the students reported their daily goals and the extent to which they achieved them. Not only in general terms (“how big was the gap between what you intended to do and what you actually did?”), but also through concrete goals they formulated for themselves and later evaluated. Altogether, this produced a rich dataset comprising more than 9,000 measurement points over nearly three months.

What did the researchers find?

The first key result is that there is indeed a relationship between daily cognitive “sharpness” and goal achievement. On days when students perform better on the cognitive tasks, they also report having achieved more of their goals. This relationship persists even after controlling for factors such as sleep, motivation, mood, and hours worked. The effect is not large, but certainly not negligible. The authors put it this way: a one-standard-deviation difference in mental sharpness roughly corresponds to the effect of about 40 extra minutes of work per day. I suspect many people would gladly take forty extra productive minutes. But that is not where the real twist lies.

When the researchers look not at differences within individuals over time, but at differences between individuals, the effect disappears. Students who, on average, perform better on the cognitive tasks are not systematically better at achieving their goals.

An old problem explained

In other words, it is not the case that “smarter” or “better” students get more done. It is the case that the same student gets more done on some days than on others, and that this is related to how sharp they are on that particular day.

This helps to explain a long-standing issue in the literature. Research on self-control, cognitive control, and executive functions often finds surprisingly weak relationships with real-world outcomes. This has sometimes been interpreted as meaning that these cognitive factors do not matter much. This study suggests something different: they do matter, but not at the level at which we usually look. Not as stable traits, but as fluctuating states.

Implications…

We tend to evaluate as if performance reflects stable characteristics. As if a test provides a fairly pure measure of what someone knows or can do. But what if part of that performance simply depends on how “sharp” someone is on that particular day?

This is not a new idea. Anyone who teaches knows there are good days and bad days. But this kind of research makes that variation more explicit and, importantly, measurable. It shows that this variation is not just noise, but systematically related to what people actually get done.

That sharpens a number of issues.

First, the difference between state and trait. Much research has found weak links between cognitive abilities and real-world outcomes. This was sometimes interpreted as meaning that it does not really matter. This study suggests the opposite: it does matter, but not in the way we usually measure it. Not as stable differences between students, but as fluctuating states within students.

Second, what are we actually measuring when we assess? If performance partly depends on day-to-day variation in cognitive “sharpness,” then we are not only measuring knowledge or skill, but also a snapshot of how someone is functioning at that particular moment. That is not necessarily a problem, but it becomes one if we draw strong conclusions from it.

Third, the idea of fairness. We tend to assume that a test creates a level playing field. But if the same student can perform differently on a Monday and a Thursday due to factors such as sleep or accumulated fatigue, then that playing field is less level than we might think.

This does not make assessment meaningless. But it does make the idea of a single measurement as “the truth” harder to defend. Again, this is not entirely new, but it is an important confirmation.

For education

This is perhaps the key implication for education: not that we should start administering cognitive tests to see how “sharp” students are, but that we should think more carefully about how we deal with variation.

There are different ways to do this. By spreading assessment over time and across formats, so that random fluctuations carry less weight. By allowing for retakes or different forms of evidence. And by taking formative assessment more seriously as a counterbalance to summative snapshots. But also by being more realistic about what performance means. A bad day is not necessarily a lack of ability. And a good day is not necessarily a stable level.

At the same time, this study suggests that this issue mainly plays out at the individual level. At the group level, such variation tends to average out, making it less relevant for large-scale assessments such as PISA, PIRLS, or national tests.

Limitations

While this study addresses some limitations of earlier research, it still has important caveats.

First, the study relies on self-reports. Students indicate their own goals and how much they have achieved them. This provides richer information than a single score, but it remains susceptible to bias. What people think they have done is not always the same as what they actually did.

Second, the measurement of “mental sharpness” is clever, but not perfect. It combines several short tasks into a single, relatively noisy measure. The authors themselves note that it captures only part of the true variation. This likely means that the effects are underestimated, but it also calls for caution.

Third, the sample is quite specific: motivated students willing to complete daily tasks for twelve weeks. This is not necessarily representative of students in classrooms, let alone broader populations.

And perhaps most importantly, this is observational research. There is a clear relationship between cognitive sharpness and goal achievement, but that does not automatically mean that one causes the other. Underlying factors may be at play, and the relationship may well run in both directions.

As is often the case, this study does not make reality simpler, but more complex. It confirms something we intuitively already knew, that people fluctuate, but it also challenges the tendency to interpret performance as a fixed characteristic.