This weekend I saw some footage about Move4words on the BBC-website:

A routine of exercises developed by an academic who had to re-learn how to read has improved pupils’ reading, writing and arithmetic.

The 15-minute programme developed by Dr Elizabeth McClelland uses physical activity to boost concentration, attention and self-control.

Dr McClelland lost the ability to read after a virus 15 years ago. Simple eye exercises finally restored her ability and now her programmes are being trialled in primary schools across Luton.

Off course this got me curious, so I visited the Move4Words-website. First the positive thing: it’s non-for-profit. Good. But in the video there also the claims that it is scientific. Well, there is a professor emeritus who  is the patron, there are many trials, but… I couldn’t find any peerreviewed research. Only a research poster that was used in a conference comes close to a scientific debate.

Of course the process of peer reviewed papers is long and difficult, so it can be in the works, still there is one quote on the website that got me really puzzled:

Our studies produce effect size values of between 0.5 (immediately after Move4words) and 2.9 (six months after the end of Move4words). These values easily pass the stringent test developed by Professor Hattie to determine if new interventions are worthy of introduction into schools (which requires a minimum effect size of 0.4). We will add the new 2012 results to the following paper as soon as possible!

Just wait a minute. Effect size is not something developed by Hattie but is something we have been using in and outside statistics for ages. Indeed, Hattie did come up with the .40 limit, but to say it’s a test? I also think that John Hattie would take the first flight to England if he saw an effect size of 2.9! In comparison the highest reported effect size Hattie has in his 2009 book is 1.44 for self reported grades.

I think it’s good people try new approaches, also it’s great they try to examine it by trials. Less good is it when stuff is (miss)used to convince people. Hattie has become almost a patron for evidence based education, this Move4words-program isn’t evidence based to such an extent yet.