Replication is very important in science, but sometimes the results can hurt. Hurt a lot. Yesterday I found this new replication meta-study on a very famous insight in psychology via this tweet by Stuart Ritchie:
The study he discusses is the 1988 study by Strack, Martin & Strepper:
We investigated the hypothesis that people’s facial activity influences their affective responses. Two studies were designed to both eliminate methodological problems of earlier experiments and clarify theoretical ambiguities. This was achieved by having subjects hold a pen in their mouth in ways that either inhibited or facilitated the muscles typically associated with smiling without requiring subjects to pose in a smiling face. Study 1’s results demonstrated the effectiveness of the procedure. Subjects reported more intense humor responses when cartoons were presented under facilitating conditions than under inhibiting conditions that precluded labeling of the facial expression in emotion categories. Study 2 served to further validate the methodology and to answer additional theoretical questions. The results replicated Study 1’s findings and also showed that facial feedback operates on the affective but not on the cognitive component of the humor response. Finally, the results suggested that both inhibitory and facilitatory mechanisms may have contributed to the observed affective responses.
It’s a famous study and I think there is indeed a big chance you’ve heard about the results.
But this new replication meta-study examining 17 studies replicating the original research is quite damning:
According to the facial feedback hypothesis, people’s affective responses can be influenced by their own facial expression (e.g., smiling, pouting), even when their expression did not result from their emotional experiences. For example, Strack, Martin, and Stepper (1988) instructed participants to rate the funniness of cartoons using a pen that they held in their mouth. In line with the facial feedback hypothesis, when participants held the pen with their teeth (inducing a “smile”), they rated the cartoons as funnier than when they held the pen with their lips (inducing a “pout”). This seminal study of the facial feedback hypothesis has not been replicated directly. This registered replication report describes the results of 17 independent direct replications of Study 1 from Strack et al. (1988), all of which followed the same vetted protocol. A meta- analysis of these studies examined the difference in funniness ratings between the “smile” and “pout” conditions. The original Strack et al. (1988) study reported a rating difference of 0.82 units on a 10 point Likert scale. Our meta-analysis revealed a rating difference of 0.03 units with a 95% confidence interval ranging from -0.11 to 0.16.
Or shown as an image:
Via the tweet conversations following the tweet by Stuart Ritchie I also found this reply by Strack and this reply on this reply by the researchers.
Reblogged this on kadir kozan.
[…] weken geleden kwam er het nieuws dat (weer) een belangrijk psychologie-onderzoek niet kon worden gerepliceerd: een glimlach door een pen in de mond maakt je niet gelukkiger. Voor BPS Digest maakte Christian […]
[…] video is al wat ouder wat je oa kan merken aan de verwijzing naar het weerlegde potlood-experiment , maar is een mooie […]
[…] No scientific nonsense here (gratitude journal, meditation – begone!), only fun stuff. Besides, did you know that science says putting a pencil in your mouth will make you happy? […]
[…] Famous psychology study ‘killed by replication’: does a pencil in your mouth make you feel happy… […]
[…] bekend ‘slachtoffer’ is bijvoorbeeld het onderzoek waarbij een potlood in de mond je beter zou doen voelen. Maar het zou fout zijn om nu te denken dat elk replicatie-onderzoek slachtoffers maakt. Sommige […]
[…] Embodied cognition. Ego-depletion. Stereotype threat. Priming. Grit and growth mindset as malleable traits. Correlating political stances with 3 stages of ovulation, 5 personality traits, 6 body types, and 34 flavors of ice cream. […]
[…] was shown once, by that famous pencil experiment, but then some joy killers came along with this. But, like Mulder, I want to believe, so I do. Mystery/magic/wonder: I am keeping it all, along […]
[…] experiment where people faking smiles were indeed more relaxed… only this experiment was replicated 2 years ago and the results weren’t so optimistic). Apparently, fake smiles don’t work, you really […]
[…] Je zou er ondertussen ook Growth Mindset, Grit en misschien de power pose kunnen aan toevoegen. Al moet ik er aan toevoegen dat Milgram recent ook succesvol werd gerepliceerd. Oja, er is ook nog het potloodverhaal dat niet meer klopt. […]
Reblogged this on Remove the end justifies the means!.
[…] I told you already that science can be messy? If not, welcome to this blog! 2 years ago I posted this replication of the infamous pencil in the mouth study. It has become one of the more well known examples of the replication crisis. But it also spurred a […]
[…] Famous psychology study ‘killed by replication’: does a pencil in your mouth make you feel happy… […]
Your over simplication of this makes topic me think you missed the point of the original (scientific) study.
Oh really? Strange as in my piece I’ve only quoted the original research and the replication…
[…] Famous psychology study ‘killed by replication’: does a pencil in your mouth make you feel happy… […]
[…] improves one’s mood and vice versa. Even though recent replication studies have put the accuracy of the original results in question, I think the idea behind the test still works as a metaphor. For me, at […]
[…] Famous psychology study ‘killed by replication’: does a pencil in your mouth make you feel happy… […]
[…] Famous psychology study ‘killed by replication’: does a pencil in your mouth make you fe… […]
Aparently knowing you’re being filmed is what kills the second experiment.
https://www.theguardian.com/science/2018/oct/17/smiling-does-make-you-happier-under-carefully-controlled-conditions
Thanks for the link!