I knew already for a long time that this thinking in gender stereotypes is flawed, but this new study again casts serious doubts on the popular idea that male students perform better than female students in science. Do note that the researchers did find significant differences, but with a weak effect size.
From the press release:
A team of researchers in the Department of Physics and Astronomy analyzed both the midterm exam scores and final grades of more than 10,000 Texas A&M students enrolled in four introductory physics courses across more than a decade, finding no evidence that male students consistently outperform female students in these courses.
The work was led by Texas A&M physicist and Presidential Professor for Teaching Excellence Tatiana Erukhimova.
With help of nearly two dozen departmental colleagues, the Texas A&M team built a database reflecting the complete introductory physics educational spectrum: the calculus-based course sequence primarily taken by engineering and physics majors as well as the algebra-based course sequence typically taken by life sciences and premed majors. Their final analysis shows that exam performance and final letter grades are largely independent of student gender — results which Erukhimova says show promise in ending gender stereotypes that negatively impact so many female students in STEM.
“There is no consistent trend on male students outperforming female students,” Erukhimova said. “Our study also provides new knowledge regarding whether statistically significant differences based on gender occurred on each exam for four introductory physics courses as the semesters were progressing — an area that has not previously been studied, at least not for such a large data set and over a long period of time.”
When differences in final letter grades for a course were observed, there were no persistent differences across that course’s exams, she said. Conversely, when researchers found differences on exams within a course, they observed no differences for final letter grades in that course. In algebra-based mechanics, they found that female students outperformed male students by a small but statistically significant margin.
Their findings were published recently in the American Physical Society journal Physical Review Physics Education Research.
Prior to the team’s study and others similar to it, Erukhimova says it has been an open question as to whether significant differences between male and female students could show up on particular exams but remain slight enough so as not to affect final course grades. For the past 25 years, the physics education profession has relied on inventory tests — optional surveys intended to assess conceptual understanding and retention of key physics concepts — to answer that question, effectively substantiating the argument for gender differences in student performance by default because men tend to score higher on them.
“In the field of physics education research, the majority of existing studies report a persistent gender gap with males performing significantly better than females on introductory mechanics concept inventory assessments, such as the Force Concept Inventory,” Erukhimova said. “The results of prior studies on the gendered differences in student performance based on course grades and examinations are less consistent. While a number of studies indicate that male students outperform female students on the exams and course grades, other groups found no significant gendered difference in student performance.”
The team applied multiple statistical analyses to the course-level data they collected to study whether there were performance differences based on student gender. To see how their findings aligned with student perceptions, they also took a snapshot of the students’ feelings about course performance, inclusion and contributions using a short anonymous questionnaire distributed to 1,600 students in fall 2019.
“Responses indicated that female students had lower perception of their performance than their male classmates,” Erukhimova said. “The only class where female students perceived their performance as equal to their male classmates was algebra-based mechanics, in which females typically outperform males. Additionally, we found that although male and female students may feel differently regarding their performance and in-class contributions, they feel equally included in class.”
Although the team’s study represents clear progress to Erukhimova, she acknowledges it comes with its own limitations — the most significant being that it relies solely on course-level data collected from faculty and does not analyze the possible impact of non-academic factors on student performance. In the future, she says the team would like to connect as much of their data set as possible to university-level records to see how prior preparation, such as SAT scores, affects these results.
“We believe that all students should have equal opportunities and chances for success in physics,” Erukhimova said. “The results of this work may help with fighting the gender stereotype threat that negatively impacts so many female students. By contributing to the body of knowledge about how gender relates to student performance, we hope that our work, which would not have been possible without our colleagues’ data, can be another step in dismantling the preconceived notion of a societal bias based on gender in physics.”
Abstract of the study:
Studies examining gender differences in introductory physics show a consensus when it comes to a gender gap on conceptual assessments; however, the story is not as clear when it comes to differences in gendered performance on exams. This study examined whether gendered differences exist on midterm and final exams in introductory physics courses and if such differences were correlated with a gender difference in final course grades. The population for this study included more than 10 000 students enrolled in algebra- and calculus-based introductory physics courses between Spring 2007 and Spring 2019. We found a small but statistically significant difference, with a weak effect size, in final letter grades for only one out of four courses: algebra-based mechanics. By looking at midterm exam grades, statistically significant differences were noted for some exams in three out of four courses, with calculus-based electricity and magnetism being the exception. In all statistically significant cases, the effect size was small or weak, indicating that performance on exams and final letter grades was not strongly dependent on gender. As an added dimension examining gendered differences, we investigated if differences exist when accounting for instructor gender. Additionally, a questionnaire was administered in Fall 2019 to more than 1600 students in both introductory sequences to explore students’ perceptions of performance, class contributions, and inclusion. We observed some differences between students’ perception of their performance and contribution when grouped by gender, but no difference on perception of inclusion.