Each trimester, I make it very clear to students that regular attendance at classes offers greater chances at success for them. Those statements are based on years of observational data on student performance in my papers - students who attend more regularly have higher pass rates, and better grades. Part of that is clearly selection bias - students who attend less often may have lives that are more complicated, making it difficult for them to keep up with studying. Alternatively, students who attend less often may be less motivated, and that affects both attendance and willingness to study. However, just before the pandemic, we ran an experiment in the ECONS101 class that provided some evidence that incentivised non-attendees to attend class, and that did appear to improve performance, suggesting that at least some of the effect of attendance on performance is causal (that study has still not been written up for publication, sadly).
On the other hand, I am very aware of the large (and still growing) literature comparing online, blended, and in-person teaching and learning modes (see this post, and the long list of links at the end of it). My takeaway from that literature is that teaching mode has no effect on student performance (or student learning) on average, but has important heterogeneous effects. More able (or more self-directed) students tend to do better in online and blended learning environments, whereas less able (or less self-directed) students tend to do worse in those environments. Based on that evidence, I encourage in-person attendance as I am somewhat more focused on ensuring that the less able students have the best opportunity to succeed. However, in the back of my mind, I do harbour some reservations that the top students are not necessarily getting the best learning experience as a result.
Those reservations seem to now have some support, from this 2023 article by Sofoklis Goulas (Brookings Institution), Silvia Griselda (Bocconi University), and Rigissa Megalokonomou (Monash University), published in the Journal of Economic Behavior and Organization (ungated earlier version here). They look at a relaxation of attendance rules at Greek high schools, and the effects on attendance and student performance. Specifically:
The education system in Greece has a very strict attendance policy. All high- school students attend classes back to back with short recesses in between from 8 am to 2 pm, Monday through Friday...
Until the end of the 2005-06 school year, every student was allowed a maximum of 50 unexcused and 64 hours (about 10 days) of excused class absences in a year. One absence is equal to one missed school period...
Before the beginning of the 2006-07 school year, the Ministry of Education announced a nationwide policy to encourage students’ autonomy (Gov. Gazette 65/A/30-3-2006). The policy provided eligible students with 50 additional excused class absences. Every student who had received a raw GPA higher than 75% the year before was eligible to take up more parent- approved absences in the current year.
Goulas et al. then use a difference-in-differences-in-differences approach, which involves comparing the difference between students who were eligible (greater than 75% GPA the previous year) and those that were not eligible, between Grade 11 (no relaxed policy) and Grade 12 (relaxed policy), between the 2006 and 2007 years (when the policy was implemented). That allows them to estimate the causal impact of the change in attendance policy on student outcomes, including high-stakes exam performance (in subjects that count towards university entrance) and low-stakes exam performance (in subjects that do not count towards university entrance). Goulas et al. find that:
Targeted students in the treated cohort took more absences and improved their high-stakes exam performance as a result of the increased autonomy policy. In particular, targeted students increased their total (excused) absences by four (three) additional class hours—roughly 0.09 (0.13) standard deviations—relative to non-targeted students during the year the increased autonomy policy was in effect. Targeted students' high-stakes exam performance increased by 0.07 standard deviations—or 0.019 standard deviations per missed period—due to the increased autonomy policy. Targeted students' low- stakes exam performance remained unaffected by the increased autonomy policy.
So, the policy, which was targeted at top students, appeared to increase their class absences (which was what it was designed to do), and improved those students' performance. Goulas et al. also show that:
...the increased autonomy policy is found to be associated with an increase in university admission score of 0.13 standard deviations... also... increased autonomy is associated with being admitted to university degree programs of higher quality/selectiveness—an improvement roughly equivalent to two percentiles in the distribution of degree quality.
So, the relaxation of attendance for top students also affects their long-term prospects in a positive way. However:
The policy is also associated with an increase of roughly 0.12 standard deviations in non-targeted students’ excused absences (roughly three additional excused class absences) in the year the increased autonomy policy was introduced. The effect of the policy on non-targeted students’ total absences or on school performance is not statistically significant. The unexcused absences of targeted and non-targeted students are unaffected by the increased autonomy policy.
So, other students also had more absences, but their performance was not affected. At least they weren't made worse off. Goulas et al. then dig a little deeper, showing that the change in absences was greatest among the top quartile of eligible students (in terms of GPA). However, that analysis doesn't show that those top-quartile students perform any better than other eligible students (in fact, the effects seem to be largest for the lowest quartile of eligible students).
What might be causing these results? Goulas et al. identify five potential mechanisms:
A first mechanism through which increased autonomy could influence performance is because of the attendance-performance association, which may also differ across students... A second mechanism through which increased autonomy could affect performance is related to the effective class size. As students take more class absences due to the increased autonomy policy, the class size decreases and student performance increases. A third mechanism may be related to changes in peer characteristics due to the increased autonomy policy. As targeted students skip class more often, the effective peer characteristics may change, impacting student performance... A fourth channel of influence of increased autonomy on performance is through teachers. As targeted students skip class more often because of the increased autonomy policy, instruction might become more effective... A fifth channel of influence of the increased autonomy policy on performance is related to student motivation from agency as suggested by the Self Determination Theory... Students targeted by the increased autonomy policy might feel they are being treated as responsible individuals, capable of making optimal decisions on their own, potentially feeling motivated to perform higher...
Goulas et al. then show that there is little evidence to support the effective class size, effective peer characteristics, and the instruction quality mechanisms, because there are similar impacts on eligible students in classes with higher or lower proportions of eligible students. That leaves the attendance-performance mechanism and greater agency. Goulas et al. show that controlling for decreased attendance explains most of the effect of the policy change on student outcomes, which suggests that it is the change in attendance that most explains the change in student performance.
What can we take away from this study? Class attendance may well make the top students worse off in terms of their academic performance. However, it is likely that what students do with the spare time does need to also be considered. This policy change was directed at the top 25 percent of Greek high school students, and they were well aware that they had a high-stakes university entrance examination at the end of the year. And, the additional absences needed to be approved by parents, who are likely to maintain at least some control over their children's activities during their absences. In other contexts, and with less motivated (or less closely supervised) students, the impacts are unlikely to be the same.
Also, I'd be cautious before extending these results to the university context. In my experience, students who are not attending are likely to be working (or playing video games) rather than studying during that freed up time. And past studies have shown that working impacts negatively on student performance (see this post, and the links at the bottom of it). However, the study does give some food for thought - maybe strict attendance norms can be relaxed for top students who are clearly engaged in other outside learning activities?
No comments:
Post a Comment