Growth mindset interventions at scale: Experimental evidence from Argentina
This study presents one of the first evaluations of a “growth mindset” intervention at scale in a developing country. I randomly assigned 202 public secondary schools in the Province of Salta, Argentina to a treatment group in which staff from the ministry of education invited grade 12 students to read a text about the malleability of intelligence, write a letter to a classmate about its main lessons, and post their letters in their classroom, or to a business-as-usual control group. I verify that the intervention was implemented as intended in 90% of treatment schools. Yet, I find no evidence that it led students to find challenging tasks less intimidating. It had a null effect on students’ perceptions of the difficulty of schoolwork, their self-efficacy in math and language, and their views on the usefulness of classroom tests. It did not increase student effort in tasks related to school (e.g., attendance), personal development (e.g., reading books), or work. It did not improve school climate, including relationships between peers, bullying, or student vandalism. Consistent with these results, the intervention had no impact on students’ performance in school (e.g., passing, repetition, or dropout rates), achievement in the national assessment, or plans to pursue post-secondary education. In nearly all outcomes, I can rule out even small effects and find little evidence of heterogeneity by student characteristics (sex, socio-economic status, or prior grade repetition) and school characteristics (prior achievement, resources, and supports for low-performing students). This study suggests that the benefits of growth mindset interventions may be more challenging to replicate and scale in developing countries than anticipated.
Teaching with the test: Experimental evidence on diagnostic feedback and capacity-building for public schools in Argentina (with R. de Hoyos and P. A. Holland)
We examine the impact of two strategies to use large-scale assessment results to improve school management and classroom instruction in the Province of La Rioja, Argentina. We randomly assigned 104 public primary schools to: a diagnostic-feedback group, in which we administered standardized tests at baseline and two follow-ups and made results available to schools; a capacity-building group, in which we also conducted workshops and school visits; or a control group, in which we administered tests at the second follow-up. After two years, diagnostic-feedback schools outperformed control schools by .33σ in math and .36σ in reading. In fact, feedback schools still performed .26σ better in math and .22σ in reading in the national assessment a year after the end of the intervention. Additionally, principals at these schools were more likely to use assessment results for management decisions and students were more likely to report that their teachers used more instructional strategies and rated them more favorably. Combining feedback with capacity building does not seem to lead to additional improvements, but this might be due to schools assigned to receive both components starting from lower learning levels and participating in fewer workshops and visits than expected.
The untapped math skills of working children in India: Evidence, possible explanations, and implications (with A. V. Banerjee, S. Bhattacharjee & R. Chattopadhyay)
It has been widely documented that many children in India lack basic arithmetic skills, as measured by their capacity to solve subtraction and division problems. We surveyed children working in informal markets in Kolkata, West Bengal, and confirmed that most were unable to solve arithmetic problems as typically presented in school. However, we also found that they were able to perform similar operations when framed as market transactions. This discrepancy was not explained by children’s ability to memorize prices and quantities in market transactions, assistance from others at their shops, reliance on calculation aids, or reading and writing skills. In fact, many children could solve hypothetical transactions of goods that they did not sell. Our results suggest that these children have arithmetic skills that are untapped by the school system.