After long-standing calls for research into ‘for whom’ neighbourhood matters, the literature has recently gained traction, focussing on background characteristics such as gender, race, and socioeconomic background. However, there is still scarce and only indirect evidence on whether neighbourhood effects vary by children’s academic ability. In this paper, we combine the Neighbourhood Choice Model with quantile regressions to investigate whether neighbourhood effects vary by children’s academic proneness. Using Norwegian register data, we demonstrate heterogeneity in the effects of neighbourhood deprivation as a function of students’ proneness to academic achievement. Students with the very lowest and highest academic potential are the least affected by neighbourhood disadvantage, while those with below average—but not at the lowest end—are most strongly affected. Moreover, while girls are less affected than boys, and children from less educated and affluent families are more affected by neighbourhood disadvantage than their more privileged peers, the effects of these observed moderators are considerably smaller than the heterogeneity observed as a function of academic proneness. Overall, our use of quantile regressions opens up new venues for understanding ‘for whom’ neighbourhoods matter, with individual-level academic vulnerability and strengths being an influential source of neighbourhood effects variation.