Research on the effects of school composition tends to focus on how it shapes school achievement. In this study, we instead examine how school composition shapes children’s educational aspirations, given their achievement, and if children from different socio-economic backgrounds are affected differently. We apply school-fixed effects on Swedish register data, including all 9th-grade students from 2013 to 2017. Being exposed to a high share of low-achieving schoolmates increases the likelihood of applying for academics instead of vocational tracking across socio-economic backgrounds. In contrast, the share of high-achieving schoolmates is negatively associated with academic tracking only for high-SES children. Being exposed to peers with highly educated parents increases the likelihood of applying for academic tracking for low-SES children, whereas the effect is weaker or even negative for some of the high-SES groups. Together, our results suggest that the academic decisions of both high- and low-SES children could benefit from a less segregated school environment.