During the early stages of the COVID-19 pandemic, individuals were asked to stay home and restrict outings to limit the spread of the virus. Physical isolation was particularly emphasized for older adults over the age of 60 who, because of their age and related medical conditions, were at increased risk of severe disease and death from the virus. This led to reduced spread of the virus but also to social and emotional health challenges for older adults. Protecting the physical health of older adults was of the utmost importance during the pandemic but supporting social and mental health must not be overlooked. This patient-oriented qualitative study involved 40 interviews with older adults, conducted in the early stages of the pandemic, followed by a thematic analysis. Three themes were derived from the findings: subverted life plan, emotional impacts, and creating a path forward. The findings from this study will help inform current physical and social distancing guidelines during the ongoing COVID-19 pandemic. Moreover, findings indicate that social and emotional challenges with ongoing physical and social isolation must be taken into consideration for future pandemics.