Stroke causes a significant reduction in health-related quality of life (HRQoL), and studies addressing its predictors often rely on models with few variables. This study aimed to assess the degree to which health status, health habits, and features of the environment predict HRQoL in stroke survivors with stable clinical condition. WHO Quality of Life questionnaire for old-Age subjects (WHOQOL-AGE) was used to assess HRQoL. We ran a multivariable linear regression to predict WHOQOL-AGE variation, entering measures of health state, bad habits, healthy behaviors, physical environment features, and social support. Patients were stroke survivors with a stable clinical condition, distance from acute event of more than 6 months, and National Institutes of Health Stroke Scale (NIHSS) of 10 or less. A total of 122 participants (47 females, 97 with ischemic stroke) were enrolled, the mean age was 64.1, mean NIHSS 2.9, and mean distance from the acute event was 5.1 years. State anxiety (β = −0.202), trait anxiety (β = −0.232), depression (β = −0.255), social support (β = 0.247), and functional independence (β = −0.210) predicted WHOQOL-AGE variation (Adj. R2 = 0.549). Our results show that psychological symptoms, reduced social network, and functional dependence together have a negative impact on HRQoL. These elements, which are partly stroke-specific, should be taken into account in the recovery process to enhance patients’ health outcomes.