The negative effects of incarceration on child well-being are often linked to the economic insecurity of formerly incarcerated parents. Researchers caution, however, that the effects of parental incarceration may be small in the presence of multiple-partner fertility and other family complexity. Despite these claims, few studies have directly observed either economic insecurity or the full extent of family complexity. We study parent-child relationships with a unique data set that includes detailed information about economic insecurity and family complexity among parents just released from prison. We find that stable private housing, more than income, is associated with close and regular contact between parents and children. Formerly incarcerated parents see their children less regularly in contexts of multiple-partner fertility and in the absence of supportive family relationships. Significant housing and family effects are estimated even after we control for drug use and crime, which are themselves negatively related to parental contact. The findings point to the constraints of material insecurity and the complexity of family relationships on the contact between formerly incarcerated parents and their children.