The purpose of this study was to examine post-diagnosis BMI, very low physical activity, and comorbidities, as predictors of breast cancer-specific and all-cause mortality. Data from three female US breast cancer survivor cohorts were harmonized in the After Breast Cancer Pooling Project (n = 9513). Delayed entry Cox proportional hazards models were used to examine the impact of three post-diagnosis lifestyle factors: body mass index (BMI), select comorbidities (diabetes only, hypertension only, or both), and very low physical activity (defined as physical activity <1.5 MET h/week) in individual models and together in multivariate models for breast cancer and all-cause mortality. For breast cancer mortality, the individual lifestyle models demonstrated a significant association with very low physical activity but not with the selected comorbidities or BMI. In the model that included all three lifestyle variables, very low physical activity was associated with a 22 % increased risk of breast cancer mortality (HR 1.22, 95 % CI 1.05, 1.42). For all-cause mortality, the three individual models demonstrated significant associations for all three lifestyle predictors. In the combined model, the strength and significance of the association of comorbidities (both hypertension and diabetes versus neither: HR 2.16, 95 % CI 1.79, 2.60) and very low physical activity (HR 1.35, 95 % CI 1.22, 1.51) remained unchanged, but the association with obesity was completely attenuated. These data indicate that after active treatment, very low physical activity, consistent with a sedentary lifestyle (and comorbidities for all-cause mortality), may account for the increased risk of mortality, with higher BMI, that is seen in other studies.