Effects of disadvantaged neighborhoods on child educational outcomes likely depend on a family’s economic resources and the timing of neighborhood exposures during the course of child development. This study investigates how timing of exposure to disadvantaged neighborhoods during childhood versus adolescence affects high school graduation and whether these effects vary across families with different income levels. It follows 6,137 children in the PSID from childhood through adolescence and overcomes methodological problems associated with the joint endogeneity of neighborhood context and family income by adapting novel counterfactual methods—a structural nested mean model estimated via two-stage regression with residuals—for time-varying treatments and time-varying effect moderators. Results indicate that exposure to disadvantaged neighborhoods, particularly during adolescence, has a strong negative effect on high school graduation and that this negative effect is more severe for children from poor families.