A robust association has been reported between childhood adverse life events (ALEs) and risky substance use in adolescence. It remains unclear, however, what the impact of type and timing of these ALEs is. We investigated the association between ALEs and substance use in adolescents. ALEs were operationalized as broad (e.g., moving, parental divorce, family sickness) or physically threatening (physical and/or sexual abuse). First, we examined lifetime ALEs, followed by an investigation into their timing. The sample consisted of 909 adolescents (aged 12–18 years) from a cohort oversampled on high levels of emotional and behavioral problems. The primary caregiver indicated which ALEs each adolescent experienced across their lifetime. Adolescents self-reported on number and frequency of substances used. Poisson and ordinal regression models were used to model the associations. The associations between lifetime ALEs and a substance used were observed only for physical ALEs (incidence rate ratio 1.18 [1.03, 1.35], p = 0.02). When investigating timing, physical ALEs after the age of 12 predicted number of substances used (IRR 1.36 [1.13, 1.63], p < .001). Recent ALEs (occurring after age 12) seem to have considerable impact on substance use. Alcohol and drugs as a coping mechanism were considered a plausible explanation for the results.