Neurocognitive impairment is one of the factors that put heroin abusers at greater risk for relapse, and deficits in related functional brain connections have been found. However, the alterations in structural brain connections that may underlie these functional and neurocognitive impairments remain largely unknown. In the present study, we investigated topological organization alterations in the structural network of white matter in heroin abusers and examined the relationships between the network changes and clinical measures. We acquired diffusion tensor imaging datasets from 76 heroin abusers and 78 healthy controls. Network‐based statistic was applied to identify alterations in interregional white matter connectivity, and graph theory methods were used to analyze the properties of global networks. The participants also completed a battery of neurocognitive measures. One increased subnetwork characterizing widespread abnormalities in structural connectivity was present in heroin users, which mainly composed of default‐mode, attentional and visual systems. The connection strength was positively correlated with increases in fractional anisotropy in heroin abusers. Intriguingly, the changes in within‐frontal and within‐temporal connections in heroin abusers were significantly correlated with daily heroin dosage and impulsivity scores, respectively. These findings suggest that heroin abusers have extensive abnormal white matter connectivity, which may mediate the relationship between heroin dependence and clinical measures. The increase in white matter connectivity may be attributable to the inefficient microstructure integrity of white matter. The present findings extend our understanding of cerebral structural disruptions that underlie neurocognitive and functional deficits in heroin addiction and provide circuit‐level markers for this chronic disorder.