White matter (WM) abnormalities in patients with cocaine use disorder (CUD) have been studied; however, the reported effects on the human brain are heterogenous and most results have been obtained from male participants. In addition, biological data supporting the imaging findings and revealing possible mechanisms underlying the neurotoxic effects of chronic cocaine use (CU) on WM are largely restricted to animal studies. To evaluate the neurotoxic effects of CU in the WM, we performed an in vivo diffusion tensor imaging assessment of male and female cocaine users (n = 75) and healthy controls (HC) (n = 58). Moreover, we performed an ex vivo large-scale proteomic analysis using liquid chromatography-tandem mass spectrometry in postmortem brains of patients with CUD (n = 8) and HC (n = 12). Compared with the HC, the CUD group showed significant reductions in global fractional anisotropy (FA) (p < 0.001), and an increase in global mean (MD) and radial diffusion (RD) (both p < 0.001). The results revealed that FA, RD, and MD alterations in the CUD group were widespread along the major WM tracts, after analysis using the tract-based special statistics approach. Global FA was negatively associated with years of CU (p = 0.0421) and female sex (p < 0.001), but not with years of alcohol or nicotine use. Concerning the fibers connecting the left to the right prefrontal cortex, Brodmann area 9 (BA9), the CUD group presented lower FA (p = 0.006) and higher RD (p < 0.001) values compared with the HC group. A negative association between the duration of CU in life and FA values in this tract was also observed (p = 0.019). Proteomics analyses in BA9 found 11 proteins differentially expressed between cocaine users and controls. Among these, were proteins related to myelination and neuroinflammation. In summary, we demonstrate convergent evidence from in vivo diffusion tensor imaging and ex vivo proteomics analysis of WM disruption in CUD.