Microdissection testicular sperm extraction (mTESE) is the first-line treatment plan for nonobstructive azoospermia (NOA). However, studies reported that the overall sperm retrieval rate (SRR) was 43% to 63% among men with NOA, implying that nearly half of the patients fail sperm retrieval. This study aimed to evaluate the diagnostic performance of parameters derived from diffusion tensor imaging (DTI) in predicting SRR in patients with NOA. Seventy patients diagnosed with NOA were enrolled and classified into two groups based on the outcome of sperm retrieval during mTESE: success (29 patients) and failure (41 patients). Scrotal magnetic resonance imaging was performed, and the DTI parameters, including mean diffusivity and fractional anisotropy, were analyzed between groups. The results showed that there was a significant difference in mean diffusivity values between the two groups, and the area under the curve for mean diffusivity was calculated as 0.865, with a sensitivity of 72.2% and a specificity of 97.5%. No statistically significant difference was observed in fractional anisotropy values and sex hormone levels between the two groups. This study demonstrated that the mean diffusivity value might serve as a useful noninvasive imaging marker for predicting the SRR of NOA patients undergoing mTESE.