Both cadmium (Cd) and polycyclic aromatic hydrocarbons (PAHs) are known reproductive toxicants, but their co-exposure and interaction effect on semen quality particularly in nonsmokers remain unknown. We included 333 nonsmoking men and analyzed their urine and semen samples for heavy metals and PAH metabolites. Restricted cubic spline models were used to explore the dose-response relationship between each OH-PAHs, Cd, and semen quality parameters; the generalized linear model was performed to examine the interaction of each urinary OH-PAH metabolite and Cd concentration on semen quality. Also, stratified analysis was applied to further illustrate the independent effect of PAHs on semen quality parameters in low and high concentration Cd subgroups. The dose-response and interaction effect of PAHs and Cd on male semen quality was observed. Stratified analysis in the high concentration Cd subgroup showed a negative association of 1-OHPyr concentration with semen motility. Our findings indicate that Cd not only modifies the association between PAHs and semen quality but can also exacerbate the toxic effect of pyrene on semen quality parameters. However, further studies with larger samples are needed to confirm the findings.