To investigate whether sperm with low concentration and motility can impact preimplantation embryos and to analyze how the effects present under a time-lapse incubation system, 2905 oocytes were collected from 219 couples between January 2014 and December 2015. Patients were divided into three groups according to sperm quality. Morphokinetic parameters and six cleavage patterns in the initial three cleavages were evaluated using the Primo Vision system. Embryo quality and clinic outcomes such as implantation rate, pregnancy rate and live birth rate were measured. The results showed that the concentration and motility of sperm correlated strongly with the rate of 2PN embryos, good-quality embryos on D3, blastocysts on D5/6 and good-quality embryos on D5/6. The time-lapse system recordings showed that compromised sperm quality could result in a significant delay in cc1 and a decrease in cc2, and impact embryo developmental potential mainly through large fragments or/and blastomere fragmentation in the initial three cleavages. In conclusion, sperm with low concentration and motility can have paternal effects on preimplantation embryos. These paternal effects present both as changes in morphokinetic parameters and cleavage patterns, which occur as early as fertilization and may cause severe damage to the preimplantation embryos.