Background Sex and gender are crucial variables in coronavirus disease 2019 (COVID-19). We sought to provide information on differences in clinical characteristics and outcomes between male and female patients and to explore the effect of estrogen in disease outcomes in patients with COVID-19. Method In this retrospective, multi-center study, we included all confirmed cases of COVID-19 admitted to four hospitals in Hubei province, China from Dec 31, 2019 to Mar 31, 2020. Cases were confirmed by real-time RT-PCR and were analyzed for demographic, clinical, laboratory and radiographic parameters. Random-effect logistic regression analysis was used to assess the association between sex and disease outcomes. Results A total of 2501 hospitalized patients with COVID-19 were included in the present study. The clinical manifestations of male and female patients with COVID-19 were similar, while male patients have more comorbidities than female patients. In terms of laboratory findings, compared with female patients, male patients were more likely to have lymphopenia, thrombocytopenia, inflammatory response, hypoproteinemia, and extrapulmonary organ damage. Random-effect logistic regression analysis indicated that male patients were more likely to progress into severe type, and prone to ARDS, secondary bacterial infection, and death than females. However, there was no significant difference in disease outcomes between postmenopausal and premenopausal females after propensity score matching (PSM) by age. Conclusions Male patients, especially those age-matched with postmenopausal females, are more likely to have poor outcomes. Sex-specific differences in clinical characteristics and outcomes do exist in patients with COVID-19, but estrogen may not be the primary cause. Further studies are needed to explore the causes of the differences in disease outcomes between the sexes.