Age has been found to be one of the main risk factors for the severity and outcome of COVID-19. However, differences in SARS-CoV-2 specific antibody responses among COVID-19 patients of different age groups remain largely unknown. In this study, we analyzed the IgG/IgM responses to 21 SARS-CoV-2 proteins and 197 peptides that fully cover the spike protein against 731 sera collected from 731 COVID-19 patients aged from 1 to 92 years. We show that there is no overall difference in SARS-CoV-2 antibody responses in COVID-19 patients in the 4 age groups. By antibody response landscape maps, we find that the IgG response profiles of SARS-CoV-2 proteins are positively correlated with age. The S protein linear epitope map shows that the immunogenicity of the S-protein peptides is related to peptide sequence, disease severity and age of the COVID-19 patients. Furthermore, the enrichment analysis indicates that low S1 IgG responses are enriched in patients aged <50 and high S1 IgG responses are enriched in mild COVID-19 patients aged >60. In addition, high responses of non-structural/accessory proteins are enriched in severe COVID-19 patients aged >70. These results suggest the distinct immune response of IgG/IgM to each SARS-CoV-2 protein in patients of different age, which may facilitate a deeper understanding of the immune responses in COVID-19 patients.