In addition to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), humans are also susceptible to six other coronaviruses, for which consecutive exposures to antigenically related and divergent seasonal coronaviruses are frequent. Despite the prevalence of COVID-19 pandemic and ongoing research, the nature of the antibody response against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is unclear. Here we longitudinally profile the early humoral immune response against SARS-CoV-2 in hospitalized coronavirus disease 2019 (COVID-19) patients and quantify levels of pre-existing immunity to OC43, HKU1 and 229E seasonal coronaviruses, and find a strong back-boosting effect to conserved but not variable regions of OC43 and HKU1 betacoronaviruses spike protein. However, such antibody memory boost to human coronaviruses negatively correlates with the induction of IgG and IgM against SARS-CoV-2 spike and nucleocapsid protein. Our findings thus provide evidence of immunological imprinting by previous seasonal coronavirus infections that can potentially modulate the antibody profile to SARS-CoV-2 infection.