Pre-existing immunity to seasonal endemic coronaviruses could have profound consequences for antibody responses to SARS-CoV-2, induced from natural infection or vaccination. A first step to establish whether pre-existing responses can impact SARS-CoV-2 infection is to understand the nature and extent of cross-reactivity in humans to coronaviruses. Here we compare serum antibody and memory B cell responses to coronavirus spike proteins from pre-pandemic and SARS-CoV-2 convalescent donors using binding and functional assays. We show weak evidence of pre-existing SARS-CoV-2 cross-reactive serum antibodies in pre-pandemic donors. However, we find evidence of pre-existing cross-reactive memory B cells that are activated during SARS-CoV-2 infection. Monoclonal antibodies show varying degrees of cross-reactivity with betacoronaviruses, including SARS-CoV-1 and endemic coronaviruses. We identify one cross-reactive neutralizing antibody specific to the S2 subunit of the S protein. Our results suggest that pre-existing immunity to endemic coronaviruses should be considered in evaluating antibody responses to SARS-CoV-2.