Cross-reactive antibodies elicited by dengue virus (DENV) infection might affect Zika virus infection and confound serologic tests. Recent data demonstrate neutralization of Zika virus by monoclonal antibodies or human serum collected early after DENV infection. Whether this finding is true in late DENV convalescence (> 6 months after infection) is unknown. We studied late convalescent serum samples from persons with prior DENV or Zika virus exposure. Despite extensive cross-reactivity in IgG binding, Zika virus neutralization was not observed among primary DENV infections. We observed low-frequency (23%) Zika virus cross-neutralization in repeat DENV infections. DENV-immune persons who had Zika virus as a secondary infection had distinct populations of antibodies that neutralized DENVs and Zika virus, as shown by DENV-reactive antibody depletion experiments. These data suggest that most DENV infections do not induce durable, high-level Zika virus cross-neutralizing antibodies. Zika virus–specific antibody populations develop after Zika virus infection irrespective of prior DENV immunity.