Despite improved methods for MHC affinity prediction, the vast majority of computationally predicted tumor neoantigens are not immunogenic experimentally, indicating that high-quality neoantigens are beyond current algorithms to discern. To enrich for neoantigens with the greatest likelihood of immunogenicity, we developed an analytic method to parse neoantigen quality through rational biological criteria across five clinical datasets for 318 cancer patients. We explored four quality metrics, including analysis of dissimilarity to the non-mutated proteome that was predictive of peptide immunogenicity. In patient tumors, neoantigens with high dissimilarity were unique, enriched for hydrophobic sequences, and correlated with survival after PD-1 checkpoint therapy in patients with non-small cell lung cancer independent of predicted MHC affinity. We incorporated our neoantigen quality analysis methodology into an open-source tool, antigen.garnish, to predict immunogenic peptides from bulk computationally predicted neoantigens for which the immunogenic "hit rate" is currently low.