Breast cancers can recur after removal of the primary tumor and treatment to eliminate remaining tumor cells. Recurrence may occur after long periods of time during which there are no clinical symptoms. Tumor cell dormancy may explain these prolonged periods of asymptomatic residual disease and treatment resistance. We generated a dormancy gene signature from published experimental models and applied it to both breast cancer cell line expression data as well as four published clinical studies of primary breast cancers. We found that estrogen receptor (ER) positive breast cell lines and primary tumors have significantly higher dormancy signature scores (P<0.0000001) than ER- cell lines and tumors. In addition, a stratified analysis combining all ER+ tumors in four studies indicated 2.1 times higher hazard of recurrence among patients whose tumors had low dormancy scores (LDS) compared to those whose tumors had high dormancy scores (HDS) (p<0.000005). The trend was shown in all four individual studies. Suppression of two dormancy genes, BHLHE41 and NR2F1, resulted in increased in vivo growth of ER positive MCF7 cells. The patient data analysis suggests that disseminated ER positive tumor cells carrying a dormancy signature are more likely to undergo prolonged dormancy before resuming metastatic growth. Furthermore, genes identified with this approach might provide insight into the mechanisms of dormancy onset and maintenance as well as dormancy models using human breast cancer cell lines.