Metabolic reprogramming of cancer cells and the tumor microenvironment are emerging as key factors governing tumor growth, metastasis, and response to therapies including immune checkpoint inhibitors. It has been recognized that rapidly proliferating cancer cells, tumor-infiltrating lymphocytes, and vascular endothelial cells compete for oxygen and nutrients. Tumor cells and other cell types in the microenvironment not only compete for nutrients, but they also simultaneously produce immunosuppressive metabolites, leading to immune escape. In addition, commensal microbial metabolites can influence regulatory T cells and inflammation in the intestine, thus playing an essential role in cancer prevention or cancer promotion. In this review, we summarize recent advances on metabolic interactions among various cell types in the tumor microenvironment, with a focus on how these interactions affect tumor immunity. We also discuss the potential role of blood vessel metabolism in regulating immune cell trafficking and activation.