The relative abundance of thermogenic beige adipocytes and lipid-storing white adipocytes in adipose tissue underlie its metabolic activity. The roles of adipocyte progenitor cells, which express PDGFRα or PDGFRβ, in adipose tissue function have remained unclear. Here, by defining the developmental timing of PDGFRα and PDGFRβ expression in mouse subcutaneous and visceral adipose depots, we uncover depot specificity of pre-adipocyte delineation. We demonstrate that PDGFRα expression precedes PDGFRβ expression in all subcutaneous but in only a fraction of visceral adipose stromal cells. We show that high-fat diet feeding or thermoneutrality in early postnatal development can induce PDGFRβ⁺ lineage recruitment to generate white adipocytes. In contrast, the contribution of PDGFRβ⁺ lineage to beige adipocytes is minimal. We provide evidence that human adipose tissue also contains distinct progenitor populations differentiating into beige or white adipocytes, depending on PDGFRβ expression. Based on PDGFRα or PDGFRβ deletion and ectopic expression experiments, we conclude that the PDGFRα/PDGFRβ signaling balance determines progenitor commitment to beige (PDGFRα) or white (PDGFRβ) adipogenesis. Our study suggests that adipocyte lineage specification and metabolism can be modulated through PDGFR signaling.