White adipose tissue (WAT) morphology characterized by hypertrophy (i.e., fewer but larger adipocytes) associates with increased adipose inflammation, lipolysis, insulin resistance, and risk of diabetes. However, the causal relationships and the mechanisms controlling WAT morphology are unclear. Herein, we identified EBF1 as an adipocyte-expressed transcription factor with decreased expression/activity in WAT hypertrophy. In human adipocytes, the regulatory targets of EBF1 were enriched for genes controlling lipolysis and adipocyte morphology/differentiation, and in both humans and murine models, reduced EBF1 levels associated with increased lipolysis and adipose hypertrophy. Although EBF1 did not affect adipose inflammation, TNFα reduced EBF1 gene expression. High-fat diet intervention in Ebf1^+/− mice resulted in more pronounced WAT hypertrophy and attenuated insulin sensitivity compared with wild-type littermate controls. We conclude that EBF1 is an important regulator of adipose morphology and fat cell lipolysis and may constitute a link between WAT inflammation, altered lipid metabolism, adipose hypertrophy, and insulin resistance.