To investigate roles for bone marrow adipocyte (BMAd) lipolysis in bone homeostasis, we created a BMAd-specific Cre mouse model in which we knocked out adipose triglyceride lipase (ATGL, Pnpla2 gene). BMAd-Pnpla2-/-mice have impaired BMAd lipolysis, and increased size and number of BMAds at baseline. Although energy from BMAd lipid stores is largely dispensable when mice are fed ad libitum, BMAd lipolysis is necessary to maintain myelopoiesis and bone mass under caloric restriction. BMAd-specific Pnpla2 deficiency compounds the effects of caloric restriction on loss of trabecular bone in male mice, likely due to impaired osteoblast expression of collagen genes and reduced osteoid synthesis. RNA sequencing analysis of bone marrow adipose tissue reveals that caloric restriction induces dramatic elevations in extracellular matrix organization and skeletal development genes, and energy from BMAd is required for these adaptations. BMAd-derived energy supply is also required for bone regeneration upon injury, and maintenance of bone mass with cold exposure.