Sexual dimorphism greatly influences adipose tissue remodeling, which is characterized by changes in the activity, number, and/or size of adipocytes in response to distinct stimuli, including lifestyle and anti-obesity drugs. This sex dependence seems to be due to the anatomical and endocrine disparities between men and women. At the molecular level, sex hormones are believed to mediate such differences and involve estrogen and androgen receptor-induced gene expression. The signaling pathways that regulate adipose tissue metabolism and function include peroxisome proliferator-activated receptor gamma, uncoupling protein 1 (UCP1), 5’ adenosine monophosphate-activated protein kinase (AMPK), and mitochondrial oxidative phosphorylation (OXPHOS), among other molecular players. Sex hormone-related pathways also interplay with adrenergic signaling, probably the most well-characterized molecular mechanism implicated in the remodeling of white adipose tissue. This review overviews and integrates the signaling pathways behind sexual dimorphism in adipose tissue remodeling, hoping to increase the knowledge on the pathogenesis of diseases, such as obesity and related comorbidities, and consequently, to drive future studies to investigate the regulation of this tissue homeostasis, either in men or women.