While obesity is defined as an excessive fat accumulation conferring a risk to metabolic health, increased adipose mass by itself does not fully explain obesity’s propensity to promote metabolic alterations. Adipose tissue regulates multiple processes critical for energy homeostasis and its dysfunction favors the development and perpetuation of metabolic diseases. Obesity drives inflammatory leucocyte infiltration in adipose tissue and fibrotic transformation of the fat depots. Both features associate with metabolic alterations such as impaired glucose control and resistance to fat mass loss. In this context, adipose progenitors, an heterogenous resident population of mesenchymal stromal cells, display functions important to shape healthy or unhealthy adipose tissue expansion. We, here, outline the current understanding of adipose progenitor biology in the context of obesity-induced adipose tissue remodeling.