Smooth muscle cells and endothelial cells have a remarkable level of plasticity in vascular pathologies. In thoracic and abdominal aortic aneurysms, smooth muscle cells have been suggested to undergo phenotypic switching and to contribute to degradation of the aortic wall structure in response to, for example, inflammatory mediators, dysregulation of growth factor signaling or oxidative stress. Recently, endothelial-to-mesenchymal transition, and a clonal expansion of degradative smooth muscle cells and immune cells, as well as mesenchymal stem–like cells have been suggested to contribute to the progression of aortic aneurysms. What are the factors driving the aortic cell phenotype changes and how vascular flow, known to affect aortic wall structure and to be altered in aortic aneurysms, could affect aortic cell remodeling? In this review, we summarize the current literature on aortic cell heterogeneity and phenotypic switching in relation to changes in vascular flow and aortic wall structure in aortic aneurysms in clinical samples with special focus on smooth muscle and endothelial cells. The differences between thoracic and abdominal aortic aneurysms are discussed.