Activation of the inflammasome is accompanied by rapid formation of a micrometer-sized perinuclear structure called the ASC speck, a platform for caspase-1 activity. The ASC speck is often referred to as an aggregate and shares certain features with aggresomes. It is thus an open question whether the ASC speck formation takes place via nonspecific aggregation of hydrophobic patches or specific interactions of its domains; PYD and CARD, which belong to the death fold superfamily. Bringing together structure and dynamics studies using the Gaussian network model of PYD and CARD, and molecular dynamics simulations of the wild-type and in silico mutated PYD, with the mutational analysis on the ASC structure and its separate domains in human cells, we show that the ASC speck is an organized structure with at least two levels of distinct compaction mechanisms based on the specific interactions of PYD and CARD.