Collagens, or more precisely collagen-based extracellular matrices, are often considered as a metazoan hallmark. Among the collagens, fibrillar collagens are present from sponges to humans, and are involved in the formation of the well-known striated fibrils. In this review we discuss the different steps in the evolution of this protein family, from the formation of an ancestral fibrillar collagen gene to the formation of different clades. Genomic data from the choanoflagellate (sister group of Metazoa) Monosiga brevicollis, and from diploblast animals, have suggested that the formation of an ancestral α chain occurred before the metazoan radiation. Phylogenetic studies have suggested an early emergence of the three clades that were first described in mammals. Hence the duplication events leading to the formation of the A, B and C clades occurred before the eumetazoan radiation. Another important event has been the two rounds of “whole genome duplication” leading to the amplification of fibrillar collagen gene numbers, and the importance of this diversification in developmental processes. We will also discuss some other aspects of fibrillar collagen evolution such as the development of the molecular mechanisms involved in the formation of procollagen molecules and of striated fibrils.