CD8⁺ T cell responses are necessary for immune control of simian immunodeficiency virus (SIV). However, the key parameters that dictate antiviral potency remain elusive, conceivably because most studies to date have been restricted to analyses of circulating CD8⁺ T cells. We conducted a detailed clonotypic, functional, and phenotypic survey of SIV-specific CD8⁺ T cells across multiple anatomical sites in chronically infected rhesus macaques with high (>10,000 copies/mL plasma) or low burdens of viral RNA (<10,000 copies/mL plasma). No significant differences in response magnitude were identified across anatomical compartments. Rhesus macaques with low viral loads (VLs) harbored higher frequencies of polyfunctional CXCR5⁺ SIV-specific CD8⁺ T cells in various lymphoid tissues and higher proportions of unique Gag-specific CD8⁺ T cell clonotypes in the mesenteric lymph nodes relative to rhesus macaques with high VLs. In addition, public Gag-specific CD8⁺ T cell clonotypes were more commonly shared across distinct anatomical sites than the corresponding private clonotypes, which tended to form tissue-specific repertoires, especially in the peripheral blood and the gastrointestinal tract. Collectively, these data suggest that functionality and tissue localization are important determinants of CD8⁺ T cell–mediated efficacy against SIV.