Repeat-rich sequences play a role in 3D genome architecture in higher eukaryotes; however, this remains unexplored in brain cells. Here, the authors show that upregulation of endogenous retroviral (ERV) sequences is linked to changes in the 3D structure in the brain, which is also observed by comparison of mouse strains with recent retrotransposon expansion.