The centromere is an essential chromatin domain required for kinetochore recruitment and chromosome segregation in eukaryotes. To perform this role, centro-chromatin adopts a unique structure that provides access to kinetochore proteins and maintains stability under tension during mitosis. This is achieved by the presence of nucleosomes containing the H3 variant CENP-A, which also acts as the epigenetic mark defining the centromere. In this review, we discuss the role of CENP-A on the structure and dynamics of centromeric chromatin. We further discuss the impact of the CENP-A binding proteins CENP-C, CENP-N, and CENP-B on modulating centro-chromatin structure. Based on these findings we provide an overview of the higher order structure of the centromere.