Duplication and segregation of chromosomes involves dynamic reorganization of their internal structure by conserved architectural proteins, including the structural maintenance of chromosomes (SMC) complexes cohesin and condensin. Despite active investigation of the roles of these factors, a genome-wide view of dynamic chromosome architecture at both small and large scale during cell division is still missing. Here, we report the first comprehensive 4D analysis of the higher-order organization of the Saccharomyces cerevisiae genome throughout the cell cycle and investigate the roles of SMC complexes in controlling structural transitions. During replication, cohesion establishment promotes numerous long-range intra-chromosomal contacts and correlates with the individualization of chromosomes, which culminates at metaphase. In anaphase, mitotic chromosomes are abruptly reorganized depending on mechanical forces exerted by the mitotic spindle. Formation of a condensin-dependent loop bridging the centromere cluster with the rDNA loci suggests that condensin-mediated forces may also directly facilitate segregation. This work therefore comprehensively recapitulates cell cycle-dependent chromosome dynamics in a unicellular eukaryote, but also unveils new features of chromosome structural reorganization during highly conserved stages of cell division.