The understanding of the photoluminescence mechanism of ultra-small gold clusters has seriously lagged behind a wealth of experimental syntheses and optical characterization. Multi-configurational quantum chemical calculations disclose that the optical properties of these clusters are predominantly regulated by the number of diamagnetic electrons and the topological features formed by aurophilic interactions.