The magnetic quantum states of holmium single atom magnets on MgO(100) have proven extremely robust when exposed to high magnetic fields and temperatures up to 35 K. Here we address the stability of Ho at small magnetic fields, where the hyperfine interaction creates several avoided level crossings. Using spin-polarized scanning tunneling microscopy, we demonstrate quantum state control via Landau-Zener tunneling and stable magnetization at zero field. Our observations indicate a total spin ground state of J(z) = +/- 8. Combined quantum and classical control render Ho a promising qubit candidate.