It has recently been proposed that combining chirality with topological band theory results in a totally new class of fermions. Understanding how these unconventional quasiparticles propagate and interact remains largely unexplored so far. Here, we use scanning tunneling microscopy to visualize the electronic properties of the prototypical chiral topological semimetal PdGa. We reveal chiral quantum interference patterns of opposite spiraling directions for the two PdGa enantiomers, a direct manifestation of the change of sign of their Chern number. Additionally, we demonstrate that PdGa remains topologically non-trivial over a large energy range, experimentally detecting Fermi arcs in an energy window of more than 1.6eV that is symmetrically centered around the Fermi level. These results are a consequence of the deep connection between chirality in real and reciprocal space in this class of materials, and, thereby, establish PdGa as an ideal topological chiral semimetal. Direct visualization of chiral effects in topological chiral semimetals remains elusive. Here, Sessi et al. demonstrate that quasiparticle scattering at impurities in the two enantiomers of PdGa gives rise to handedness dependent quantum interference patterns.