Understanding the dynamics of atomic vibrations confined in quasi-zero dimen- sional systems is crucial from both a fundamental point-of-view and a technologi- cal perspective. Using ultrafast electron diffraction, we monitored the lattice dynamics of GaAs quantum dots—grown by Droplet Epitaxy on AlGaAs—with sub-picosecond and sub-picometer resolutions. An ultrafast laser pulse nearly reso- nantly excites a confined exciton, which efficiently couples to high-energy acoustic phonons through the deformation potential mechanism. The transient behavior of the measured diffraction pattern reveals the nonequilibrium phonon dynamics both within the dots and in the region surrounding them. The experimental results are interpreted within the theoretical framework of a non-Markovian decoherence, according to which the optical excitation creates a localized polaron within the dot and a travelling phonon wavepacket that leaves the dot at the speed of sound. These findings indicate that integration of a phononic emitter in opto-electronic devices based on quantum dots for controlled communication processes can be fun- damentally feasible.