We prove small data modified scattering for the Vlasov-Poisson system in dimension $d=3$ using a method inspired from dispersive analysis. In particular, we identify a simple asymptotic dynamic related to the scattering mass.