We prove that under certain mild moment and continuity assumptions, the d-dimensional continuum Gaussian free field is the only stochastic process satisfying the usual domain Markov property and a scaling assumption. Our proof is based on a decomposition of the underlying functional space in terms of radial processes and spherical harmonics.