We develop a generalisation of the original theory of regularity structures, [Hai14], which is able to treat SPDEs on manifolds with values in vector bundles. Assume M is a Riemannian manifold and E→M and Fi→M are vector bundles (with a metric and connection), this theory allows to solve subcritical equations of the form ∂tu+u=∑i=0mGi(u,∇u,…,∇nu)ξi , where u is a (generalised) section of E,  is a uniformly elliptic operator on E of order strictly greater than n, the ξi are Fi-valued random distributions (e.g. Fi-valued white noises), and the Gi:E×TM∗⊗E×…×(TM∗)⊗n⊗E→L(Fi,E) are local functions. We apply our framework to three example equations which illustrate that when  is a Laplacian it is possible in most cases to renormalise such equations by adding spatially homogeneous counterterms and we discuss in which cases more sophisticated renormalisation procedures (involving the curvature of the underlying manifold) are required.