The most classic approach to the dynamics of an n-dimensional mechanical system constrained by d independent holonomic constraints is to pick explicitly a new set of (n - d) curvilinear coordinatesparametrizingthe manifold of configurations satisfying the constraints, and to compute the Lagrangian generating the unconstrained dynamics in these (n - d) configuration coordinates. Starting from this Lagrangian an unconstrained Hamiltonian H(q,p) on 2(n-d) dimensional phase space can then typically be defined in the standard way via a Legendre transform. Furthermore, if the system is in contact with a heat bath, the associated Langevin and Fokker-Planck equations can be introduced. Provided that an appropriate fluctuation-dissipation condition is satisfied, there will be a canonical equilibrium distribution of the Gibbs form exp(-beta H) with respect to the flat measure dqdp in these 2(n - d) dimensional curvilinear phase space coordinates. The existence of (n - d) coordinates satisfying the constraints is often guaranteed locally by an implicit function theorem. Nevertheless in many examples these coordinates cannot be constructed in any tractable form, even locally, so that other approaches are of interest. In ambient space formulations the dynamics are defined in the full original n-dimensional configuration space, and associated 2n-dimensional phase space, with some version of Lagrange multipliers introduced so that the 2(n - d) dimensional sub-manifold of phase space implied by the holonomic constraints and their time derivative, is invariant under the dynamics. In this article we review ambient space formulations, and explain that for constrained dynamics there is in fact considerable freedom in how a Hamiltonian form of the dynamics can be constructed. We then discuss and contrast the Langevin and Fokker-Planck equations and their equilibrium distributions for the different forms of ambient space dynamics.