We study the solution of the two-temperature Fokker-Planck equation and rigorously analyse its convergence towards an explicit non-equilibrium stationary measure for long time and two widely separated time scales. The exponential rates of convergence are estimated assuming the validity of logarithmic Sobolev inequalities for the conditional and marginal distributions of the limit measure. We show that these estimates are sharp in the exactly solvable case of a quadratic potential. We discuss a few examples where the logarithmic Sobolev inequalities are satisfied through simple, though not optimal, criteria. In particular, we consider a spin glass model with slowly varying external magnetic fields whose non-equilibrium measure corresponds to Guerra's hierarchical construction appearing in Talagrand's proof of the Parisi formula.