The temperature dependence of the femtosecond elastic second harmonic scattering (fs-ESHS) response of bulk light and heavy water and their electrolyte solutions is presented. We observe clear temperature dependent changes in the hydrogen (H)-bond network of water that show a decrease in the orientational order of water with increasing temperature. Although D2O has a more structured H-bond network (giving rise to more fs-ESHS intensity), the relative temperature dependence is larger in H2O. The changes are interpreted in terms of the symmetry of H-bonds and are indicators of nuclear quantum effects. Increasing the temperature in electrolyte solutions decreases the influence of the total electrostatic field from ions on the water-water correlations, as expected from Debye-Hückel theory, since the Debye length becomes longer. The effects are, however, 1.9 times (6.3 times) larger than those predicted for H2O (D2O). Since fs-ESHS responses can be computed from known molecular coordinates, our observations provide a unique opportunity to refine quantum mechanical models of water.