An attractive formulation of the sampling problem is based on the principle of a consistent signal reconstruction. The requirement is that the reconstructed signal is indistinguishable from the input in the sense that it yields the exact same measurements. Such a system can be interpreted as an oblique projection onto a given reconstruction space. The standard formulation requires a one-to-one relationship between the input measurements and the reconstructed model. Unfortunately, this condition fails when the cross-correlation matrix between the analysis and reconstruction basis functions is not invertible; in particular, when there are less measurements than the number of reconstruction functions. In this paper, we propose an extension of consistent sampling that is applicable to those singular cases as well, and that yields a unique and well-defined solution. This solution also makes use of projection operators and has a geometric interpretation. The key idea is to exclude the null space of the sampling operator from the reconstruction space and to enforce consistency on its complement. We specify a class of consistent reconstruction algorithms corresponding to different choices of complementary reconstruction spaces. The formulation includes the Moore-Penrose generalized inverse, as well as other potentially more interesting reconstructions that preserve certain preferential signals. In particular, we display solutions that preserve polynomials or sinusoids, and therefore perform well in practical applications.