The sliding window approach is the most widely used technique to detect an object from an image. In the past few years, classifiers have been improved in many ways to increase the scanning speed. Apart from the classifier design (such as the cascade), the scanning speed also depends on a number of different factors (such as the grid spacing, and the scale at which the image is searched). When the scanning grid spacing is larger than the tolerance of the trained classifier it suffers from low detections. In this paper, we present a technique to reduce the number of missed detections when fewer subwindows are processed in the sliding window approach for face detection. This is achieved by using a small patch to predict the location of the face within a local search area. We use simple binary features and a decision tree for location estimation as it proved to be efficient for our application. We also show that by using a simple interest point detector based on quantized gradient orientation, as the front-end to the proposed location estimation technique, we can further improve the performance. Experimental evaluation on several face databases show better detection rate and speed with our proposed approach when fewer number of subwindows are processed compared to the standard scanning technique. (C) 2013 Published by Elsevier Inc.