This paper investigates the prediction of two aspects of human behavior us- ing smartphones as sensing devices. We present a framework for predicting where users will go and which app they will use in the next ten minutes by ex- ploiting the rich contextual information from smartphone sensors. Our first goal is to understand which smartphone sensor data types are important for the two prediction tasks. Secondly, we aim at extracting generic (i.e., user- independent) behavioral patterns and study how generic behavior models can improve the predictive performance of personalized models. Experimen- tal validation was conducted on the Lausanne Data Collection Campaign (LDCC) dataset, with longitudinal smartphone data collected over a period of 17 months from 71 users.