In this chapter, we present all the technical details that lead to successfully understanding the mobility of more than a hundred million individuals in crowded train terminals over the course of two years. We cover the full spectrum of an intelligent system that detects and tracks humans in high density crowds using a camera network. We share detailed insights on how to address the occlusion problem with sparsity promoting priors and discrete combinatorial optimization that models social interactions.