This abstract presents the Tractometer evaluation system (www.tractometer.org) and how it was used to evaluate the entries of the ISBI 2013 HARDI Reconstruction Challenge to find the best local reconstruction methods of the contest. This abstract raises questions that researchers should take into consideration when choosing and developing new dMRI methods aimed at improving tractography.