Information transmission through multimode fibers (MMFs) has been a topic of great interest for many years. Deep learning algorithms have been applied successfully to MMFs in particular to fiber endoscopy. In this work, we show how Deep Neural Networks (DNNs) can be a versatile technique for classification and recovery of input images that have been significantly distorted while propagating along the MMF forming a speckle pattern. A comparison between holographic and intensity-only recording of the speckle output, which is used as an input to the DNNs, shows that high performance can be achieved without having the full field information (amplitude and phase). Impressive reconstruction fidelity and classification accuracy of the fiber inputs from the intensity-only images of the speckle patterns is reported.