Rock cuttings from destructive boreholes are a common and cheaper source of drilling materials that can be used to determine underground geology compared to rock core samples. Classifying manually the series of cuttings can be a long and tedious process and can also be prone to subjectivity leading to errors. In this paper, a framework for the classification of multiple types of rock structures is introduced based on rock cutting images from X-ray micro-CT technology. The classification is performed using a simple yet effective deep learning model (a ResNet-18 architecture) to categorize five different lithologies: micritic limestone, bioclastic limestone, oolithic limestone, molassic sandstone and gneiss. The proposed network is trained on 2 datasets (laboratory and borehole) both containing the five lithologies and comprise over 10 000 images. The laboratory dataset consists of a well-controlled experiments with homogeneous samples and the borehole dataset with heterogeneous samples corresponding to a real case application. Among all the considered models, including ResNet-34, and SPP-CNN and human experts manual classification, ResNet-18 demonstrates superior performance across multiple evaluation metrics, including precision, recall, and F1-score. It is to our best knowledge, the first time a test comparing deep neural network and human performance is performed for this task. To optimize the performance of the proposed model, the transfer learning method is implemented. Furthermore, the experiments demonstrate that when employing transfer learning, the size of the dataset significantly impacts the performance of the model. In the studied design, the experimental results confirm that the proposed approach is a cost-effective and efficient method for automated rock cutting classification using the micro-CT technique, and it can be easily modified to adapt the rock cutting classification from various types and sources.