Our advanced computer vision system allows for the precise tracking of serial numbers on steel billets in challenging industrial settings. It combines cutting-edge hardware and machine learning, excelling in character recognition (99.8%) and localization while adapting to dynamic ambient lighting conditions (104 ). Moreover, it accurately measures crucial geometric parameters such as side sizes, bulging, and skewness. This multifaceted technology promises to elevate material tracking, quality assessment, and production optimization in the steel industry to unprecedented levels.