Ultra-High Performance Fiber Reinforced Concretes (UHPFRC) have demonstrated their potential to contain the explosion of maintenance costs (Economy and Environment) for civil engineering structures, due to their extremely low permeability associated with the outstanding mechanical properties. Substitution of Embodied- Energy (EE)-costly components of UHPFRC such as clinker and steel fibers, is the next step towards sustainability, to make it even more efficient and more environment- friendly. In this study, a strain hardening UHPFRC mix with two main modifications has been developed in which (1) 75% of steel fibers have been replaced by ultra-high molecular weight polyethylene (UHMWPE, henceforth referred to as PE) fibers and (2) 50% volume of cement type CEM I have been replaced with limestone filler. The effect of the fiber orientation and the specimen thickness on the mechanical properties of such mixes have been investigated. The mechanical properties have been investigated using direct tensile test, and 4-point bending test. Finally, the dramatic effect of fiber orientation on the ultimate strength and deformability has been demonstrated. Moreover, the results confirm that the specimen thickness affects the deformation capacity of the specimens. Finally, improvements in terms of reduction of EE of the proposed mixes are highlighted.