A finite Hall conductance under zero magnetic field implies time reversal symmetry (TRS) breaking due to magnetic ordering. In rhombohedral (RH) stacked graphene, the angular momentum breaking TRS can result from the orbital degree of freedom at the K and K′ valleys. This leads to valley polarization and occupation-dependent anomalous Hall resistance (AHR) due to the chirality in Berry curvaturebetweenthevalleys. Wereportmagnetoelectriccontroloforbitalmagneticorderincrystalline rhombohedral hexalayer graphene (RHG), achieved without the introduction of a moiré superlattice. Atmoderatedisplacementfieldsandlowcarrierdensities, weobserveanon-volatileandhystereticAHR that can be electrically toggled by sweeping either the carrier density or the displacement field. Upon the application of small perpendicular magnetic fields, the system reveals a characteristic double sign reversal of the AHR, indicating a competition between distinct magnetic ground states. This interplay between valley polarization, orbital magnetism, and electric and magnetic field tuning demonstrates the rich multiferroic behavior of RHG. Our findings present crystalline RHG as a minimal, tunable platform for studying symmetry-breaking phases and magnetic order in flat-band systems, offering insight into the coupling between electronic structure and magnetoelectric response.