Anisotropic magnetism of single crystal BaVSe3 was Studied for the first time by the combination of the susceptibility and torque methods. As reported previously for polycrystalline sample, BaVSe3 undergoes ferromagnetic ordering below 43 K. Well above ferromagnetic ordering temperature, the torque measurements reveal a continuous symmetry change that influences the ordered state accordingly. We found ferromagnetic easy axis in the vanadium chain direction, i.e., along the crystallographic c-axis. The presence of two ferromagnetic domains of opposite magnetization direction signifies uniaxial symmetry of the ordered ferromagnetic State.