There is provided a hearing assistance system, comprising a transmission unit (10) comprising a microphone arrangement (17) for capturing audio signals from a voice of a speaker ( 11 ) using the transmission unit and being adapted to transmit the audio signals as radio frequency (RF) signal via a wireless RF link (12); a left ear hearing device (16B) and a right ear hearing device (16A), each hearing device being adapted to stimulate the user's hearing and to receive an RF signal from the transmission unit via the wireless RF link and comprising a microphone arrangement (62) for capturing audio signals from ambient sound; the hearing devices being adapted to communicate with each other via a binaural link (15) and to estimate the angular location of the transmission unit by exchanging data concerning the received RF signal level, the level of the audio signal captured by the microphone arrangement of the hearing devices, and the phase difference between the audio signal received via the RF link from the transmission unit and the audio signal captured by the microphone arrangement of the hearing device, wherein each hearing device is adapted to process the au dio signal received from the transmission unit via the wireless link in a manner so as to create a hearing perception, when stimulating the user's hearing according to the processed audio signals, wherein the angular localization impression of the audio signals from the transmission unit corresponds to the estimated azimuthal angular location of the transmission unit.