Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Audio-visual detection of multiple chirping robots
 
conference paper

Audio-visual detection of multiple chirping robots

Gribovskiy, Alexey  
•
Mondada, Francesco  
Vahrenkamp, N.
•
Plagemann, C.
Show more
2008
Intelligent Autonomous Systems 10 - IAS-10
Intelligent Autonomous Systems 10

Design, study, and control of mixed animals-robots societies are the fields of scientific exploration that can bring new opportunities for study and control of groups of social insects and animals and, in particular, for improvement of welfare and breeding conditions of domestic animals. Our long-term objective is to develop a mobile robot, socially acceptable by chickens and able to interact with them using appropriate communication channels. For interaction purposes the robot has to know positions of all birds in an experimental area and detect those uttering calls. In this paper, we present an audio-visual approach to locate the robots and animals on a scene and detect their calling activity. The visual tracking is provided by a marker-based tracker with help of an overhead camera. Sound localization is achieved by the beamforming approach using an array of sixteen microphones. Visual and sound information are probabilistically mixed to detect the calling activity. The experimental results demonstrate that our system is capable to detect the sound emission activity of multiple moving robots with 90% probability.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

Audio-visual detection of multiple chirping robots_1.pdf

Type

Preprint

Version

Submitted version (Preprint)

Access type

openaccess

Size

1.91 MB

Format

Adobe PDF

Checksum (MD5)

799011596ec92c5bb6d8a84aa522a450

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés