Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Spiking Neural Networks for Active Time-Resolved SPAD Imaging
 
conference paper

Spiking Neural Networks for Active Time-Resolved SPAD Imaging

Lin, Yang  
•
Charbon, Edoardo  
January 3, 2024
Proceedings - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
IEEE Winter Conference on Applications of Computer Vision

Single-photon avalanche diodes (SPADs) are detectors capable of capturing single photons and of performing photon counting. SPADs have an exceptional temporal resolution and are thus highly suitable for time-resolved imaging applications. Applications span from biomedical research to consumers with SPADs integrated in smartphones and mixed-reality headsets. While conventional SPAD imaging systems typically employ photon time-tagging and histogram-building in the workflow, the pulse signal output of a SPAD naturally lends itself as input to spiking neural networks (SNNs). Leveraging this potential, SNNs offer real-time, energy-efficient, and intelligent processing with high throughput. In this paper, we propose two SNN frameworks, namely the Transporter SNN and the Reversed Start-stop SNN, along with corresponding hardware schemes for active time-resolved SPAD imaging. These frameworks convert phase-coded spike trains into density- and interspike-interval-coded ones, enabling training with rate-based warm-up and Surrogate Gradient. The SNNs are evaluated on fluorescence lifetime imaging. The results demonstrate that the accuracy of shallow SNNs is on par with established benchmarks. Our vision is to integrate SNNs in SPAD sensors and to explore advanced SNNs within the proposed schemes for high-level applications.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/WACV57701.2024.00796
Scopus ID

2-s2.0-85183791867

Author(s)
Lin, Yang  

École Polytechnique Fédérale de Lausanne

Charbon, Edoardo  

École Polytechnique Fédérale de Lausanne

Date Issued

2024-01-03

Publisher

Institute of Electrical and Electronics Engineers Inc.

Published in
Proceedings - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
ISBN of the book

9798350318920

Start page

8132

End page

8141

Subjects

Applications

•

Applications

•

Biomedical / healthcare / medicine

•

Embedded sensing / real-time techniques

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
AQUA  
Event nameEvent acronymEvent placeEvent date
IEEE Winter Conference on Applications of Computer Vision

Waikoloa, United States

2024-01-04 - 2024-01-08

Available on Infoscience
January 26, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/244804
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés