Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Approximating Relu Networks By Single-Spike Computation
 
conference paper

Approximating Relu Networks By Single-Spike Computation

Stanojevic, Ana
•
Eleftheriou, Evangelos
•
Cherubini, Giovanni
Show more
January 1, 2022
2022 Ieee International Conference On Image Processing, Icip
IEEE International Conference on Image Processing (ICIP)

Developing energy-saving neural network models is a topic of rapidly increasing interest in the artificial intelligence community. Spiking neural networks (SNNs) are biologically inspired models that strive to leverage the energy efficiency stemming from a long process of evolution under limited resources. In this paper we propose a SNN model where each neuron integrates piecewise linear postsynaptic potentials caused by input spikes and a positive bias, and spikes maximally once. Transformation of such a network into the ANN domain yields an approximation of a standard ReLU network, leading to a facilitated training based on backpropagation and an adaptation of the batch normalization. With backpropagation-trained weights, SNN inference offers a sparse-signal and low-latency classification, which can be readily adapted for a stream of input patterns, lending itself to an efficient hardware implementation. The supervised classification of MNIST and Fashion-MNIST datasets, using this approach, provides accuracy close to that of an ANN and surpassing other single-spike SNNs.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ICIP46576.2022.9897692
Web of Science ID

WOS:001058109502003

Author(s)
Stanojevic, Ana
Eleftheriou, Evangelos
Cherubini, Giovanni
Wozniak, Stanislaw
Pantazi, Angeliki
Gerstner, Wulfram  
Date Issued

2022-01-01

Publisher

IEEE

Publisher place

New York

Published in
2022 Ieee International Conference On Image Processing, Icip
ISBN of the book

978-1-6654-9620-9

Series title/Series vol.

IEEE International Conference on Image Processing ICIP

Start page

1901

End page

1905

Subjects

spiking neural network

•

one spike per neuron

•

image processing

•

relu

•

efficient classification

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LCN  
Event nameEvent placeEvent date
IEEE International Conference on Image Processing (ICIP)

Bordeaux, FRANCE

Oct 16-19, 2022

Available on Infoscience
October 23, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/201722
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés