Approximating Relu Networks By Single-Spike Computation
Developing energy-saving neural network models is a topic of rapidly increasing interest in the artificial intelligence community. Spiking neural networks (SNNs) are biologically inspired models that strive to leverage the energy efficiency stemming from a long process of evolution under limited resources. In this paper we propose a SNN model where each neuron integrates piecewise linear postsynaptic potentials caused by input spikes and a positive bias, and spikes maximally once. Transformation of such a network into the ANN domain yields an approximation of a standard ReLU network, leading to a facilitated training based on backpropagation and an adaptation of the batch normalization. With backpropagation-trained weights, SNN inference offers a sparse-signal and low-latency classification, which can be readily adapted for a stream of input patterns, lending itself to an efficient hardware implementation. The supervised classification of MNIST and Fashion-MNIST datasets, using this approach, provides accuracy close to that of an ANN and surpassing other single-spike SNNs.
Cite this item
Stanojevic, A., Eleftheriou, E., Cherubini, G., Wozniak, S., Pantazi, A., & Gerstner, W. (2022). Approximating Relu Networks By Single-Spike Computation. 2022 Ieee International Conference on Image Processing, Icip, IEEE International Conference on Image Processing ICIP, 1901–1905. https://doi.org/10.1109/ICIP46576.2022.9897692
Click Copy to copy the citation, or select the text manually.
WOS:001058109502003
2022-01-01
New York
978-1-6654-9620-9
IEEE International Conference on Image Processing ICIP
1901
1905
REVIEWED
EPFL
| Event name | Event place | Event date |
Bordeaux, FRANCE | Oct 16-19, 2022 | |