Temporal pattern coding in deep spiking neural networks
Piscataway, NJ : Institute of Electrical and Electronics Engineers (IEEE)
In2021 International Joint Conference on Neural Networks (IJCNN), pp. 1-8
2021 International Joint Conference on Neural Networks (IJCNN) (Shenzhen, China, 18-22 July 2021)
Article in monograph or in proceedings
Display more detailsDisplay less details
SW OZ DCC AI
2021 International Joint Conference on Neural Networks (IJCNN)
SubjectCognitive artificial intelligence
Deep Artificial Neural Networks (ANNs) employ a simplified analog neuron model that mimics the rate transfer function of integrate-and-fire neurons. In Spiking Neural Networks (SNNs), the predominant information transmission method is based on rate codes. This code is inefficient from a hardware perspective because the number of transmitted spikes is proportional to the encoded analog value. Alternate codes such as temporal codes that are based on single spikes are difficult to scale up for large networks due to their sensitivity to spike timing noise. Here we present a study of an encoding scheme based on temporal spike patterns. This scheme inherits the efficiency of temporal codes but retains the robustness of rate codes. The pattern code is evaluated on MNIST, CIFAR-10, and ImageNet image classification tasks. We compare the network performance of ANNs, rate-coded SNNs, and temporal-coded SNNs, using the classification error and operation count as performance metrics. We also estimate the power consumption of the digital logic needed for the operations associated with each encoding type, and the impact of the bit precision of the weights and activations. On ImageNet, the temporal pattern code achieves up to 35× reduction in the estimated power consumption compared to the rate-coded SNN, and 42× compared to the ANN. The classification error of the pattern-coded SNN is increased by <1% compared to the ANN, and decreased by 2% compared to the rate-coded SNN.
This item appears in the following Collection(s)
- Academic publications 
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.