AdaptHD: Adaptive Efficient Training for Brain-Inspired Hyperdimensional Computing

Brain-inspired Hyperdimensional (HD) computing is a promising solution for energy-efficient classification. However, the existing HD computing algorithms have a lack of controllability on the training iterations which often results in slow training or divergence. In this work, we propose AdaptHD, an adaptive learning approach based on HD computing to address the HD training issues. AdaptHD introduces the definition of learning rate in HD computing and proposes two approaches for adaptive training: iteration-dependent and data-dependent. In the iteration-dependent approach, AdaptHD uses a large learning rate to speedup the training procedure in the first iterations, and then adaptively reduces the learning rate depending on the slope of the error rate. In the data-dependent approach, AdaptHD changes the learning rate for each data point depending on how far off the data was misclassified. Our evaluations on a wide range of classification applications show that AdaptHD achieves 6.9× speedup and 6.3× energy efficiency improvement during training as compared to the state-of-the-art HD computing algorithm.

Published in:
[2019 IEEE Biomedical Circuits and Systems Conference (BioCAS)]
Presented at:
BioCAS 2019, Nara, Japan, October 17-19, 2019
Oct 17 2019
Paper ID 8008.

Note: The status of this file is: Anyone

 Record created 2019-10-23, last modified 2020-04-20

Download fulltext

Rate this document:

Rate this document:
(Not yet reviewed)