bwasti 7 years ago

I doubt pruning alone is going to serve up the same kind of wins that energy aware architectures will. The main problem is that convolutions are heavy computational operations. There has been ongoing research in modifications to the convolution that basically decrease the amount of computation being done in channel space (grouped and depthwise separable convolutions). The tradeoff is accuracy, but new techniques (like shuffling the channels) are helping recover that.

MobileNets and ShuffleNet are some examples. They see 10x reductions in MACs, far more than the "73 percent reduction in power consumption over the standard implementation of neural networks" talked about in this article. https://arxiv.org/pdf/1704.04861.pdf https://arxiv.org/pdf/1707.01083.pdf