论文标题
迈向片上贝叶斯神经形态学习
Towards On-Chip Bayesian Neuromorphic Learning
论文作者
论文摘要
如果将边缘设备部署到关键应用程序中,他们的决策可能会带来严重的财务,政治或公共卫生后果,则他们将需要一种方式来发出信号,当他们不确定如何对环境做出反应时。例如,丢失的交货无人机可以回到配送中心,或者如果对客户进行确切的交付方式感到困惑,而不是采取“最有可能”正确的操作。对于医疗保健或军事应用,此问题更加复杂。但是,很难求解神经形态计算算法的脑逼真的时间信用分配问题很难解决。在基于反向传播的学习学习中,双重角色权重决定网络对输入和反馈的反应,需要解耦。 E-Prop 1是一种有前途的学习算法,可以通过广播对齐(一种在反馈期间用随机权重取代网络权重的技术)并累积本地信息。我们在什么条件下调查贝叶斯损失项可以以类似的方式表达,提出了一种算法,该算法也只能使用本地信息进行计算,因此在硬件上不难实施。该算法在商店回顾问题上展出,这表明它可以随着时间的流逝而学习决策的良好不确定性。
If edge devices are to be deployed to critical applications where their decisions could have serious financial, political, or public-health consequences, they will need a way to signal when they are not sure how to react to their environment. For instance, a lost delivery drone could make its way back to a distribution center or contact the client if it is confused about how exactly to make its delivery, rather than taking the action which is "most likely" correct. This issue is compounded for health care or military applications. However, the brain-realistic temporal credit assignment problem neuromorphic computing algorithms have to solve is difficult. The double role weights play in backpropagation-based-learning, dictating how the network reacts to both input and feedback, needs to be decoupled. e-prop 1 is a promising learning algorithm that tackles this with Broadcast Alignment (a technique where network weights are replaced with random weights during feedback) and accumulated local information. We investigate under what conditions the Bayesian loss term can be expressed in a similar fashion, proposing an algorithm that can be computed with only local information as well and which is thus no more difficult to implement on hardware. This algorithm is exhibited on a store-recall problem, which suggests that it can learn good uncertainty on decisions to be made over time.