With the advancement of deep learning and neural networks,the computational demands for applications in wearable devices have grown exponentially.However,wearable devices also have strict requirements for long battery...With the advancement of deep learning and neural networks,the computational demands for applications in wearable devices have grown exponentially.However,wearable devices also have strict requirements for long battery life,low power consumption,and compact size.In this work,we propose a scalable optoelectronic computing system based on an integrated optical convolution acceleration core.This system enables high-precision computation at the speed of light,achieving 7-bit accuracy while maintaining extremely low power consumption.It also demonstrates peak throughput of 3.2 TOPS(tera operations per second)in parallel processing.We have successfully demonstrated image convolution and the typical application of an interactive first-person perspective gesture recognition application based on depth information.The system achieves a comparable recognition accuracy to traditional electronic computation in all blind tests.展开更多
基金supported by the National Natural Science Foundation of China (U21A20511)the Innovation Project of Optics Valley Laboratory (OVL2021BG001).
文摘With the advancement of deep learning and neural networks,the computational demands for applications in wearable devices have grown exponentially.However,wearable devices also have strict requirements for long battery life,low power consumption,and compact size.In this work,we propose a scalable optoelectronic computing system based on an integrated optical convolution acceleration core.This system enables high-precision computation at the speed of light,achieving 7-bit accuracy while maintaining extremely low power consumption.It also demonstrates peak throughput of 3.2 TOPS(tera operations per second)in parallel processing.We have successfully demonstrated image convolution and the typical application of an interactive first-person perspective gesture recognition application based on depth information.The system achieves a comparable recognition accuracy to traditional electronic computation in all blind tests.