Neuromorphic photonic computing has emerged as a competitive computing paradigm to overcome the bottlenecks of the von-Neumann architecture.Linear weighting and nonlinear spike activation are two fundamental functions...Neuromorphic photonic computing has emerged as a competitive computing paradigm to overcome the bottlenecks of the von-Neumann architecture.Linear weighting and nonlinear spike activation are two fundamental functions of a photonic spiking neural network(PSNN).However,they are separately implemented with different photonic materials and devices,hindering the large-scale integration of PSNN.Here,we propose,fabricate and experimentally demonstrate a photonic neuro-synaptic chip enabling the simultaneous implementation of linear weighting and nonlinear spike activation based on a distributed feedback(DFB)laser with a saturable absorber(DFB-SA).A prototypical system is experimentally constructed to demonstrate the parallel weighted function and nonlinear spike activation.Furthermore,a fourchannel DFB-SA laser array is fabricated for realizing matrix convolution of a spiking convolutional neural network,achieving a recognition accuracy of 87%for the MNIST dataset.The fabricated neuro-synaptic chip offers a fundamental building block to construct the large-scale integrated PSNN chip.展开更多
Task offloading is a potential solution to satisfy the strict requirements of computation-intensive and latency-sensitive vehicular applications due to the limited onboard computing resources.However,the overwhelming ...Task offloading is a potential solution to satisfy the strict requirements of computation-intensive and latency-sensitive vehicular applications due to the limited onboard computing resources.However,the overwhelming upload traffic may lead to unacceptable uploading time.To tackle this issue,for tasks taking environmental data as input,the data perceived by roadside units(RSU)equipped with several sensors can be directly exploited for computation,resulting in a novel task offloading paradigm with integrated communications,sensing and computing(I-CSC).With this paradigm,vehicles can select to upload their sensed data to RSUs or transmit computing instructions to RSUs during the offloading.By optimizing the computation mode and network resources,in this paper,we investigate an I-CSC-based task offloading problem to reduce the cost caused by resource consumption while guaranteeing the latency of each task.Although this nonconvex problem can be handled by the alternating minimization(AM)algorithm that alternatively minimizes the divided four sub-problems,it leads to high computational complexity and local optimal solution.To tackle this challenge,we propose a creative structural knowledge-driven meta-learning(SKDML)method,involving both the model-based AM algorithm and neural networks.Specifically,borrowing the iterative structure of the AM algorithm,also referred to as structural knowledge,the proposed SKDML adopts long short-term memory(LSTM)networkbased meta-learning to learn an adaptive optimizer for updating variables in each sub-problem,instead of the handcrafted counterpart in the AM algorithm.Furthermore,to pull out the solution from the local optimum,our proposed SKDML updates parameters in LSTM with the global loss function.Simulation results demonstrate that our method outperforms both the AM algorithm and the meta-learning without structural knowledge in terms of both the online processing time and the network performance.展开更多
Parallel multi-thread processing in advanced intelligent processors is the core to realize high-speed and high-capacity signal processing systems.Optical neural network(ONN)has the native advantages of high paralleliz...Parallel multi-thread processing in advanced intelligent processors is the core to realize high-speed and high-capacity signal processing systems.Optical neural network(ONN)has the native advantages of high parallelization,large bandwidth,and low power consumption to meet the demand of big data.Here,we demonstrate the dual-layer ONN with Mach-Zehnder interferometer(MZI)network and nonlinear layer,while the nonlinear activation function is achieved by optical-electronic signal conversion.Two frequency components from the microcomb source carrying digit datasets are simultaneously imposed and intelligently recognized through the ONN.We successfully achieve the digit classification of different frequency components by demultiplexing the output signal and testing power distribution.Efficient parallelization feasibility with wavelength division multiplexing is demonstrated in our high-dimensional ONN.This work provides a high-performance architecture for future parallel high-capacity optical analog computing.展开更多
Multi-antenna technologies have already achieved a series of great successes in the development of information networks. For future space-ground integrated networks(SGINs), the traditional various kinds of separated i...Multi-antenna technologies have already achieved a series of great successes in the development of information networks. For future space-ground integrated networks(SGINs), the traditional various kinds of separated information networks will converge to a whole fully connected information network to provide more flexible and reliable services on a world scale. Regarding their great successes in existing systems, multiantenna technologies will be of critical importance for the realization of SGINs and multi-antenna technologies are definitely one of the most important enabling technologies for future converged SGINs. In this article, a comprehensive overview on multi-antenna technologies is given. We first investigate multi-antenna technologies from a theoretical viewpoint. It is shown that we can understand multi-antenna technologies in a general and unified point of view. This fact has two-fold meanings. First, the research on multi-antennas can help us understand the relationships between different technologies e.g., OFDMA, CDMA, etc. On the other hand,multi-antenna technologies are easy to integrate into various information systems. Following that, we discuss in depth the potentials and challenges of the multi-antenna technologies on different platforms and in different applications case by case. More specifically, we investigate spaceborne multi-antenna technologies, airborne multi-antenna technologies, shipborne multi-antenna technologies, etc. Moreover, the combinations of multiantenna technologies with other advanced wireless technologies e.g., physical layer network coding, cooperative communication, etc., are also elaborated.展开更多
Three recent breakthroughs due to AI in arts and science serve as motivation:An award winning digital image,protein folding,fast matrix multiplication.Many recent developments in artificial neural networks,particularl...Three recent breakthroughs due to AI in arts and science serve as motivation:An award winning digital image,protein folding,fast matrix multiplication.Many recent developments in artificial neural networks,particularly deep learning(DL),applied and relevant to computational mechanics(solid,fluids,finite-element technology)are reviewed in detail.Both hybrid and pure machine learning(ML)methods are discussed.Hybrid methods combine traditional PDE discretizations with ML methods either(1)to help model complex nonlinear constitutive relations,(2)to nonlinearly reduce the model order for efficient simulation(turbulence),or(3)to accelerate the simulation by predicting certain components in the traditional integration methods.Here,methods(1)and(2)relied on Long-Short-Term Memory(LSTM)architecture,with method(3)relying on convolutional neural networks.Pure ML methods to solve(nonlinear)PDEs are represented by Physics-Informed Neural network(PINN)methods,which could be combined with attention mechanism to address discontinuous solutions.Both LSTM and attention architectures,together with modern and generalized classic optimizers to include stochasticity for DL networks,are extensively reviewed.Kernel machines,including Gaussian processes,are provided to sufficient depth for more advanced works such as shallow networks with infinite width.Not only addressing experts,readers are assumed familiar with computational mechanics,but not with DL,whose concepts and applications are built up from the basics,aiming at bringing first-time learners quickly to the forefront of research.History and limitations of AI are recounted and discussed,with particular attention at pointing out misstatements or misconceptions of the classics,even in well-known references.Positioning and pointing control of a large-deformable beam is given as an example.展开更多
As the integration of distributed generations(DGs)transforms the traditional distribution network into the active distribution network,voltage stability assessments(VSA)of transmission grid and distribution grid are n...As the integration of distributed generations(DGs)transforms the traditional distribution network into the active distribution network,voltage stability assessments(VSA)of transmission grid and distribution grid are not suitable to be studied separately.This paper presents a distributed continuation power flow method for VSA of global transmission and distribution grid.Two different parameterization schemes are adopted to guarantee the coherence of load growth in transmission and distribution grids.In the correction step,the boundary bus voltage,load parameter and equivalent power are communicated between the transmission and distribution control centers to realize the distributed computation of load margin.The optimal multiplier technique is used to improve the convergence of the proposed method.The three-phase unbalanced characteristic of distribution networks and the reactive capability limits of DGs are considered.Simulation results on two integrated transmission and distribution test systems show that the proposed method is effective.展开更多
基金financial supports from National Key Research and Development Program of China (2021YFB2801900,2021YFB2801901,2021YFB2801902,2021YFB2801904)National Natural Science Foundation of China (No.61974177)+1 种基金National Outstanding Youth Science Fund Project of National Natural Science Foundation of China (62022062)The Fundamental Research Funds for the Central Universities (QTZX23041).
文摘Neuromorphic photonic computing has emerged as a competitive computing paradigm to overcome the bottlenecks of the von-Neumann architecture.Linear weighting and nonlinear spike activation are two fundamental functions of a photonic spiking neural network(PSNN).However,they are separately implemented with different photonic materials and devices,hindering the large-scale integration of PSNN.Here,we propose,fabricate and experimentally demonstrate a photonic neuro-synaptic chip enabling the simultaneous implementation of linear weighting and nonlinear spike activation based on a distributed feedback(DFB)laser with a saturable absorber(DFB-SA).A prototypical system is experimentally constructed to demonstrate the parallel weighted function and nonlinear spike activation.Furthermore,a fourchannel DFB-SA laser array is fabricated for realizing matrix convolution of a spiking convolutional neural network,achieving a recognition accuracy of 87%for the MNIST dataset.The fabricated neuro-synaptic chip offers a fundamental building block to construct the large-scale integrated PSNN chip.
基金supported in part by National Key Research and Development Program of China(2020YFB1807700)in part by National Natural Science Foundation of China(62201414)+2 种基金in part by Qinchuangyuan Project(OCYRCXM-2022-362)in part by Science and Technology Project of Guangzhou(2023A04J1741)in part by Chongqing key laboratory of Mobile Communications Technologg(cqupt-mct-202202).
文摘Task offloading is a potential solution to satisfy the strict requirements of computation-intensive and latency-sensitive vehicular applications due to the limited onboard computing resources.However,the overwhelming upload traffic may lead to unacceptable uploading time.To tackle this issue,for tasks taking environmental data as input,the data perceived by roadside units(RSU)equipped with several sensors can be directly exploited for computation,resulting in a novel task offloading paradigm with integrated communications,sensing and computing(I-CSC).With this paradigm,vehicles can select to upload their sensed data to RSUs or transmit computing instructions to RSUs during the offloading.By optimizing the computation mode and network resources,in this paper,we investigate an I-CSC-based task offloading problem to reduce the cost caused by resource consumption while guaranteeing the latency of each task.Although this nonconvex problem can be handled by the alternating minimization(AM)algorithm that alternatively minimizes the divided four sub-problems,it leads to high computational complexity and local optimal solution.To tackle this challenge,we propose a creative structural knowledge-driven meta-learning(SKDML)method,involving both the model-based AM algorithm and neural networks.Specifically,borrowing the iterative structure of the AM algorithm,also referred to as structural knowledge,the proposed SKDML adopts long short-term memory(LSTM)networkbased meta-learning to learn an adaptive optimizer for updating variables in each sub-problem,instead of the handcrafted counterpart in the AM algorithm.Furthermore,to pull out the solution from the local optimum,our proposed SKDML updates parameters in LSTM with the global loss function.Simulation results demonstrate that our method outperforms both the AM algorithm and the meta-learning without structural knowledge in terms of both the online processing time and the network performance.
基金Peng Xie acknowledges the support from the China Scholarship Council(Grant no.201804910829).
文摘Parallel multi-thread processing in advanced intelligent processors is the core to realize high-speed and high-capacity signal processing systems.Optical neural network(ONN)has the native advantages of high parallelization,large bandwidth,and low power consumption to meet the demand of big data.Here,we demonstrate the dual-layer ONN with Mach-Zehnder interferometer(MZI)network and nonlinear layer,while the nonlinear activation function is achieved by optical-electronic signal conversion.Two frequency components from the microcomb source carrying digit datasets are simultaneously imposed and intelligently recognized through the ONN.We successfully achieve the digit classification of different frequency components by demultiplexing the output signal and testing power distribution.Efficient parallelization feasibility with wavelength division multiplexing is demonstrated in our high-dimensional ONN.This work provides a high-performance architecture for future parallel high-capacity optical analog computing.
基金supported in part by National Scientific Foundation of China for Young Scholars(Grant Nos.61301088,61301089)
文摘Multi-antenna technologies have already achieved a series of great successes in the development of information networks. For future space-ground integrated networks(SGINs), the traditional various kinds of separated information networks will converge to a whole fully connected information network to provide more flexible and reliable services on a world scale. Regarding their great successes in existing systems, multiantenna technologies will be of critical importance for the realization of SGINs and multi-antenna technologies are definitely one of the most important enabling technologies for future converged SGINs. In this article, a comprehensive overview on multi-antenna technologies is given. We first investigate multi-antenna technologies from a theoretical viewpoint. It is shown that we can understand multi-antenna technologies in a general and unified point of view. This fact has two-fold meanings. First, the research on multi-antennas can help us understand the relationships between different technologies e.g., OFDMA, CDMA, etc. On the other hand,multi-antenna technologies are easy to integrate into various information systems. Following that, we discuss in depth the potentials and challenges of the multi-antenna technologies on different platforms and in different applications case by case. More specifically, we investigate spaceborne multi-antenna technologies, airborne multi-antenna technologies, shipborne multi-antenna technologies, etc. Moreover, the combinations of multiantenna technologies with other advanced wireless technologies e.g., physical layer network coding, cooperative communication, etc., are also elaborated.
文摘Three recent breakthroughs due to AI in arts and science serve as motivation:An award winning digital image,protein folding,fast matrix multiplication.Many recent developments in artificial neural networks,particularly deep learning(DL),applied and relevant to computational mechanics(solid,fluids,finite-element technology)are reviewed in detail.Both hybrid and pure machine learning(ML)methods are discussed.Hybrid methods combine traditional PDE discretizations with ML methods either(1)to help model complex nonlinear constitutive relations,(2)to nonlinearly reduce the model order for efficient simulation(turbulence),or(3)to accelerate the simulation by predicting certain components in the traditional integration methods.Here,methods(1)and(2)relied on Long-Short-Term Memory(LSTM)architecture,with method(3)relying on convolutional neural networks.Pure ML methods to solve(nonlinear)PDEs are represented by Physics-Informed Neural network(PINN)methods,which could be combined with attention mechanism to address discontinuous solutions.Both LSTM and attention architectures,together with modern and generalized classic optimizers to include stochasticity for DL networks,are extensively reviewed.Kernel machines,including Gaussian processes,are provided to sufficient depth for more advanced works such as shallow networks with infinite width.Not only addressing experts,readers are assumed familiar with computational mechanics,but not with DL,whose concepts and applications are built up from the basics,aiming at bringing first-time learners quickly to the forefront of research.History and limitations of AI are recounted and discussed,with particular attention at pointing out misstatements or misconceptions of the classics,even in well-known references.Positioning and pointing control of a large-deformable beam is given as an example.
基金This work is supported by National Natural Science Foundation of China(No.51077042,No.51577049)Special Foundation of The doctoral program of Higher Education(No.20120094110008).
文摘As the integration of distributed generations(DGs)transforms the traditional distribution network into the active distribution network,voltage stability assessments(VSA)of transmission grid and distribution grid are not suitable to be studied separately.This paper presents a distributed continuation power flow method for VSA of global transmission and distribution grid.Two different parameterization schemes are adopted to guarantee the coherence of load growth in transmission and distribution grids.In the correction step,the boundary bus voltage,load parameter and equivalent power are communicated between the transmission and distribution control centers to realize the distributed computation of load margin.The optimal multiplier technique is used to improve the convergence of the proposed method.The three-phase unbalanced characteristic of distribution networks and the reactive capability limits of DGs are considered.Simulation results on two integrated transmission and distribution test systems show that the proposed method is effective.