Parallel Learning:Overview and Perspective for Computational Learning Across Syn2Real and Sim2Real

The virtual-to-real paradigm,i.e.,training models on virtual data and then applying them to solve real-world problems,has attracted more and more attention from various domains by successfully alleviating the data shortage problem in machine learning.To summarize the advances in recent years,this survey comprehensively reviews the literature,from the viewport of parallel intelligence.First,an extended parallel learning framework is proposed to cover main domains including computer vision,natural language processing,robotics,and autonomous driving.Second,a multi-dimensional taxonomy is designed to organize the literature in a hierarchical structure.Third,the related virtual-toreal works are analyzed and compared according to the three principles of parallel learning known as description,prediction,and prescription,which cover the methods for constructing virtual worlds,generating labeled data,domain transferring,model training and testing,as well as optimizing the strategies to guide the task-oriented data generator for better learning performance.Key issues remained in virtual-to-real are discussed.Furthermore,the future research directions from the viewpoint of parallel learning are suggested.

Parallel Learning:a Perspective and a Framework

The development of machine learning in complex system is hindered by two problems nowadays.The first problem is the inefficiency of exploration in state and action space,which leads to the data-hungry of some state-of-art data-driven algorithm.The second problem is the lack of a general theory which can be used to analyze and implement a complex learning system.In this paper,we proposed a general methods that can address both two issues.We combine the concepts of descriptive learning,predictive learning,and prescriptive learning into a uniform framework,so as to build a parallel system allowing learning system improved by self-boosting.Formulating a new perspective of data,knowledge and action,we provide a new methodology called parallel learning to design machine learning system for real-world problems.

Parallel Reinforcement Learning:A Framework and Case Study

In this paper, a new machine learning framework is developed for complex system control, called parallel reinforcement learning. To overcome data deficiency of current data-driven algorithms, a parallel system is built to improve complex learning system by self-guidance. Based on the Markov chain(MC) theory, we combine the transfer learning, predictive learning, deep learning and reinforcement learning to tackle the data and action processes and to express the knowledge. Parallel reinforcement learning framework is formulated and several case studies for real-world problems are finally introduced.

Collaborative Clustering Parallel Reinforcement Learning for Edge-Cloud Digital Twins Manufacturing System

To realize high-accuracy physical-cyber digital twin(DT)mapping in a manufacturing system,a huge amount of data need to be collected and analyzed in real-time.Traditional DTs systems are deployed in cloud or edge servers independently,whilst it is hard to apply in real production systems due to the high interaction or execution delay.This results in a low consistency in the temporal dimension of the physical-cyber model.In this work,we propose a novel efficient edge-cloud DT manufacturing system,which is inspired by resource scheduling technology.Specifically,an edge-cloud collaborative DTs system deployment architecture is first constructed.Then,deterministic and uncertainty optimization adaptive strategies are presented to choose a more powerful server for running DT-based applications.We model the adaptive optimization problems as dynamic programming problems and propose a novel collaborative clustering parallel Q-learning(CCPQL)algorithm and prediction-based CCPQL to solve the problems.The proposed approach reduces the total delay with a higher convergence rate.Numerical simulation results are provided to validate the approach,which would have great potential in dynamic and complex industrial internet environments.

Parallel Driving in CPSS:A Unified Approach for Transport Automation and Vehicle Intelligence

The emerging development of connected and automated vehicles imposes a significant challenge on current vehicle control and transportation systems. This paper proposes a novel unified approach, Parallel Driving, a cloud-based cyberphysical-social systems(CPSS) framework aiming at synergizing connected automated driving. This study first introduces the CPSS and ACP-based intelligent machine systems. Then the parallel driving is proposed in the cyber-physical-social space,considering interactions among vehicles, human drivers, and information. Within the framework, parallel testing, parallel learning and parallel reinforcement learning are developed and concisely reviewed. Development on intelligent horizon(iHorizon)and its applications are also presented towards parallel horizon.The proposed parallel driving offers an ample solution for achieving a smooth, safe and efficient cooperation among connected automated vehicles with different levels of automation in future road transportation systems.

A STUDY OF METHODS FOR IMPROVING LEARNING VECTOR QUANTIZATION

Learning Vector Quantization(LVQ)originally proposed by Kohonen(1989)is aneurally-inspired classifier which pays attention to approximating the optimal Bayes decisionboundaries associated with a classification task.With respect to several defects of LVQ2 algorithmstudied in this paper,some‘soft’competition schemes such as‘majority voting’scheme andcredibility calculation are proposed for improving the ability of classification as well as the learningspeed.Meanwhile,the probabilities of winning are introduced into the corrections for referencevectors in the‘soft’competition.In contrast with the conventional sequential learning technique,a novel parallel learning technique is developed to perform LVQ2 procedure.Experimental resultsof speech recognition show that these new approaches can lead to better performance as comparedwith the conventional