The Internet of Things under Federated Learning:A Review of the Latest Advances and Applications

With the rapid development of artificial intelligence,the Internet of Things(IoT)can deploy various machine learning algorithms for network and application management.In the IoT environment,many sensors and devices generatemassive data,but data security and privacy protection have become a serious challenge.Federated learning(FL)can achieve many intelligent IoT applications by training models on local devices and allowing AI training on distributed IoT devices without data sharing.This review aims to deeply explore the combination of FL and the IoT,and analyze the application of federated learning in the IoT from the aspects of security and privacy protection.In this paper,we first describe the potential advantages of FL and the challenges faced by current IoT systems in the fields of network burden and privacy security.Next,we focus on exploring and analyzing the advantages of the combination of FL on the Internet,including privacy security,attack detection,efficient communication of the IoT,and enhanced learning quality.We also list various application scenarios of FL on the IoT.Finally,we propose several open research challenges and possible solutions.

Game theory in network security for digital twins in industry

To ensure the safe operation of industrial digital twins network and avoid the harm to the system caused by hacker invasion,a series of discussions on network security issues are carried out based on game theory.From the perspective of the life cycle of network vulnerabilities,mining and repairing vulnerabilities are analyzed by applying evolutionary game theory.The evolution process of knowledge sharing among white hats under various conditions is simulated,and a game model of the vulnerability patch cooperative development strategy among manufacturers is constructed.On this basis,the differential evolution is introduced into the update mechanism of the Wolf Colony Algorithm(WCA)to produce better replacement individuals with greater probability from the perspective of both attack and defense.Through the simulation experiment,it is found that the convergence speed of the probability(X)of white Hat 1 choosing the knowledge sharing policy is related to the probability(x0)of white Hat 2 choosing the knowledge sharing policy initially,and the probability(y0)of white hat 2 choosing the knowledge sharing policy initially.When y0?0.9,X converges rapidly in a relatively short time.When y0 is constant and x0 is small,the probability curve of the“cooperative development”strategy converges to 0.It is concluded that the higher the trust among the white hat members in the temporary team,the stronger their willingness to share knowledge,which is conducive to the mining of loopholes in the system.The greater the probability of a hacker attacking the vulnerability before it is fully disclosed,the lower the willingness of manufacturers to choose the"cooperative development"of vulnerability patches.Applying the improved wolf colonyco-evolution algorithm can obtain the equilibrium solution of the"attack and defense game model",and allocate the security protection resources according to the importance of nodes.This study can provide an effective solution to protect the network security for digital twins in the industry.

Modeling Methods of 3D Model in Digital Twins

To understand the current application and development of 3D modeling in Digital Twins(DTs),abundant literatures on DTs and 3D modeling are investigated by means of literature review.The transition process from 3D modeling to DTs modeling is analyzed,as well as the current application of DTs modeling in various industries.The application of 3D DTs modeling in the􀀀elds of smartmanufacturing,smart ecology,smart transportation,and smart buildings in smart cities is analyzed in detail,and the current limitations are summarized.It is found that the 3D modeling technology in DTs has broad prospects for development and has a huge impact on all walks of life and even human lifestyles.At the same time,the development of DTs modeling relies on the development and support capabilities of mature technologies such as Big Data,Internet of Things,Cloud Computing,Articial Intelligence,and game technology.Therefore,although some results have been achieved,there are still limitations.This work aims to provide a good theoretical support for the further development of 3D DTs modeling.

Architecting the Metaverse: Blockchain and the Financial and Legal Regulatory Challenges of Virtual Real Estate

There has been disagreement over the value of purchasing space in the metaverse, but many businesses including Nike, The Wendy’s Company, and McDonald’s have jumped in headfirst. While the metaverse land rush has been called an “illusion” given underdeveloped infrastructure, including inadequate software and servers, and the potential opportunities for economic and legal abuse, the “real estate of the future” shows no signs of slowing. While the current virtual space of the metaverse is worth $6.30 billion, that is expected to grow to $84.09 billion by the end of 2028. But the long-term legal and regulatory considerations of capitalizing on the investment, as well as the manner in which blockchain technology can secure users’ data and digital assets, has yet to be properly investigated. With the metaverse still in a conceptual phase, building a new 3D social environment capable of digital transactions will represent most of the initial investment in time in human capital. Digital twin technologies, already well-established in industry, will be ported to support the need to architect and furnish the new digital world. The return on and viability of investing in the “real estate of the future” raises questions fundamental to the success or failure of the enterprise. As such this paper proposes a novel framing of the issue and looks at the intersection where finance, technology, and law are converging to prevent another Dot-com bubble of the late 1990s in metaverse-based virtual real estate transactions. Furthermore, the paper will argue that these domains are technologically feasible, but the main challenges for commercial users remain in the legal and regulatory arenas. As has been the case with the emergence of online commerce, a legal assessment of the metaverse indicates that courts will look to traditional and established legal principles when addressing issues until the enactment of federal and/or state statutes and accompanying regulations. Lastly, whereas traditional regulation of real estate would involve property law, the current legal framing of ownership of metaverse assets is governed by contract law.

Protecting the trust and credibility of data by tracking forgery trace based on GANs

With the advent of the 5G Internet of Things era,communication and social interaction in our daily life have changed a lot,and a large amount of social data is transmitted to the Internet.At the same time,with the rapid development of deep forgery technology,a new generation of social data trust crisis has also followed.Therefore,how to ensure the trust and credibility of social data in the 5G Internet of Things era is an urgent problem to be solved.This paper proposes a new method for forgery detection based on GANs.We first discover the hidden gradient information in the grayscale image of the forged image and use this gradient information to guide the generation of forged traces.In the classifier,we replace the traditional binary loss with the focal loss that can focus on difficult-to-classify samples,which can achieve accurate classification when the real and fake samples are unbalanced.Experimental results show that the proposed method can achieve high accuracy on the DeeperForensics dataset and with the highest accuracy is 98%.

Evolutionary Neural Architecture Search and Its Applications in Healthcare

Most of the neural network architectures are based on human experience,which requires a long and tedious trial-and-error process.Neural architecture search(NAS)attempts to detect effective architectures without human intervention.Evolutionary algorithms(EAs)for NAS can find better solutions than human-designed architectures by exploring a large search space for possible architectures.Using multiobjective EAs for NAS,optimal neural architectures that meet various performance criteria can be explored and discovered efficiently.Furthermore,hardware-accelerated NAS methods can improve the efficiency of the NAS.While existing reviews have mainly focused on different strategies to complete NAS,a few studies have explored the use of EAs for NAS.In this paper,we summarize and explore the use of EAs for NAS,as well as large-scale multiobjective optimization strategies and hardware-accelerated NAS methods.NAS performs well in healthcare applications,such as medical image analysis,classification of disease diagnosis,and health monitoring.EAs for NAS can automate the search process and optimize multiple objectives simultaneously in a given healthcare task.Deep neural network has been successfully used in healthcare,but it lacks interpretability.Medical data is highly sensitive,and privacy leaks are frequently reported in the healthcare industry.To solve these problems,in healthcare,we propose an interpretable neuroevolution framework based on federated learning to address search efficiency and privacy protection.Moreover,we also point out future research directions for evolutionary NAS.Overall,for researchers who want to use EAs to optimize NNs in healthcare,we analyze the advantages and disadvantages of doing so to provide detailed guidance,and propose an interpretable privacy-preserving framework for healthcare applications.

Survey and Prospect for Applying Knowledge Graph in Enterprise Risk Management

Enterprise risk management holds significant importance in fostering sustainable growth of businesses and in serving as a critical element for regulatory bodies to uphold market order.Amidst the challenges posed by intricate and unpredictable risk factors,knowledge graph technology is effectively driving risk management,leveraging its ability to associate and infer knowledge from diverse sources.This review aims to comprehensively summarize the construction techniques of enterprise risk knowledge graphs and their prominent applications across various business scenarios.Firstly,employing bibliometric methods,the aim is to uncover the developmental trends and current research hotspots within the domain of enterprise risk knowledge graphs.In the succeeding section,systematically delineate the technical methods for knowledge extraction and fusion in the standardized construction process of enterprise risk knowledge graphs.Objectively comparing and summarizing the strengths and weaknesses of each method,we provide recommendations for addressing the existing challenges in the construction process.Subsequently,categorizing the applied research of enterprise risk knowledge graphs based on research hotspots and risk category standards,and furnishing a detailed exposition on the applicability of technical routes and methods.Finally,the future research directions that still need to be explored in enterprise risk knowledge graphs were discussed,and relevant improvement suggestions were proposed.Practitioners and researchers can gain insights into the construction of technical theories and practical guidance of enterprise risk knowledge graphs based on this foundation.

Short‐time wind speed prediction based on Legendre multi‐wavelet neural network

As one of the most widespread renewable energy sources,wind energy is now an important part of the power system.Accurate and appropriate wind speed forecasting has an essential impact on wind energy utilisation.However,due to the stochastic and un-certain nature of wind energy,more accurate forecasting is necessary for its more stable and safer utilisation.This paper proposes a Legendre multiwavelet‐based neural network model for non‐linear wind speed prediction.It combines the excellent properties of Legendre multi‐wavelets with the self‐learning capability of neural networks,which has rigorous mathematical theory support.It learns input‐output data pairs and shares weights within divided subintervals,which can greatly reduce computing costs.We explore the effectiveness of Legendre multi‐wavelets as an activation function.Mean-while,it is successfully being applied to wind speed prediction.In addition,the appli-cation of Legendre multi‐wavelet neural networks in a hybrid model in decomposition‐reconstruction mode to wind speed prediction problems is also discussed.Numerical results on real data sets show that the proposed model is able to achieve optimal per-formance and high prediction accuracy.In particular,the model shows a more stable performance in multi‐step prediction,illustrating its superiority.

Building the metaverse using digital twins at all scales,states,and relations

Developments in new-generation information technology have enabled Digital Twins to reshape the physical world into a virtual digital space and provide technical support for constructing the Metaverse.Metaverse objects can be at the micro-,meso-,or macroscale.The Metaverse is a complex collection of solid,liquid,gaseous,plasma,and other uncertain states.Additionally,the Metaverse integrates tangibles with social relations,such as interpersonal(friends,partners,and family)and social relations(ethics,morality,and law).This review introduces some principles and laws,such as broken windows theory,small-world phenomenon,survivor bias,and herd behavior,for constructing a Digital Twins model for social relations.Therefore,from multiple perspectives,this article reviews mappings of tangible and intangible real-world objects to the Metaverse using the Digital Twins model.

Virtual Reality Neurorehabilitation

The present work investigates the application of virtual reality(VR)technology to neurorehabilitation.By consulting a wealth of data,the advantages of VR in neurorehabilitation are introduced,followed by the application status of VR in the rehabilitation of stroke patients,Parkinson’s patients,mental and psychological diseases.Besides,many research experiments on the application of VR technology in rehabilitation medicine at the present stage are investigated.The results indicate that compared with traditional balance training,the VR-based neurological rehabilitation training method can more effectively ease the tilt degree and strengthen the trunk control ability and balance function of patients with post-stroke tilt syndrome.When the effect of traditional rehabilitation training on the gait and balance of Parkinson’s patients is not good enough,VR-based rehabilitation training can at least be used as an alternative therapy.Moreover,VR games have made great breakthroughs in promoting limb rehabilitation and brain injury rehabilitation,which is of incredible benefit to those with motor and activity disorders.It is also beneficial to the treatment and recovery of mental disorders of patients with nerve injury.Although VR still has limitations such as high cost and technical breakthrough bottleneck,it has great advantages in relieving pain,enhancing interest,and recovering patients’mental health in neurological rehabilitation training.

A spatiotemporal intelligent framework and experimental platform for urban digital twins

Backgrounds This work emphasizes the current research status of the urban Digital Twins to establish an intelligent spatiotemporal framework.A Geospatial Artificial Intelligent(GeoAI)system is developed based on the Geographic Information System and Artificial Intelligence.It integrates multi-video technology and Virtual City in urban Digital Twins.Methods Besides,an improved small object detection model is proposed:YOLOv5-Pyramid,and Siamese network video tracking models,namely MPSiam and FSSiamese,are established.Finally,an experimental platform is built to verify the georeferencing correction scheme of video images.Result The MultiplyAccumulate value of MPSiam is 0.5B,and that of ResNet50-Siam is 4.5B.Besides,the model is compressed by 4.8times.The inference speed has increased by 3.3 times,reaching 83 Frames Per Second.3%of the Average Expectation Overlap is lost.Therefore,the urban Digital Twins-oriented GeoAI framework established here has excellent performance for video georeferencing and target detection problems.

Intelligent fire information system based on 3D GIS

Background This work aims to build a comprehensive and effective fire emergency management system based on the Internet of Things(IoT)and achieve an actual intelligent fire rescue.A smart fire protection information system was designed based on the IoT.A detailed analysis was conducted on the problem of rescue vehicle scheduling and the evacuation of trapped persons in the process of fire rescue.Methods The intelligent fire visualization platform based on the three-dimensional(3D)Geographic Information Science(GIS)covers project overview,equipment status,equipment classification,equipment alarm information,alarm classification,alarm statistics,equipment account information,and other modules.The live video accessed through the visual interface can clearly identify the stage of the fire,which facilitates the arrangement of rescue equipment and personnel.The vehicle scheduling model in the system primarily used two objective functions to solve the Pareto Non-Dominated Solution Set Optimization:emergency rescue time and the number of vehicles.In addition,an evacuation path optimization method based on the Improved Ant Colony(IAC)algorithm was designed to realize the dynamic optimization of building fire evacuation paths.Results The experimental results indicate that all the values of detection signals were significantly larger in the smoldering fire scene at t=17s than the initial value.In addition,the probability of smoldering fire and the probability of open fire were relatively large according to the probability function of the corresponding fire situation,demonstrating that this model could detect fire.Conclusions The IAC algorithm reported here avoided the passages near the fire and spreading areas as much as possible and took the safety of the trapped persons as the premise when planning the evacuation route.Therefore,the IoT-based fire information system has important value for ensuring fire safety and carrying out emergency rescue and is worthy of popularization and application.

Virtual-reality and intelligent hardware in Digital Twins

Several new models and formats for the digital transformation of the manufacturing industry appear because of the rapid integration of information technology and the real economy,as well as the increasingly obvious evolution trend of industrial digitalization,networking,and intelligence.Among them,digital twins have increasingly become a research hotspot in all sectors of the industry and have broad prospects.It maps physical objects in virtual space in a digital way and simulates their behavioral characteristics in real environments.It makes the gap between virtuality and reality disappear based on their closed-loop interaction.Digital twins are undoubtedly an important and strategic technology in response to familiar products,production,and services.It can also speculate some indicators that cannot be directly measured by machine learning through collecting the direct data of limited physical sensor indicators.This can realize an assessment of the current state,a diagnosis of past problems,and a prediction of future trends,and simulate possibilities to provide more comprehensive decision support.

Artificial intelligence in the digital twins:State of the art,challenges,and future research topics[version 1;peer review:1 approved,1 approved with reservations]

Advanced computer technologies such as big data,Artificial Intelligence(AI),cloud computing,digital twins,and edge computing have been applied in various fields as digitalization has progressed.To study the status of the application of digital twins in the combination with AI,this paper classifies the applications and prospects of AI in digital twins by studying the research results of the current published literature.We discuss the application status of digital twins in the four areas of aerospace,intelligent manufacturing in production workshops,unmanned vehicles,and smart city transportation,and we review the current challenges and topics that need to be looked forward to in the future.It was found that the integration of digital twins and AI has significant effects in aerospace flight detection simulation,failure warning,aircraft assembly,and even unmanned flight.In the virtual simulation test of automobile autonomous driving,it can save 80%of the time and cost,and the same road conditions reduce the parameter scale of the actual vehicle dynamics model and greatly improve the test accuracy.In the intelligent manufacturing of production workshops,the establishment of a virtual workplace environment can provide timely fault warning,extend the service life of the equipment,and ensure the overall workshop operational safety.In smart city traffic,the real road environment is simulated,and traffic accidents are restored,so that the traffic situation is clear and efficient,and urban traffic management can be carried out quickly and accurately.Finally,we looked forward to the future of digital twins and AI,hoping to provide a reference for future research in related fields.

Digital Twins in Industry5.0

This work aims to explore the impact of Digital Twins Technology on industrial manufacturing in the context of Industry 5.0.A computer is used to search the Web of Science database to summarize the Digital Twins in Industry 5.0.First,the background and system architecture of Industry 5.0 are introduced.Then,the potential applications and key modeling technologies in Industry 5.0 are discussd.It is found that equipment is the infrastructure of industrial scenarios,and the embedded intelligent upgrade for equipment is a Digital Twins primary condition.At the same time,Digital Twins can provide automated real-time process analysis between connected machines and data sources,speeding up error detection and correction.In addition,Digital Twins can bring obvious efficiency improvements and cost reductions to industrial manufacturing.Digital Twins reflects its potential application value and subsequent potential value in Industry 5.0 through the prospect.It is hoped that this relatively systematic overview can provide technical reference for the intelligent development of industrial manufacturing and the improvement of the efficiency of the entire business process in the Industrial X.O era.