In view of the low efficiency of production and assembly in traditional industries,we use AR technology to replace traditional assembly instructions and design an industry-oriented cloud-edge intelligent assembly guid...In view of the low efficiency of production and assembly in traditional industries,we use AR technology to replace traditional assembly instructions and design an industry-oriented cloud-edge intelligent assembly guidance system.Since the computing power ofARglasses cannot meet the high complexity requirements of scene understanding,we adopt the joint solution of Cloud-Edge.First,the sensor data collected by the AR glasses are streamed to the edge server using high-speed and low-latency wireless interconnection technology.Then,the product artifacts in the data scene are identified and understood through the instance segmentation network BlendMask based on deep learning.Then,the 3D pose of the object is calculated in real time by combining pose estimation and 3D reconstruction.Furthermore,an accurate 3D guidance animation is generated,and the virtual 3D model in the AR glasses is accurately superimposed on the real object to determine whether the assembly is correct in real time.Experiments show that the system effectively combines artificial intelligence and intelligent manufacturing,integrates various elements in the scene in real time to provide operators with multimodal and multidimensional immersive guidance,and corrects in time when assembly errors occur.It can not only quickly guide the operator to complete the learning of the assembly process but also assist the staff in the assembly in real time.Ultimately,it improves assembly speed and accuracy,which in turn improves enterprise productivity.展开更多
The traditional industrial assembly method is inefficient,and it is difficult to meet the needs of rapid production in modern society.Although many virtual assembly systems based on augmented reality technology have a...The traditional industrial assembly method is inefficient,and it is difficult to meet the needs of rapid production in modern society.Although many virtual assembly systems based on augmented reality technology have appeared in recent years,most of these assembly systems are noninteractive,nonintelligent,and inefficient.In response to this problem,we combined AR technology and AI technology to design and implement a strong interactive,high-intelligence virtual assembly guidance system in four levels.Finally,we took a UAV assembly as an example to show our design results.Operators can use this system to quickly master the assembly process.Finally,according to some problems encountered in the process of system implementation,the improvement direction of the virtual assembly system is proposed,and the future development of the AR auxiliary industry is proposed.This article describes the functions and implementation process of the four levels of the AR assembly system in detail,which can help readers quickly understand the connection between AR technology and AI technology and understand the principle of the virtual assembly guidance system.展开更多
文摘In view of the low efficiency of production and assembly in traditional industries,we use AR technology to replace traditional assembly instructions and design an industry-oriented cloud-edge intelligent assembly guidance system.Since the computing power ofARglasses cannot meet the high complexity requirements of scene understanding,we adopt the joint solution of Cloud-Edge.First,the sensor data collected by the AR glasses are streamed to the edge server using high-speed and low-latency wireless interconnection technology.Then,the product artifacts in the data scene are identified and understood through the instance segmentation network BlendMask based on deep learning.Then,the 3D pose of the object is calculated in real time by combining pose estimation and 3D reconstruction.Furthermore,an accurate 3D guidance animation is generated,and the virtual 3D model in the AR glasses is accurately superimposed on the real object to determine whether the assembly is correct in real time.Experiments show that the system effectively combines artificial intelligence and intelligent manufacturing,integrates various elements in the scene in real time to provide operators with multimodal and multidimensional immersive guidance,and corrects in time when assembly errors occur.It can not only quickly guide the operator to complete the learning of the assembly process but also assist the staff in the assembly in real time.Ultimately,it improves assembly speed and accuracy,which in turn improves enterprise productivity.
文摘The traditional industrial assembly method is inefficient,and it is difficult to meet the needs of rapid production in modern society.Although many virtual assembly systems based on augmented reality technology have appeared in recent years,most of these assembly systems are noninteractive,nonintelligent,and inefficient.In response to this problem,we combined AR technology and AI technology to design and implement a strong interactive,high-intelligence virtual assembly guidance system in four levels.Finally,we took a UAV assembly as an example to show our design results.Operators can use this system to quickly master the assembly process.Finally,according to some problems encountered in the process of system implementation,the improvement direction of the virtual assembly system is proposed,and the future development of the AR auxiliary industry is proposed.This article describes the functions and implementation process of the four levels of the AR assembly system in detail,which can help readers quickly understand the connection between AR technology and AI technology and understand the principle of the virtual assembly guidance system.
