In view of the low efficiency of production and assembly in traditional industries,we use AR technology to replace traditional assembly instructions and design an industry-oriented cloud-edge intelligent assembly guid...In view of the low efficiency of production and assembly in traditional industries,we use AR technology to replace traditional assembly instructions and design an industry-oriented cloud-edge intelligent assembly guidance system.Since the computing power ofARglasses cannot meet the high complexity requirements of scene understanding,we adopt the joint solution of Cloud-Edge.First,the sensor data collected by the AR glasses are streamed to the edge server using high-speed and low-latency wireless interconnection technology.Then,the product artifacts in the data scene are identified and understood through the instance segmentation network BlendMask based on deep learning.Then,the 3D pose of the object is calculated in real time by combining pose estimation and 3D reconstruction.Furthermore,an accurate 3D guidance animation is generated,and the virtual 3D model in the AR glasses is accurately superimposed on the real object to determine whether the assembly is correct in real time.Experiments show that the system effectively combines artificial intelligence and intelligent manufacturing,integrates various elements in the scene in real time to provide operators with multimodal and multidimensional immersive guidance,and corrects in time when assembly errors occur.It can not only quickly guide the operator to complete the learning of the assembly process but also assist the staff in the assembly in real time.Ultimately,it improves assembly speed and accuracy,which in turn improves enterprise productivity.展开更多
文摘In view of the low efficiency of production and assembly in traditional industries,we use AR technology to replace traditional assembly instructions and design an industry-oriented cloud-edge intelligent assembly guidance system.Since the computing power ofARglasses cannot meet the high complexity requirements of scene understanding,we adopt the joint solution of Cloud-Edge.First,the sensor data collected by the AR glasses are streamed to the edge server using high-speed and low-latency wireless interconnection technology.Then,the product artifacts in the data scene are identified and understood through the instance segmentation network BlendMask based on deep learning.Then,the 3D pose of the object is calculated in real time by combining pose estimation and 3D reconstruction.Furthermore,an accurate 3D guidance animation is generated,and the virtual 3D model in the AR glasses is accurately superimposed on the real object to determine whether the assembly is correct in real time.Experiments show that the system effectively combines artificial intelligence and intelligent manufacturing,integrates various elements in the scene in real time to provide operators with multimodal and multidimensional immersive guidance,and corrects in time when assembly errors occur.It can not only quickly guide the operator to complete the learning of the assembly process but also assist the staff in the assembly in real time.Ultimately,it improves assembly speed and accuracy,which in turn improves enterprise productivity.
