Virtual Assembly Collision Detection Algorithm Using Backpropagation Neural Network

As computer graphics technology continues to advance,Collision Detection(CD)has emerged as a critical element in fields such as virtual reality,computer graphics,and interactive simulations.CD is indispensable for ensuring the fidelity of physical interactions and the realism of virtual environments,particularly within complex scenarios like virtual assembly,where both high precision and real-time responsiveness are imperative.Despite ongoing developments,current CD techniques often fall short in meeting these stringent requirements,resulting in inefficiencies and inaccuracies that impede the overall performance of virtual assembly systems.To address these limitations,this study introduces a novel algorithm that leverages the capabilities of a Backpropagation Neural Network(BPNN)to optimize the structural composition of the Hybrid Bounding Volume Tree(HBVT).Through this optimization,the research proposes a refined Hybrid Hierarchical Bounding Box(HHBB)framework,which is specifically designed to enhance the computational efficiency and precision of CD processes.The HHBB framework strategically reduces the complexity of collision detection computations,thereby enabling more rapid and accurate responses to collision events.Extensive experimental validation within virtual assembly environments reveals that the proposed algorithm markedly improves the performance of CD,particularly in handling complex models.The optimized HBVT architecture not only accelerates the speed of collision detection but also significantly diminishes error rates,presenting a robust and scalable solution for real-time applications in intricate virtual systems.These findings suggest that the proposed approach offers a substantial advancement in CD technology,with broad implications for its application in virtual reality,computer graphics,and related fields.

Creation and Evaluation of a Multi-sensory Virtual Assembly Environment

The multi-modal information presentation, integrated into the virtual environment （VE）, has potential for stimulating different senses, improving the user＇s impression of immersion, and increasing the amount of information that is accepted and processed by the user＇s perception system. The increase of the useful feedback information may reduce the user＇s cognitive load, thus enhancing the user＇s efficiency and performance while interacting with VEs. This paper presents our creation of a multi-sensory virtual assembly environment （VAE） and the evaluation of the effects of multi-sensory feedback on the usability. The VAE brings together complex technologies such as constraint-based assembly simulation, optical motion tracking technology, and real-time 3D sound generation technology around a virtual reality workbench and a common software platform. The usability evaluation is in terms of its three attributes： efficiency of use, user satisfaction, and reliability. These are addressed by using task completion times （TCTs）, questionnaires, and human performance error rates （HPERs）, respectively. Two assembly tasks have been used to perform the experiments, using sixteen participants. The outcomes showed that the multi-sensory feedback could improve the usability. They also indicated that the integrated feedback offered better usability than either feedback used in isolation. Most participants preferred the integrated feedback to either feedback （visual or auditory） or no feedback. The participants＇ comments demonstrated that nonrealistic or inappropriate feedback had negative effects on the usability, and easily made them feel frustrated. The possible reasons behind the outcomes are also analysed by using a unifying human computer interaction framework. The implications, concluded from the outcomes of this work, can serve as useful guidelines for improving VE system design and implementation.

Integrated Virtual Assembly Process Planning System

Assembly process planning（APP） for complicated products is a time-consuming and difficult work with conventional method. Virtual assembly process planning（VAPP） provides engineers a new and efficiency way. Previous studies in VAPP are almost isolated and dispersive, and have not established a whole understanding and discussed key realization techniques of VAPP from a systemic and integrated view. The integrated virtual assembly process planning（IVAPP） system is a new virtual reality based engineering application, which offers engineers an efficient, intuitive, immersive and integrated method for assembly process planning in a virtual environment. Based on analysis the information integration requirement of VAPP, the architecture of IVAPP is proposed. Through the integrated structure, IVAPP system can realize information integration and workflow controlling. In order to mode/the assembly process in IVAPP, a hierarchical assembly task list（HATL） is presented, in which different assembly tasks for assembling different components are organized into a hierarchical list. A process-oriented automatic geometrical constraint recognition algorithm（AGCR） is proposed, so that geometrical constraints between components can be automatically recognized during the process of interactive assembling. At the same time, a progressive hierarchical reasoning（PHR） model is discussed. AGCR and PHR will greatly reduce the interactive workload. A discrete control node model（DCNM） for cable harness assembly planning in IVAPP is detailed. DCNM converts a cable harness into continuous flexed line segments connected by a series of section center points, and designs can realize cable harness planning through controlling those control nodes. Mechanical assemblies （such as transmission case and engine of automobile） are used to illustrate the feasibility of the proposed method and algorithms. The application of IVAPP system reveals advantages over the traditional assembly process planning method in shortening the time-consumed in assembly planning and in minimizing the handling difficulty, excessive reorientation and dissimilarity of assembly operations.

Kinematics Analysis of Mechanisms Based on Virtual Assembly

Currently, virtual assembly technology has attracted increasing attention due to considerations of solving assembly problems in virtual environment before actual assembly in manufactory. Previous studies on kinematic analysis of mechanism only aim at analyzing motion law of single mechanism, but can not simulate the multi-mechanisms motion process at the same time, let alone simulating the automatic assembly process of products in a whole assembly workshop. In order to simulate the assembly process of products in an assembly workshop and provide effective data for analyzing mechanical performance after finishing assembly simulation in virtual environment, this study investigates the kinematics analysis of mechanisms based on virtual assembly. Firstly, in view of the same function of the kinematic pairs and the assembly constraints on restricting the motion of components （subassembly or part）, the method of identifying kinematic pairs automatically based on assembly constraints is presented. The information of kinematic pairs can be obtained through calculating the constraint degree of the assembly constraints. Secondly, the incidence matrix eliminating element method is proposed in order to search the information and establish the models of mechanisms automatically after finishing assembly simulation in virtual environment. Both methods have important significance for reducing the workload of pretreatment and promoting the level of automation of kinematics analysis. Finally, the method of kinematics analysis of mechanisms is presented. Based on Descartes coordinates, three types of kinematics equations are formed. The parameters, like displacement, velocity, and acceleration, can be obtained by solving these equations. All these data are important to analyze mechanical performance. All the methods are implemented and validated in the prototype system virtual assembly process planning（VAPP）. The mechanism models are established and simulated in the VAPP system, and the result curves are shown accurately. The proposed kinematics analysis of mechanisms based on virtual assembly provides an effective method for simulating product assembly process automatically and analyzing mechanical performance after finishing assembly simulation.

RESEARCH OF GUIDANCE TECHNOLOGY FOR ASSEMBLY MODELING IN VIRTUAL ENVIRONMENT

Technology of movement and knowledge guidance in virtual assembly is presented The designer can move the mechanical part precisely under the movement guidance The movement guidance is implemented based on constraint recognition and assembly degree of freedom analysis A multi hierarchy knowledge base is built to represent the assembly knowledge and information The virtual assembly system judges the requirement of the designer based on the context of design task and searches for the useful knowledge and information, which can be provided to the designer in a natural way

Contact State Estimation Based on Surface-matching in Virtual Assembly

Contact problems are one of the most challenging fields in virtual assembly. Information of contact states could be utilized to realize compliant motion of work pieces, to analyze the contact stress, to assist positioning parts and so on. Some methods have already been proposed to estimate contact states between objects and in most of these methods contact states between objects are simplified in order to realize real-time visual reality animation. While in virtual assembly contact states between parts are required to analyze contact stress, deformation and quality. Besides the contact state estimation method for virtual assembly should be able to handle a number of complex parts in real time. There are rarely known methods which could meet this requirement till now. In this study a contact state estimation algorithm based on surface-matching for virtual assembly is proposed. Contacts between parts are categorized into six basic types according to contact region of surfaces. Based on continuous collision detection of polyhedral models a novel contact state identification algorithm which is based on surface matching is proposed. Then contact evolution algorithm, which utilizes the extern force and contact information, is implemented to handle evolution of contact state. Finally a prototype system is developed to verify the above technologies. Experiment results reveal that contact state between parts could be estimated correctly in real time virtual assembly. The proposed contact state estimation algorithm provides a complete solution to obtain the contact state between parts in virtual assembly. Information of contact state between parts could be utilized to realize contact dynamic, contact stress analysis, assembly quality analysis, and so on.

Universal Mechanism Modeling Method in Virtual Assembly Environment

Motion simulation and performance analysis of mechanism are important methods for analyzing assembly quality after finishing assembly simulation in virtual assembly environment. However, most simulation systems have no function of mechanism motion simulation due to the randomicity of mechanism and lack of universal mechanism modeling method. In order to realize the simulation of any mechanism after finishing assembly simulation in a virtual environment, a new universal mechanism modeling method is presented. Two main models are contained in the mechanism model： information model and mathematical model. Firstly, the information model of mechanism is proposed to describe the data structure of mechanism which contains bottom geometry data, information of constraint, link, kinematic pair and physical data. Because the object of mechanism simulation is the assembly, which is assembled during the process of assembly simulation, the information of mechanism can be obtained automatically through mechanism automatic search method. Secondly, mathematical model of mechanism is presented. The mathematical model uses mathematical method to express the mechanism. In order to realize the automatic expression of any random mechanism, basic constraint library is presented, consequently random mechanism can be described based on the basic constraint library. Finally, two examples are introduced to validate the method in the prototype system named VAPP（Virtual Assembly Process Planning）. The validation result shows that the mechanism modeling provides a universal modeling method for mechanism motion simulation in virtual assembly environment. This research has important effect on the development both of mechanism motion simulation and virtual assembly.

Realization Techniques of Virtual Assembly Process Planning System

The key realization techniques of virtual assembly process planning （VAPP） system are analyzed, including virtual assembly model, real-time collision detection, automatic constraint recognition algorithm, cable harness assembly process planning and visual assembly process plan at the workshop. A virtual assembly model based on hierarchical assembly task list （HATL） is put forward, in which assembly tasks are defined to express component assembling operations and are sequentially and hierarchically organized according to different subassemblies, which can perfectly model the construction process of product, And a multi-layer automatic geometry constraint recognition algorithm of how to identify assmbly constraint relations in the virtual environment is proposed, then a four-layer collision detection algorithm is discussed. A VAPP system is built and some simple mechanical assemblies are used to illustrate the feasibility of the proposed method and algorithms.

Modular Fixture Assembly Model for Virtual Assembly Design

To support modular fixture assembly design in virtual environment,a multi-view based modular fixture virtual assembly model is proposed.Instead of squeezing all assembly related information into a single model,three complementary views of assembly model,element information,function and structure,and assembly relationship are proposed to be used.The first view contains the detailed element information,while the other two explicitly capture the hierarchical function relationships and mating relationships respectively.These views are complementary in the sense that each view only contains a specific aspect of assembly related information while together they include required assembly related information.The proposed assembly model is specialized to accommodate the features of modular fixture virtual assembly design and applied in our developed prototype system.

Research on an Integrated Modeling Method of Virtual Ship Assembly

A new method of virtual ship assembly modeling which integrates ship three-dimensional design and ship construction planning was described in this paper. A workflow model of simulation modeling based on the virtual ship assembly process was also established; furthermore, a method of information transformation between the ship three-dimensional design and ship construction plan was formulated. To meet the requirements of information sharing between different systems in the ship virtual assembly, a simulation database was created by using the software engineering design method and the relational data model. With the application of this database, the information of ship three-dimensional design, construction planning, and virtual assembly can be integrated into one system. Subsequently, this new method was applied as a tool to simulate the virtual assembly of a ship, and the results guarantee its rationality and reliability.

A Virtual Assembly System for Aero-engines Based on VR

In this paper,a synthesized technique is explored through design of a virtual experiment system for main aero-engine based on VR,which attempts to integrate some VR techniques,such as 3D stereo simulation and modeling,3D scene management and human-computer virtual assembly based on data glove and collision detection.The geometry modeling and instantiation technique,virtual hand modeling and data glove interaction technique are discussed chiefly.Finally,taking aim at assembling and dismantling experiment system of a certain aero-engine,interface technology is expounded also.

Cable Harness Assembly Planning in Virtual Environment

Based on the analysis of characteristic of cable harness planning in virtual environment,a discrete control node modeling (DCNM) method of cable harness in virtual environment and the cable harness assembly routing technique based on it are proposed. DCNM converts a cable harness into continuous flexed line segments connected by a series of section center points,and the design can realize cable harness planning through controlling those control nodes. This method of cable harness routing in the virtual environment breaks the status that virtual assembly process planning is just suitable for the rigid components at present,and impulse the virtual assembly process planning to be more practical. Relation algorithms have been verified in a self-developed system named virtual cable harness assembly planning (VCHAP) system,and this VCHAP system has been applied in assembly process planning of aerospace-related products.

Study on Solder Joint Reliability of Plastic Ball Grid Array Component Based on SMT Products Virtual Assembly Technology

Based on surface mount products virtual assembly technology,the solder joint reliability of plastic ball grid array (PBGA) was studied. Four process parameters,including the upper pad diameter,the stencil thickness,the chip weight on a single solder joint and the lower pad diameter were chose as four control factors. By using an L25(56) orthogonal array the PBGA solder joints which have 25 different process parameters’ levels combinations were designed. The numerical models of all the 25 PBGA solder joints were developed and the finite element analysis models were setup. The stress and strain distribution within the PBGA solder joints under thermal cycles were studied by finite element analysis,and the thermal fatigue life of PBGA solder joint was calculated using Coffin-Manson equation. Based on the calculated thermal fatigue life results,the range analysis was performed. The results of study show that that the impact sequence of the four factors from high to low on the fatigue life of PBGA solder joints are the stencil thickness,the upper pad diameter,the lower pad diameter and the chip weight on a single solder joint; the best level combination ofprocess parameters that results in the longest fatigue life is the lower pad diameter of 0.6 mm,the stencil thickness of 0.175 mm,the chip weight on asingle solder joint of 28×10 -5 N and the upper pad diameter of 0.5 mm.

Virtual Reality Toolkit for the Assembly of Nanotube-based Nano-electro-mechanical Systems

Nano assembly and manipulation technologies are the basis for nano-electro-mechanical systems（NEMS）. Atomic force microscope（AFM） is widely used to manipulate nanotubes to assemble NEMS. Manipulating nanotubes with AFM is a challenging and difficult task. One of the major reasons is the deficiency of visual information during the manipulation process. To address these difficulties, this research aims to put forward novel virtual tools and assembly strategies to improve the efficiency, accuracy and ease of the assembly process of NEMS. This paper begins by the discussion of the principles and implementation of a virtual nano-assembly simulator, which serves as a benchmark to test the proposed NEMS assembly techniques and virtual tools. Then, a general framework of nanotube-based NEMS assembly is proposed. Several nano-assembly strategies and virtual tools, such as automated path planning for NEMS assembly, a four-step scheme of nanotube manipulation, virtual fixtures for assembly finalization and safe manipulation, are introduced. These virtual tools and methods are experimented for justification. An assembly task of moderate complexity was performed in our virtual nano-assembly simulator with and without the help of the proposed toolkit. Experimental results suggest that the proposed methods tend to greatly enhance the efficiency and accuracy of nanotube-based NEMS assembly. In general, the proposed virtual reality toolkit not only ensures the safety, but also enhances the accuracy and efficiency of the assembly of nanotube-based NEMS.

Object-Oriented Modeling of Virtual Assembly Process

Virtual assembly is a Virtual Reality (VR) based engineering application which allows engineers to evaluate, analyze, and plan the assembly of mechanical systems. To model the virtual assembly process, new methodology must be applied. Based on the idea that the virtual assembly system is an event driven system, the interactive behavior and information model is proposed to describe the dynamic process of virtual assembly. Definition of the object-oriented model of virtual assembly is put forward.

Virtual assembly framework for performance analysis of large optics

Background A longstanding technological challenge exists regarding the precise assembly design and performance optimization of large optics in high power laser facilities,comprising a combination of many complex problems involving mechanical,material,and laser beam physics.Method In this study,an augmented virtual assembly framework based on a multiphysics analysis and digital simulation is presented for the assembly optimization of large optics.This framework focuses on the fundamental impact of the structural and assembly parameters of a product on its optical performance;three-dimensional simulation technologies improve the accuracy and measurability of the impact.Intelligent iterative computation algorithms have been developed to optimize the assembly plan of large optics,which are significantly affected by a series of constraints including dynamic loads and nonlinear ambient excitations.Results Finally,using a 410-mm-aperture frequency converter as the study case,we present a detailed illustration and discussion to validate the performance of the proposed system in large optics assembly and installation engineering.

多通道Assembly-like排队系统的强逼近

借助于强逼近理论和修正系统，本文较为详细地研究了多路到达、多服务台Ａｓｓｅｍ ｂｌｙ－ｌｉｋｅ 排队系统，得到了队长过程、离去过程、负荷和虚等待时间过程的强逼近定理．

Assembly—Like排队系统的强逼近

本文利用概率论强逼近理论,较为详细地研究了Assembly-Like排队系统。在各种负荷条件下得到了虚等待时间、队长等排队指标的强逼近定理,并给出了嵌入排队中诸指标的强逼近定理。

Mixed Reality-based Interactive Technology for Aircraft Cabin Assembly

Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of aircraft design, the different stages of the lifecycle of aircraft must be thought about, which include the trial manufacture, assembly, maintenance, recycling and destruction of the product. Recently, thanks to the development of the virtual reality and augmented reality, some low-cost and fast solutions are found for the product assembly. This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly, which can enhance the efficiency of the assemblage in a virtual environment in terms of vision, information and operation. In the mixed reality-based assembly environment, the physical scene can be obtained by a camera and then generated by a computer. The virtual parts, the features of visual assembly, the navigation information, the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene. The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment. Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts, and to avoid the complex calculation of constraint＇s match. Finally, a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.

Force Feedback Coupling with Dynamics for Physical Simulation of Product Assembly and Operation Performance

Most existing force feedback methods are still difficult to meet the requirements of real-time force calculation in virtual assembly and operation with complex objects. In addition, there is often an assumption that the controlled objects are completely flee and the target object is only completely fixed or flee, thus, the dynamics of the kinematic chain where the controlled objects are located are neglected during the physical simulation of the product manipulation with force feedback interaction. This paper proposes a physical simulation method of product assembly and operation manipulation based on statistically learned contact force prediction model and the coupling of force feedback and dynamics. In the proposed method, based on hidden Markov model （HMM） and local weighting learning （LWL）, contact force prediction model is constructed, which can estimate the contact force in real time during interaction. Based on computational load balance model, the computing resources are dynamically assigned and the dynamics integral step is optimized. In addition, smoothing process is performed to the force feedback on the synchronization points. Consequently, we can solve the coupling and synchronization problems of high-frequency feedback force servo. low-frequency dynamics solver servo and scene rendering servo, and realize highly stable and accurate force feedback in the physical simulation of product assembly and operation manipulation. This research proposes a physical simulation method of product assembly and operation manipulation.