Appearance Based Dynamic Hand Gesture Recognition Using 3D Separable Convolutional Neural Network

Appearance-based dynamic Hand Gesture Recognition(HGR)remains a prominent area of research in Human-Computer Interaction(HCI).Numerous environmental and computational constraints limit its real-time deployment.In addition,the performance of a model decreases as the subject’s distance from the camera increases.This study proposes a 3D separable Convolutional Neural Network(CNN),considering the model’s computa-tional complexity and recognition accuracy.The 20BN-Jester dataset was used to train the model for six gesture classes.After achieving the best offline recognition accuracy of 94.39%,the model was deployed in real-time while considering the subject’s attention,the instant of performing a gesture,and the subject’s distance from the camera.Despite being discussed in numerous research articles,the distance factor remains unresolved in real-time deployment,which leads to degraded recognition results.In the proposed approach,the distance calculation substantially improves the classification performance by reducing the impact of the subject’s distance from the camera.Additionally,the capability of feature extraction,degree of relevance,and statistical significance of the proposed model against other state-of-the-art models were validated using t-distributed Stochastic Neighbor Embedding(t-SNE),Mathew’s Correlation Coefficient(MCC),and the McNemar test,respectively.We observed that the proposed model exhibits state-of-the-art outcomes and a comparatively high significance level.

Digital Simulation Platform for Satellite Launch Mission Verification

To simulate the satellite launch mission under a general platform which could be used in a full-digital mode as well as in a semi-physical way, is an important way to certify the mission design performance as well as technical feasibilities, and it relates to complex system simulation methods such as multi-disciplinary coupling, multi-language modeling as well as interactive simulation and virtual simulation technologies. This paper introduces the design of a digital simulation platform for satellite launch mission verification.The platform has the advantages of high generality and extensibility, being easy to build up. The Functional Mockup Interface(FMI) Standard is adopted to achieve integration of multi-source models. A WebGL based 3D visual simulation tool is also adopted to implement the virtual display system which could display the rocket launch process and rocket-satellite separation with high fidelity 3D virtual scenes. A configuration tool was developed to map the 3D objects in the visual scene with simulation physical variables for complex rocket flight control mechanisms, which greatly improves the platform's generality and extensibility. Finally the real-time performance had been tested and the YL-1 launch mission was adopted to demonstrate the functions of the platform.The platform will be used to construct a digital twin system for satellite launch missions in the future.

基于3DWidgets的三维人机交互平台的设计与实现

随着人机交互技术的不断发展,对三维人机交互的支持在三维图形软件中占有越来越重要的地位,而在医学影像处理与分析领域,它对于更方便、准确地使用可视化的结果辅助医生进行诊断具有重要意义。该文针对医学影像处理与分析领域中三维交互的需求与特点,设计并实现了一个基于3D Widgets的三维人机交互软件平台,包括以3D Widgets为核心的交互框架、各功能模块以及一些实用的Widgets的设计和实现,并给出了一组应用实例。其最终目的是为医学影像处理与分析领域提供一个灵活可靠和可扩展的三维交互平台。

Vision Based Hand Gesture Recognition Using 3D Shape Context

Hand gesture recognition is a popular topic in computer vision and makes human-computer interaction more flexible and convenient.The representation of hand gestures is critical for recognition.In this paper,we propose a new method to measure the similarity between hand gestures and exploit it for hand gesture recognition.The depth maps of hand gestures captured via the Kinect sensors are used in our method,where the 3D hand shapes can be segmented from the cluttered backgrounds.To extract the pattern of salient 3D shape features,we propose a new descriptor-3D Shape Context,for 3D hand gesture representation.The 3D Shape Context information of each 3D point is obtained in multiple scales because both local shape context and global shape distribution are necessary for recognition.The description of all the 3D points constructs the hand gesture representation,and hand gesture recognition is explored via dynamic time warping algorithm.Extensive experiments are conducted on multiple benchmark datasets.The experimental results verify that the proposed method is robust to noise,articulated variations,and rigid transformations.Our method outperforms state-of-the-art methods in the comparisons of accuracy and efficiency.

An operation optimization method of a fully mechanized coal mining face based on semi-physical virtual simulation

A mathematical hydraulic support self-tracking model for three-machine cooperative mining is proposed to address low efficiency and difficulties in strategy evaluation of a fully mechanized coal face.The proposed model uses the coordinates and traction speed of the shearer to calculate the frequency of the circular hydraulic support and realize the coordinated operation of the three-machine mining technology.A unity3d hardware-in-the-loop simulation experimental hearer and hydraulic support platform was used to validate the model of autonomous follow-up.The results indicate that collaborative control of coal mining allowed for an efficiency 3.76%higher than under automatic operation mode and 46.03%higher than under manual control;thus,The mathematical model provided an improved production efficiency of the fully mechanized mining face.The mathematical model also provides a more intelligent and reliable security support,and improves the intelligent level of hydraulic support follow-up control.

A simplified method for the determination of vertically loaded pile-soil interface parameters in layered soil based on FLAC3D

The numerical analysis of pile-soil interaction commonly requires a lot of trial works to determine the interface parameters and the accuracy cannot be ensured normally. Considering this, this paper first conducts a sensitivity analysis to figure out the influence of interface parameters on the bearing behavior of a single pile in sand. Then, a simplified method for the determination of pile-soil interface parameters in layered soil is proposed based on the parameter studies. Finally, a filed loading test is used for the validation of the simplified method, and the calculated results agree well with the monitoring data. In general, the simplified method proposed in this paper works with higher accuracy and consumes less time compared with the traditional trial works, especially on the determinations ofinterfacial cohesive and interracial friction angle.

EZ-Manipulator:Designing a mobile,fast,and ambiguity-free 3D manipulation interface using smartphones

Interacting with digital contents in 3 D is an essential task in various applications such as modeling packages, gaming, virtual reality, etc. Traditional interfaces using keyboard and mouse or trackball usually require a non-trivial amount of working space as well as a learning process. We present the design of EZ-Manipulator, a new 3 D manipulation interface using smartphones that supports mobile, fast, and ambiguity-free interaction with 3 D objects. Our system leverages the built-in multi-touch input and gyroscope sensor of smartphones to achieve 9 degrees-of-freedom axis-constrained manipulation and free-form rotation.Using EZ-Manipulator to manipulate objects in 3 D is easy. The user merely has to perform intuitive singleor two-finger gestures and rotate the hand-held device to perform manipulations at fine-grained and coarse levels respectively. We further investigate the ambiguity in manipulation introduced by indirect manipulations using a multi-touch interface, and propose a dynamic virtual camera adjustment to effectively resolve the ambiguity. A preliminary study shows that our system has significant lower task completion time compared to conventional use of a keyboard–mouse interface, and provides a positive user experience to both novices and experts.

A flexible various-scale approach for soil-structure interaction and its application in seismic damage analysis of the underground structure of nuclear power plants

In simulations of geotechnical engineering, interface elements are versatile tools and are widely used in the modeling of the relative displacements between soils and structures. To consider the case of a local failure adjacent to a soil-structure interaction region, a partial mesh refinement should be performed. In this study, a three-dimensional(3 D) interface element with an arbitrary number of nodes is developed as a new technique to reduce the complexity and difficulty of managing the various scales between soil and structure. An asymmetric number of nodes is permissible on the two sliding surfaces. In this manner, soil and structure can be discretized independently, and the various-scale model is established conveniently and rapidly. The accuracy of the proposed method is demonstrated through numerical examples. The various-scale approach is employed in an elasto-plastic seismic damage analysis of a buried concrete drainage culvert of a nuclear power plant. The results indicate that by applying the proposed method, the number of elements decreased by 72.5%, and the computational efficiency improved by 59% with little influence on accuracy. The proposed method is powerful for local damage evolution analyses of both soil and structure and possesses great practical significance and the potential for further application, especially for nonlinear analysis of large-scale geotechnical engineering.

基于CATIA的心墙堆石坝三维可视化交互系统

目前大坝施工仿真建模中多是基于Geographic Information System(GIS)或3DS MAX软件构建的施工场景,其三维模型存在精度不高,不易修改,相似模型也不能重复利用等问题。本文将CATIA引入心墙堆石坝施工仿真建模中,即利用CATIA的三维建模技术构建了心墙堆石坝的三维施工场景。关键技术包括骨架设计技术、参数化技术、知识工程技术和设计过程模块化技术,并通过三维数字建模来模拟整个建筑物的信息。以某心墙堆石坝为例,建立了基于CATIA的心墙堆石坝施工仿真系统平台,实现了基于Brower/Server(B/S)的堆石坝施工场景的远程交互,可为堆石坝施工管理提供理论与技术支持。

交互式三维对象建模方法研究与实现

论文设计了一种交互式三维对象建模方法,为非专业三维应用开发人员提供了一个友好的三维图形开发应用平台。研究了三维对象模型的概念模型和逻辑模型,分析了三维对象模型拓扑关系的存储方式和查询方式;提出了关系模型,设计出三维对象模型与关系模型间的相互作用方式;采用模型库保存常用的基本模型和关系模型,用户也可按需求自定义对象模型和关系模型,并扩充模型库,使得模型具有较好的可重用性;结合OSG三维图形引擎,验证了提出的交互式三维对象建模方法的可行性。