基于Leap Motion手势交互技术的博物馆数字展示应用研究

随着科技的不断发展,博物馆数字展示已成为呈现文物与历史不可或缺的重要手段之一。在数字化潮流的推动下,Leap Motion技术凭借其卓越的手势交互能力引起了广泛的关注与兴趣。本研究旨在探索如何充分利用Leap Motion手势交互技术,设计并实现一种全新的博物馆数字展示交互系统,以提升观众的参与度和沉浸式体验。本研究采用实验研究方法,开发并实施了一套基于LeapMotion技术的手势交互系统。通过实验设计、设备选择与安装、手势识别与映射、展示内容的创建与集成、以及用户测试与优化等步骤完成研究。其结果表明,该系统能够准确捕捉观众的手部动作,并将其映射到超大屏幕的交互中,显著提升了展示效果和观众的互动体验。手势识别的误差率控制在5%以内,交互响应速度优秀,达到了预期目标。本研究验证了LeapMotion手势交互技术在博物馆数字展示中的有效性和可行性,提供了一种创新的展示方式,为公众呈现出更为丰富、引人入胜的文化体验,为未来博物馆展示的数字化发展方向提供有益的参考与借鉴,以促进整个行业的创新发展。

基于Leap Motion手势识别的三维交互系统

随着虚拟交互技术的发展,人们迈入了“体验式经济时代”,消费者越来越关注个性体验,因此,基于Leap Motion手势识别设备,设计了一种三维虚拟室内交互系统。该系统以Unity3D作为开发工具,Leap Motion作为硬件平台,结合C#语言进行脚本的编译,利用3ds Max平台对室内进行场景搭建,通过Unity3D工具将组件整合,设计了七种手势,使用Leap Motion硬件设备对场景中物体进行各种不同的操作。经试验表明,该系统实现了用户与场景中物体的交互能力,可以应用在室内装修和设计等方面,增强人们的体验感与趣味性。

ACCURATE DETECTION OF HIGH-SPEED MULTI-TARGET VIDEO SEQUENCES MOTION REGIONS BASED ON RECONSTRUCTED BACKGROUND DIFFERENCE

The paper first discusses shortcomings of classical adjacent-frame difference. Sec ondly, based on the image energy and high order statistic(HOS) theory, background reconstruction constraints are setup. Under the help of block-processing technology, background is reconstructed quickly. Finally, background difference is used to detect motion regions instead of adjacent frame difference. The DSP based platform tests indicate the background can be recovered losslessly in about one second, and moving regions are not influenced by moving target speeds. The algorithm has important usage both in theory and applications.

Pulses in ground motions identified through surface partial matching and their impact on seismic rocking consequence

In seismology and earthquake engineering,it is fundamental to identify and characterize the pulse-like features in pulse-type ground motions.To capture the pulses that dominate structural responses,this study establishes congruence and shift relationships between response spectrum surfaces.A similarity search between spectrum surfaces,supplemented with a similarity search in time series,has been applied to characterize the pulse-like features in pulse-type ground motions.The identified pulses are tested in predicting the rocking consequences of slender rectangular blocks under the original ground motions.Generally,the prediction is promising for the majority of the ground motions where the dominant pulse is correctly identified.

Motion Planning for Autonomous Driving with Real Traffic Data Validation

Accurate trajectory prediction of surrounding road users is the fundamental input for motion planning,which enables safe autonomous driving on public roads.In this paper,a safe motion planning approach is proposed based on the deep learning-based trajectory prediction method.To begin with,a trajectory prediction model is established based on the graph neural network(GNN)that is trained utilizing the INTERACTION dataset.Then,the validated trajectory prediction model is used to predict the future trajectories of surrounding road users,including pedestrians and vehicles.In addition,a GNN prediction model-enabled motion planner is developed based on the model predictive control technique.Furthermore,two driving scenarios are extracted from the INTERACTION dataset to validate and evaluate the effectiveness of the proposed motion planning approach,i.e.,merging and roundabout scenarios.The results demonstrate that the proposed method can lower the risk and improve driving safety compared with the baseline method.

Dynamic Hand Gesture-Based Person Identification Using Leap Motion and Machine Learning Approaches

Person identification is one of the most vital tasks for network security. People are more concerned about theirsecurity due to traditional passwords becoming weaker or leaking in various attacks. In recent decades, fingerprintsand faces have been widely used for person identification, which has the risk of information leakage as a resultof reproducing fingers or faces by taking a snapshot. Recently, people have focused on creating an identifiablepattern, which will not be reproducible falsely by capturing psychological and behavioral information of a personusing vision and sensor-based techniques. In existing studies, most of the researchers used very complex patternsin this direction, which need special training and attention to remember the patterns and failed to capturethe psychological and behavioral information of a person properly. To overcome these problems, this researchdevised a novel dynamic hand gesture-based person identification system using a Leap Motion sensor. Thisstudy developed two hand gesture-based pattern datasets for performing the experiments, which contained morethan 500 samples, collected from 25 subjects. Various static and dynamic features were extracted from the handgeometry. Randomforest was used to measure feature importance using the Gini Index. Finally, the support vectormachinewas implemented for person identification and evaluate its performance using identification accuracy. Theexperimental results showed that the proposed system produced an identification accuracy of 99.8% for arbitraryhand gesture-based patterns and 99.6% for the same dynamic hand gesture-based patterns. This result indicatedthat the proposed system can be used for person identification in the field of security.

基于Leap motion 的大学物理实验虚拟课堂设计

通过利用手势控制器(Leap Motion)技术,设计并实施一套创新的大学物理虚拟实验课程.通过在Unity3D软件中整合Leap Motion,创建一个大学物理实验测量杨氏模量实验场景,主要是利用C#语言进行开发,通过设计出多个模块,包括主界面设计和基本实验组件来完成物理实验的设计.在Leap Motion官网上下载关于Unity3D的SDK资源包并且导入Unity3D中,用其建立手部模型,实现Leap Motion控制器与Unity3D的手部交互实验系统的设计.人机交互技术的引入不仅可以丰富大学物理实验的教学手段,而且还能提高学生的学科理解和实际操作能力,同时培养其创新思维和科技素养.

Research on Rotating Machinery Fault Diagnosis Based on Improved Multi-target Domain Adversarial Network

Aiming at the problems of low efficiency,poor anti-noise and robustness of transfer learning model in intelligent fault diagnosis of rotating machinery,a new method of intelligent fault diagnosis of rotating machinery based on single source and multi-target domain adversarial network model(WDMACN)and Gram Angle Product field(GAPF)was proposed.Firstly,the original one-dimensional vibration signal is preprocessed using GAPF to generate the image data including all time series.Secondly,the residual network is used to extract data features,and the features of the target domain without labels are pseudo-labeled,and the transferable features among the feature extractors are shared through the depth parameter,and the feature extractors of the multi-target domain are updated anatomically to generate the features that the discriminator cannot distinguish.The modelt through adversarial domain adaptation,thus achieving fault classification.Finally,a large number of validations were carried out on the bearing data set of Case Western Reserve University(CWRU)and the gear data.The results show that the proposed method can greatly improve the diagnostic efficiency of the model,and has good noise resistance and generalization.

Positron Emission Tomography Lung Image Respiratory Motion Correcting with Equivariant Transformer

In addressing the challenge of motion artifacts in Positron Emission Tomography (PET) lung scans, our studyintroduces the Triple Equivariant Motion Transformer (TEMT), an innovative, unsupervised, deep-learningbasedframework for efficient respiratory motion correction in PET imaging. Unlike traditional techniques,which segment PET data into bins throughout a respiratory cycle and often face issues such as inefficiency andoveremphasis on certain artifacts, TEMT employs Convolutional Neural Networks (CNNs) for effective featureextraction and motion decomposition.TEMT’s unique approach involves transforming motion sequences into Liegroup domains to highlight fundamental motion patterns, coupled with employing competitive weighting forprecise target deformation field generation. Our empirical evaluations confirm TEMT’s superior performancein handling diverse PET lung datasets compared to existing image registration networks. Experimental resultsdemonstrate that TEMT achieved Dice indices of 91.40%, 85.41%, 79.78%, and 72.16% on simulated geometricphantom data, lung voxel phantom data, cardiopulmonary voxel phantom data, and clinical data, respectively. Tofacilitate further research and practical application, the TEMT framework, along with its implementation detailsand part of the simulation data, is made publicly accessible at https://github.com/yehaowei/temt.

Safe Motion Planning and Control Framework for Automated Vehicles with Zonotopic TRMPC

Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles(AVs).The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal trajectories that are individually optimized by the AV's planning layer.To address this issue,this study proposes a safe motion planning and control(SMPAC)framework for AVs.For the control layer,a dynamic model including multi-dimensional uncertainties is established.A zonotopic tube-based robust model predictive control scheme is proposed to constrain the uncertain system in a bounded minimum robust positive invariant set.A flexible tube with varying cross-sections is constructed to reduce the controller conservatism.For the planning layer,a concept of safety sets,representing the geometric boundaries of the ego vehicle and obstacles under uncertainties,is proposed.The safety sets provide the basis for the subsequent evaluation and ranking of the generated trajectories.An efficient collision avoidance algorithm decides the desired trajectory through the intersection detection of the safety sets between the ego vehicle and obstacles.A numerical simulation and hardware-in-the-loop experiment validate the effectiveness and real-time performance of the SMPAC.The result of two driving scenarios indicates that the SMPAC can guarantee the safety of automated driving under multi-dimensional uncertainties.

A HEVC Video Steganalysis Method Using the Optimality of Motion Vector Prediction

Among steganalysis techniques,detection against MV(motion vector)domain-based video steganography in the HEVC(High Efficiency Video Coding)standard remains a challenging issue.For the purpose of improving the detection performance,this paper proposes a steganalysis method that can perfectly detectMV-based steganography in HEVC.Firstly,we define the local optimality of MVP(Motion Vector Prediction)based on the technology of AMVP(Advanced Motion Vector Prediction).Secondly,we analyze that in HEVC video,message embedding either usingMVP index orMVD(Motion Vector Difference)may destroy the above optimality of MVP.And then,we define the optimal rate of MVP as a steganalysis feature.Finally,we conduct steganalysis detection experiments on two general datasets for three popular steganographymethods and compare the performance with four state-ofthe-art steganalysis methods.The experimental results demonstrate the effectiveness of the proposed feature set.Furthermore,our method stands out for its practical applicability,requiring no model training and exhibiting low computational complexity,making it a viable solution for real-world scenarios.

Single-pixel imaging of a moving object with multi-motion

Motion blur restoration is essential for the imaging of moving objects,especially for single-pixel imaging(SPI),which requires multiple measurements.To reconstruct the image of a moving object with multiple motion modes,we propose a novel motion blur restoration method of SPI using geometric moment patterns.We design a novel localization method that uses normalized differential first-order moments and central moment patterns to determine the object's translational position and rotation angle information.Then,we perform motion compensation by using shifting Hadamard patterns.Our method effectively improves the detection accuracy of multiple motion modes and enhances the quality of the reconstructed image.We perform simulations and experiments,and the results validate the effectiveness of the proposed method.

Multiparameter Numerical Investigation of Two Types of Moving Interactions Between the Deep-Sea Mining Vehicle Track Plate and Seabed Soil:Digging and Rotating Motions

To ensure the safe performance of deep-sea mining vehicles(DSMVs),it is necessary to study the mechanical characteristics of the interaction between the seabed soil and the track plate.The rotation and digging motions of the track plate are important links in the contact between the driving mechanism of the DSMV and seabed soil.In this study,a numerical simulation is conducted using the coupled Eulerian–Lagrangian(CEL)large deformation numerical method to investigate the interaction between the track plate of the DSMV and the seabed soil under two working conditions:rotating condition and digging condition.First,a soil numerical model is established based on the elastoplastic mechanical characterization using the basic physical and mechanical properties of the seabed soil obtained by in situ sampling.Subsequently,the soil disturbance mechanism and the dynamic mechanical response of the track plate under rotating and digging conditions are obtained through the analysis of the sensitivity of the motion parameters,the grouser structure,the layered soil features and the soil heterogeneity.The results indicate that the above parameters remarkably influence the interaction between the DSMV and the seabed soil.Therefore,it is important to consider the rotating and digging motion of the DSMV in practical engineering to develop a detailed optimization design of the track plate.

基于三维运动捕捉技术构建蒙医震脑术三维虚拟仿真平台的视觉呈现

背景:基于三维运动捕捉技术可以构建精准的、客观量化的医学虚拟仿真模型,有利于临床学习者精准、深入理解和掌握各种传统疗术。目前中医虚拟仿真模型已有报道,但蒙医传统疗术的虚拟仿真模型尚未见报道。目的:构建一种基于三维运动捕捉技术的交互式三维可视化的蒙医震脑术虚拟仿真模型。方法:使用Motion Analysis三维光学运动捕捉系统和足底测力台采集蒙医专家的运动捕捉数据,在Motion Builder软件中构建震脑术三维动作模型,使用Maya软件构建角色模型并与动作模型相匹配,运动Unity3D软件构建蒙医震脑术虚拟仿真系统,系统整合蒙医震脑术操作3D动画、运动学和动力学参数信息。结果与结论:通过三维运动捕捉技术和计算机仿真重现蒙医震脑术操作,能够显示施术者和受试者的运动姿态,记录关节运动的关键空间位置参数与变化情况,得出运动过程中的运动学、动力学参数。运用交互式三维虚拟仿真技术,实现蒙医震脑术的三维虚拟仿真的视觉呈现,为蒙医震脑术手法的标准化、数字化、可视化研究奠定基础。

Neural Dynamics for Cooperative Motion Control of Omnidirectional Mobile Manipulators in the Presence of Noises: A Distributed Approach

This paper presents a distributed scheme with limited communications, aiming to achieve cooperative motion control for multiple omnidirectional mobile manipulators(MOMMs).The proposed scheme extends the existing single-agent motion control to cater to scenarios involving the cooperative operation of MOMMs. Specifically, squeeze-free cooperative load transportation is achieved for the end-effectors of MOMMs by incorporating cooperative repetitive motion planning(CRMP), while guiding each individual to desired poses. Then, the distributed scheme is formulated as a time-varying quadratic programming(QP) and solved online utilizing a noise-tolerant zeroing neural network(NTZNN). Theoretical analysis shows that the NTZNN model converges globally to the optimal solution of QP in the presence of noise. Finally, the effectiveness of the control design is demonstrated by numerical simulations and physical platform experiments.

Relationship between self-propelled velocity and Brownian motion for spherical and ellipsoid particles

The Brownian motion of spherical and ellipsoidal self-propelled particles was simulated without considering the effect of inertia and using the Langevin equation and the diffusion coefficient of ellipsoidal particles derived by Perrin.The P´eclet number(Pe)was introduced to measure the relative strengths of self-propelled and Brownian motions.We found that the motion state of spherical and ellipsoid self-propelled particles changed significantly under the influence of Brownian motion.For spherical particles,there were three primary states of motion:1)when Pe<30,the particles were still significantly affected by Brownian motion;2)when Pe>30,the self-propelled velocities of the particles were increasing;and 3)when Pe>100,the particles were completely controlled by the self-propelled velocities and the Brownian motion was suppressed.In the simulation of the ellipsoidal self-propelled particles,we found that the larger the aspect ratio of the particles,the more susceptible they were to the influence of Brownian motion.In addition,the value interval of Pe depended on the aspect ratio.Finally,we found that the directional motion ability of the ellipsoidal self-propelled particles was much weaker than that of the spherical self-propelled particles.

Quantitative analysis of the morphing wing mechanism of raptors:IMMU-based motion capture system and its application on gestures of a Falco peregrinus

This paper presented a novel tinny motion capture system for measuring bird posture based on inertial and magnetic measurement units that are made up of micromachined gyroscopes, accelerometers, and magnetometers. Multiple quaternion-based extended Kalman filters were implemented to estimate the absolute orientations to achieve high accuracy.Under the guidance of ornithology experts, the extending/contracting motions and flapping cycles were recorded using the developed motion capture system, and the orientation of each bone was also analyzed. The captured flapping gesture of the Falco peregrinus is crucial to the motion database of raptors as well as the bionic design.

A Framework of LSTM Neural Network Model in Multi-Time Scale Real-Time Prediction of Ship Motions in Head Waves

Ship motions induced by waves have a significant impact on the efficiency and safety of offshore operations.Real-time prediction of ship motions in the next few seconds plays a crucial role in performing sensitive activities.However,the obvious memory effect of ship motion time series brings certain difficulty to rapid and accurate prediction.Therefore,a real-time framework based on the Long-Short Term Memory(LSTM)neural network model is proposed to predict ship motions in regular and irregular head waves.A 15000 TEU container ship model is employed to illustrate the proposed framework.The numerical implementation and the real-time ship motion prediction in irregular head waves corresponding to the different time scales are carried out based on the container ship model.The related experimental data were employed to verify the numerical simulation results.The results show that the proposed method is more robust than the classical extreme short-term prediction method based on potential flow theory in the prediction of nonlinear ship motions.

Bioinspired Polarized Optical Flow Enables Turbid Underwater Target Motion Estimation

Underwater target motion estimation is a challenge for ocean military and scientific research.In this work,we propose a method based on the combination of polarization imaging and optical flow for turbid underwater target detection.Polarization imaging can reduce the influence of backscattered light and obtain high-quality images underwater.The optical flow shows the motion and structural information of the target.We use polarized optical flow to obtain the optical flow field and estimate the target motion.The experimental results of different targets under varying water turbidity levels illustrate that our method is realizable and robust.The precision is verified by comparing the results with the precise displacement data and calculating two error measures.The proposed method based on polarized optical flow can obtain accurate displacement information and a good recognition effect.Moving target segmentation based on the Otsu method further proves the superiority of the polarized optical flow under turbid water.This study is valuable for target detection and motion estimation in scattering environments.

Self-Attention Mechanism-Based Activity and Motion Recognition Using Wi-Fi Signals

Activity and motion recognition using Wi-Fi signals,mainly channel state information(CSI),has captured the interest of many researchers in recent years.Many research studies have achieved splendid results with the help of machine learning models from different applications such as healthcare services,sign language translation,security,context awareness,and the internet of things.Nevertheless,most of these adopted studies have some shortcomings in the machine learning algorithms as they rely on recurrence and convolutions and,thus,precluding smooth sequential computation.Therefore,in this paper,we propose a deep-learning approach based solely on attention,i.e.,the sole Self-Attention Mechanism model(Sole-SAM),for activity and motion recognition using Wi-Fi signals.The Sole-SAM was deployed to learn the features representing different activities and motions from the raw CSI data.Experiments were carried out to evaluate the performance of the proposed Sole-SAM architecture.The experimental results indicated that our proposed system took significantly less time to train than models that rely on recurrence and convolutions like Long Short-Term Memory(LSTM)and Recurrent Neural Network(RNN).Sole-SAM archived a 0.94%accuracy level,which is 0.04%better than RNN and 0.02%better than LSTM.