Interactive System for Video Summarization Based on Multimodal Fusion

Biography videos based on life performances of prominent figures in history aim to describe great mens' life.In this paper,a novel interactive video summarization for biography video based on multimodal fusion is proposed,which is a novel approach of visualizing the specific features for biography video and interacting with video content by taking advantage of the ability of multimodality.In general,a story of movie progresses by dialogues of characters and the subtitles are produced with the basis on the dialogues which contains all the information related to the movie.In this paper,JGibbsLDA is applied to extract key words from subtitles because the biography video consists of different aspects to depict the characters' whole life.In terms of fusing keywords and key-frames,affinity propagation is adopted to calculate the similarity between each key-frame cluster and keywords.Through the method mentioned above,a video summarization is presented based on multimodal fusion which describes video content more completely.In order to reduce the time spent on searching the interest video content and get the relationship between main characters,a kind of map is adopted to visualize video content and interact with video summarization.An experiment is conducted to evaluate video summarization and the results demonstrate that this system can formally facilitate the exploration of video content while improving interaction and finding events of interest efficiently.

Design and Implementation of the Image Interactive System Based on Human-Computer Interaction

Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.

ST-Map:an Interactive Map for Discovering Spatial and Temporal Patterns in Bibliographic Data

Getting insight into the spatiotemporal distribution patterns of knowledge innovation is receiving increasing attention from policymakers and economic research organizations.Many studies use bibliometric data to analyze the popularity of certain research topics,well-adopted methodologies,influential authors,and the interrelationships among research disciplines.However,the visual exploration of the patterns of research topics with an emphasis on their spatial and temporal distribution remains challenging.This study combined a Space-Time Cube(STC)and a 3D glyph to represent the complex multivariate bibliographic data.We further implemented a visual design by developing an interactive interface.The effectiveness,understandability,and engagement of ST-Map are evaluated by seven experts in geovisualization.The results suggest that it is promising to use three-dimensional visualization to show the overview and on-demand details on a single screen.

Optimization of Interactive Videos Empowered the Experience of Learning Management System

The Learning management system(LMS)is now being used for uploading educational content in both distance and blended setups.LMS platform has two types of users:the educators who upload the content,and the students who have to access the content.The students,usually rely on text notes or books and video tutorials while their exams are conducted with formal methods.Formal assessments and examination criteria are ineffective with restricted learning space which makes the student tend only to read the educational contents and videos instead of interactive mode.The aim is to design an interactive LMS and examination video-based interface to cater the issues of educators and students.It is designed according to Human-computer interaction(HCI)principles to make the interactive User interface(UI)through User experience(UX).The interactive lectures in the form of annotated videos increase user engagement and improve the self-study context of users involved in LMS.The interface design defines how the design will interact with users and how the interface exchanges information.The findings show that interactive videos for LMS allow the users to have a more personalized learning experience by engaging in the educational content.The result shows a highly personalized learning experience due to the interactive video and quiz within the video.

A Study on Gender Differences in Speech Interaction Behaviors of Preschool Teachers-Based on the Improved Flanders Interactive Analysis System(iFIAS)

The issue of the extremely imbalanced gender ratio in preschool teachers has received widespread attention,and there are few studies on teacher-child verbal interaction behavior based on gender differences in preschool teachers.This article takes the“Little Light Bulb Is On”,a scientific exploration activity done by 5-6 years old kindergarten students as an example,and uses the improved Flanders Interaction Analysis System(iFIAS)as a tool to analyze the speech interaction behavior of male and female preschool teachers.The research results indicate that there are gender differences in teacher child language interaction between male and female teachers in terms of the atmosphere,the teaching structure,the teaching tendency,the way of raising questions,and the overall trend of interaction.

MCIF-Transformer Mask RCNN:Multi-Branch Cross-Scale Interactive Feature Fusion Transformer Model for PET/CT Lung Tumor Instance Segmentation

The precise detection and segmentation of tumor lesions are very important for lung cancer computer-aided diagnosis.However,in PET/CT(Positron Emission Tomography/Computed Tomography)lung images,the lesion shapes are complex,the edges are blurred,and the sample numbers are unbalanced.To solve these problems,this paper proposes a Multi-branch Cross-scale Interactive Feature fusion Transformer model(MCIF-Transformer Mask RCNN)for PET/CT lung tumor instance segmentation,The main innovative works of this paper are as follows:Firstly,the ResNet-Transformer backbone network is used to extract global feature and local feature in lung images.The pixel dependence relationship is established in local and non-local fields to improve the model perception ability.Secondly,the Cross-scale Interactive Feature Enhancement auxiliary network is designed to provide the shallow features to the deep features,and the cross-scale interactive feature enhancement module(CIFEM)is used to enhance the attention ability of the fine-grained features.Thirdly,the Cross-scale Interactive Feature fusion FPN network(CIF-FPN)is constructed to realize bidirectional interactive fusion between deep features and shallow features,and the low-level features are enhanced in deep semantic features.Finally,4 ablation experiments,3 comparison experiments of detection,3 comparison experiments of segmentation and 6 comparison experiments with two-stage and single-stage instance segmentation networks are done on PET/CT lung medical image datasets.The results showed that APdet,APseg,ARdet and ARseg indexes are improved by 5.5%,5.15%,3.11%and 6.79%compared with Mask RCNN(resnet50).Based on the above research,the precise detection and segmentation of the lesion region are realized in this paper.This method has positive significance for the detection of lung tumors.

Parameter calibration of the tensile-shear interactive damage constitutive model for sandstone failure

The tensile-shear interactive damage(TSID)model is a novel and powerful constitutive model for rock-like materials.This study proposes a methodology to calibrate the TSID model parameters to simulate sandstone.The basic parameters of sandstone are determined through a series of static and dynamic tests,including uniaxial compression,Brazilian disc,triaxial compression under varying confining pressures,hydrostatic compression,and dynamic compression and tensile tests with a split Hopkinson pressure bar.Based on the sandstone test results from this study and previous research,a step-by-step procedure for parameter calibration is outlined,which accounts for the categories of the strength surface,equation of state(EOS),strain rate effect,and damage.The calibrated parameters are verified through numerical tests that correspond to the experimental loading conditions.Consistency between numerical results and experimental data indicates the precision and reliability of the calibrated parameters.The methodology presented in this study is scientifically sound,straightforward,and essential for improving the TSID model.Furthermore,it has the potential to contribute to other rock constitutive models,particularly new user-defined models.

Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates

Interactive holography offers unmatched levels of immersion and user engagement in the field of future display.Despite of the substantial progress has been made in dynamic meta-holography,the realization of real-time,highly smooth interactive holography remains a significant challenge due to the computational and display frame rate limitations.In this study,we introduced a dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates.To our knowledge,this is the first reported practical dynamic interactive metasurface holographic system.We spa-tially divided the metasurface device into multiple distinct channels,each projecting a reconstructed sub-pattern.The switching states of these channels were mapped to bitwise operations on a set of bit values,which avoids complex holo-gram computations,enabling an ultra-high computational frame rate.Our approach achieves a computational frame rate of 800 kHz and a display frame rate of 23 kHz on a low-power Raspberry Pi computational platform.According to this methodology,we demonstrated an interactive dynamic holographic Tetris game system that allows interactive gameplay,color display,and on-the-fly hologram creation.Our technology presents an inspiration for advanced dynamic meta-holography,which is promising for a broad range of applications including advanced human-computer interaction,real-time 3D visualization,and next-generation virtual and augmented reality systems.

Coexistence of antiferromagnetism and unconventional superconductivity in a quasi-one-dimensional flat-band system:Creutz lattice

We study the coexistence of antiferromagnetism and unconventional superconductivity on the Creutz lattice which shows strictly flat bands in the noninteracting regime.The famous renormalized mean-field theory is used to deal with strong electron-electron repulsive Hubbard interaction in the effective low-energy t-J model,the superfluid weight of the unconventional superconducting state has been calculated via the linear response theory.An unconventional superconducting state with both spin-singlet and staggered spin-triplet pairs emerges beyond a critical antiferromagnetic coupling interaction,while antiferromagnetism accompanies this state.The superconducting state with only spin-singlet pairs is dominant with paramagnetic phase.The A phase is analogous to the pseudogap phase,which shows that electrons go to form pairs but do not cause a supercurrent.We also show the superfluid behavior of the unconventional superconducting state and its critical temperature.It is proven directly that the flat band can effectively raise the critical temperature of superconductivity.It is implementable to simulate and control strongly-correlated electrons'behavior on the Creutz lattice in the ultracold atoms experiment or other artificial structures.Our results may help the understanding of the interplay between unconventional superconductivity and magnetism.

Phonon resonance modulation in weak van der Waals heterostructures:Controlling thermal transport in graphene-silicon nanoparticle systems

The drive for efficient thermal management has intensified with the miniaturization of electronic devices.This study explores the modulation of phonon transport within graphene by introducing silicon nanoparticles influenced by van der Waals forces.Our approach involves the application of non-equilibrium molecular dynamics to assess thermal conductivity while varying the interaction strength,leading to a noteworthy reduction in thermal conductivity.Furthermore,we observe a distinct attenuation in length-dependent behavior within the graphene-nanoparticles system.Our exploration combines wave packet simulations with phonon transmission calculations,aligning with a comprehensive analysis of the phonon transport regime to unveil the underlying physical mechanisms at play.Lastly,we conduct transient molecular dynamics simulations to investigate interfacial thermal conductance between the nanoparticles and the graphene,revealing an enhanced thermal boundary conductance.This research not only contributes to our understanding of phonon transport but also opens a new degree of freedom for utilizing van der Waals nanoparticle-induced resonance,offering promising avenues for the modulation of thermal properties in advanced materials and enhancing their performance in various technological applications.

Studies on the temporal,structural,and interacting features of the clubroot resistance gene Rcr1 using CRISPR/Cas9-based systems

Clubroot disease is a severe threat to Brassica crops globally,particularly in western Canada.Genetic resistance,achieved through pyramiding clubroot resistance(CR)genes with different modes of action,is the most important strategy for managing the disease.However,studies on the CR gene functions are quite limited.In this study,we have conducted investigations into the temporal,structural,and interacting features of a newly cloned CR gene,Rcr1,using CRISPR/Cas9 technology.For temporal functionality,we developed a novel CRISPR/Cas9-based binary vector,pHHIGR-Hsp18.2,to deliver Rcr1 into a susceptible canola line(DH12075)and observed that early expression of Rcr1 is critical for conferring resistance.For structural functionality,several independent mutations in specific domains of Rcr1 resulted in loss-offunction,highlighting their importance for CR phenotype.In the study of the interacting features of Rcr1,a cysteine protease gene and its homologous allele in canola were successfully disrupted via CRISPR/Cas9 as an interacting component with Rcr1 protein,resulting in the conversion from clubroot resistant to susceptible in plants carrying intact Rcr1.These results indicated an indispensable role of these two cysteine proteases in Rcr1-mediated resistance response.This study,the first of its kind,provides valuable insights into the functionality of Rcr1.Further,the new vector p HHIGR-Hsp18.2 demonstrated an inducible feature on the removal of add-on traits,which should be useful for functional genomics and other similar research in brassica crops.

Machine learning and human‐machine trust in healthcare:A systematic survey

As human‐machine interaction(HMI)in healthcare continues to evolve,the issue of trust in HMI in healthcare has been raised and explored.It is critical for the development and safety of healthcare that humans have proper trust in medical machines.Intelligent machines that have applied machine learning(ML)technologies continue to penetrate deeper into the medical environment,which also places higher demands on intelligent healthcare.In order to make machines play a role in HMI in healthcare more effectively and make human‐machine cooperation more harmonious,the authors need to build good humanmachine trust(HMT)in healthcare.This article provides a systematic overview of the prominent research on ML and HMT in healthcare.In addition,this study explores and analyses ML and three important factors that influence HMT in healthcare,and then proposes a HMT model in healthcare.Finally,general trends are summarised and issues to consider addressing in future research on HMT in healthcare are identified.

Chemical simulation teaching system based on virtual reality and gesture interaction

Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.

Virtual Keyboard:A Real-Time Hand Gesture Recognition-Based Character Input System Using LSTM and Mediapipe Holistic

In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.

Isotope Tracking of Surface Water Groundwater Interaction in the Beninese Part of the Iullemeden Aquifer System

The Kandi basin is located in northeast Benin (West Africa). This study is focused on the estimation of water fluxes exchanged between the river Niger (and its tributaries) and the transboundary Iullemeden Aquifer System. In that framework, an innovative approach based on the application of the Bayesian Mixing Model (MixSIAR) analysis on water isotopes (oxygen-18, deuterium and tritium) was performed. Moreover, to assess the relevance of the model outputs, Pearson’s correlation and Principal Component Analysis (PCA) have been done. A complex relationship between surface water and groundwater has been found. Sixty percent (60%) of groundwater samples are made of more than 70% river water and rainwater;while 31.25% of surface water samples are made of about 84% groundwater. To safeguard sustainable water resources for the well-being of the local communities, surface water and groundwater must be managed as a unique component in the Kandi basin.

The Application of Formative Assessment in Interactive Comprehensive English Classroom Teaching

Teaching evaluation is an important part of the teaching process of college English courses,and effective formative assessment can reflect the entire teaching process from multiple perspectives and ensure the smooth achievement of teaching objectives.Formative assessment is an assessment that runs through the entire learning process,based on humanism and constructivism,with various forms of evaluation.

基于Interactive Physics的物理习题教学--以2023年高考全国乙卷25题和湖北卷15题为例

在传统高中物理教学中,多过程碰撞的物理过程很难在板书上展现出来,成为教学的一大难点。基于Interactive Physics仿真功能,以2023年高考全国乙卷25题和湖北卷15题为例,将多过程碰撞的物理过程可视化,直观展现物理模型,帮助学生理解题目的复杂情境,有效缩短学习时间,提高教学质量和教学效率,实现最优化的教学目标。

Dynamics of Non-Markovianity, Quantum Correlations and Information Scrambling of Three Qubits Systems Interacting via Rashba Interaction

The behavior of the quantum correlations, information scrambling and the non-Markovianity of three entangling qubits systems via Rashba is discussed. The results showed that, the three physical quantities oscillate between their upper and lower bounds, where the number of oscillations increases as the Rashba interaction strength increases. The exchanging rate of these three quantities depends on the Rashba strength, and whether the entangled state is generated via direct/indirect interaction. Moreover, the coherence parameter can be used as a control parameter to maximize or minimize the three physical quantities.

Research on Visualization and Interactive Design of Plant Configuration Virtual Reality in the Context of Digitalization

This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in-depth analysis of digital technology,the study outlines its important role in landscape design,especially in the application of plant configuration.The current application status of virtual reality technology in landscape design is discussed,as well as how interactive design can enhance user experience and participation.Furthermore,the achievements and challenges of digital technology in landscape design are summarized.Finally,it proposes future research directions and suggestions,aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.

Research and Application of AI-Based Interactive Exhibits in Wuhan Museum of Science and Technology

This article aims to explore the development and application of AI-based interactive exhibits in Wuhan Museum of Science and Technology.By utilizing computer vision,natural language processing,and machine learning technologies,an innovative exhibit development and application system is proposed.This system employs deep learning algorithms and data analysis methods to achieve real-time perception of visitor behavior and adaptive interaction.The development process involves designing user interfaces and interaction methods to effectively enhance visitor engagement and learning outcomes.Through evaluation and comparison in practical applications,the potential of this system in enhancing exhibit interaction,increasing visitor engagement,improving educational effectiveness,and expanding avenues for scientific knowledge dissemination are validated.