A Restricted, Adaptive Threshold Segmentation Approach for Processing High-Speed Image Sequences of the Glottis

In this paper, we propose a restricted, adaptive threshold approach for the segmentation of images of the glottis acquired from high speed video-endoscopy (HSV). The approach involves first, identifying a region of interest (ROI) that encloses the vocal-fold motion extent for each image frame as estimated by the different image sequences. This procedure is then followed by threshold segmentation restricted within the identified ROI for each image frame of the original image sequences, or referred to as sub-image sequences. The threshold value is adapted for each sub-image frame and determined by respective minimum gray-scale value that typically corresponds to a spatial location within the glottis. The proposed approach is practical and highly efficient for segmenting a vast amount of image frames since simple threshold method is adapted. Results obtained from the segmentation of representative clinical image sequences are presented to verify the proposed method.

A Versatile High-speed Image Processing System Based on DSP and CPLD

In this paper, we present an optimized design method for high-speed embedded image processing system using 32 bit floating-point Digital Signal Processor （DSP） and Complex Programmable Logic Device （CPLD）. The DSP acts as the main processor of the system： executes digital image processing algorithms and operates other devices such as image sensor and CPLD. The CPLD is used to acquire images and achieve complex logic control of the whole system. Some key technologies are introduced to enhance the performance of our system. In particular, the use of DSP/BIOS tool to develop DSP applications makes our program run much more efficiently. As a result, this system can provide an excellent computing platform not only for executing complex image processing algorithms, but also for other digital signal processing or multi-channel data collection by choosing different sensors or Analog-to-Digital （A/D） converters.

Experimental Investigation of Flame Dynamics Based on High-Speed Images in Swirl Combustion Systems

The interaction mechanism of internally-staged-swirling stratified flame is complex,and the pilot flame has a manifest influence on flame stability.To study this,a series of experimental investigations for the pilot flame has been carried out in a model swirl combustor by only supplying the pilot fuel.The CH*chemiluminescence images of the pilot flame are acquired by a high-speed camera with a CH*bandpass filter,whose dynamic characteristics are identified by image statistical analysis and proper orthogonal decomposition(POD)analysis.And the fast algorithm based on matrix theory proposed in this paper increases the operation efficiency and operability of POD.With the pilot equivalence ratioΦincrease,the pilot flame gradually shows an unstable state,whose POD energy distribution is significantly different.In the unstable state,the flame dynamics include three modes—spiral motion mode,flame shedding mode,and axial oscillation mode,whose formation reasons have also been further analyzed in combination with the experimental characteristics.And the fast Fourier transform(FFT)analysis of the time coefficients for the first four POD modes indicates all the dominant frequency is 280 Hz,which means the model combustor is in resonance.In addition,a sensitivity analysis based on the different image resolutions further reveals the robustness of the POD method and its optimization direction.These results emphasize the important influence of the pilot fuel flow rate on the stability of the pilot flame.

Image-Aided Analysis of Ballast Particle Movement Along a High-Speed Railway

As a core infrastructure of high-speed railways,ballast layers constituted by graded crushed stones feature noteworthy particle movement compared with normal railways,which may cause excessive settlement and have detrimental effects on train operation.However,the movement behavior remains ambiguous due to a lack of effective measurement approaches and analytical methods.In this study,an image-aided technique was developed in a full-scale model test using digital cameras and a colorbased identification approach.A total of 1274 surface ballast particles were manually dyed by discernible colors to serve as tracers in the test.The movements of the surface ballast particles were tracked using the varied pixels displaying tracers in the photos that were intermittently taken during the test in the perpendicular direction.The movement behavior of ballast particles under different combinations of train speeds and axle loads was quantitatively evaluated.The obtained results indicated that the surface ballast particle movements were slight,mainly concentrated near sleepers under low-speed train loads and greatly amplified and extended to the whole surface when the train speed reached 360 km.h-1.Additionally,the development of ballast particle displacement statistically resembled its rotation.Track vibration contributed to the movements of ballast particles,which specifically were driven by vertical acceleration near the track center and horizontal acceleration at the track edge.Furthermore,the development trends of ballast particle movements and track settlement under long-term train loading were similar,and both stabilized at nearly the same time.The track performance,including the vibration characteristics,accumulated settlement,and sleeper support stiffness,was determined to be closely related to the direction and distribution of ballast particle flow,which partly deteriorated under high-speed train loads.

High-speed image reconstruction for optically sectioned,super-resolution structured illumination microscopy

Super-resolution structured illumination microscopy(SR-SIM)is an outstanding method for visualizing the subcellular dynamics in living cells.To date,by using elaborately designed systems and algorithms,SR-SIM can achieve rapid,optically sectioned,SR observation with hundreds to thousands of time points.However,real-time observation is still out of reach for most SIM setups as conventional algorithms for image reconstruction involve a heavy computing burden.To address this limitation,an accelerated reconstruction algorithm was developed by implementing a simplified workflow for SR-SIM,termed joint space and frequency reconstruction.This algorithm results in an 80-fold improvement in reconstruction speed relative to the widely used Wiener-SIM.Critically,the increased processing speed does not come at the expense of spatial resolution or sectioning capability,as demonstrated by live imaging of microtubule dynamics and mitochondrial tubulation.

Dendritic Learning-Incorporated Vision Transformer for Image Recognition

Dear Editor,This letter proposes to integrate dendritic learnable network architecture with Vision Transformer to improve the accuracy of image recognition.In this study,based on the theory of dendritic neurons in neuroscience,we design a network that is more practical for engineering to classify visual features.Based on this,we propose a dendritic learning-incorporated vision Transformer(DVT),which out-performs other state-of-the-art methods on three image recognition benchmarks.

Infrared and Visible Image Fusion Based on Res2Net-Transformer Automatic Encoding and Decoding

A novel image fusion network framework with an autonomous encoder and decoder is suggested to increase thevisual impression of fused images by improving the quality of infrared and visible light picture fusion. The networkcomprises an encoder module, fusion layer, decoder module, and edge improvementmodule. The encoder moduleutilizes an enhanced Inception module for shallow feature extraction, then combines Res2Net and Transformerto achieve deep-level co-extraction of local and global features from the original picture. An edge enhancementmodule (EEM) is created to extract significant edge features. A modal maximum difference fusion strategy isintroduced to enhance the adaptive representation of information in various regions of the source image, therebyenhancing the contrast of the fused image. The encoder and the EEM module extract features, which are thencombined in the fusion layer to create a fused picture using the decoder. Three datasets were chosen to test thealgorithmproposed in this paper. The results of the experiments demonstrate that the network effectively preservesbackground and detail information in both infrared and visible images, yielding superior outcomes in subjectiveand objective evaluations.

Numerical Study on Reduction in Aerodynamic Drag and Noise of High-Speed Pantograph

Reducing the aerodynamic drag and noise levels of high-speed pantographs is important for promoting environmentally friendly,energy efficient and rapid advances in train technology.Using computational fluid dynamics theory and the K-FWH acoustic equation,a numerical simulation is conducted to investigate the aerodynamic characteristics of high-speed pantographs.A component optimization method is proposed as a possible solution to the problemof aerodynamic drag and noise in high-speed pantographs.The results of the study indicate that the panhead,base and insulator are the main contributors to aerodynamic drag and noise in high-speed pantographs.Therefore,a gradual optimization process is implemented to improve the most significant components that cause aerodynamic drag and noise.By optimizing the cross-sectional shape of the strips and insulators,the drag and noise caused by airflow separation and vortex shedding can be reduced.The aerodynamic drag of insulator with circular cross section and strips with rectangular cross section is the largest.Ellipsifying insulators and optimizing the chamfer angle and height of the windward surface of the strips can improve the aerodynamic performance of the pantograph.In addition,the streamlined fairing attached to the base can eliminate the complex flow and shield the radiated noise.In contrast to the original pantograph design,the improved pantograph shows a 21.1%reduction in aerodynamic drag and a 1.65 dBA reduction in aerodynamic noise.

High-speed penetration of ogive-nose projectiles into thick concrete targets:Tests and a projectile nose evolution model

The majority of the projectiles used in the hypersonic penetration study are solid flat-nosed cylindrical projectiles with a diameter of less than 20 mm.This study aims to fill the gap in the experimental and analytical study of the evolution of the nose shape of larger hollow projectiles under hypersonic penetration.In the hypersonic penetration test,eight ogive-nose AerMet100 steel projectiles with a diameter of 40 mm were launched to hit concrete targets with impact velocities that ranged from 1351 to 1877 m/s.Severe erosion of the projectiles was observed during high-speed penetration of heterogeneous targets,and apparent localized mushrooming occurred in the front nose of recovered projectiles.By examining the damage to projectiles,a linear relationship was found between the relative length reduction rate and the initial kinetic energy of projectiles in different penetration tests.Furthermore,microscopic analysis revealed the forming mechanism of the localized mushrooming phenomenon for eroding penetration,i.e.,material spall erosion abrasion mechanism,material flow and redistribution abrasion mechanism and localized radial upsetting deformation mechanism.Finally,a model of highspeed penetration that included erosion was established on the basis of a model of the evolution of the projectile nose that considers radial upsetting;the model was validated by test data from the literature and the present study.Depending upon the impact velocity,v0,the projectile nose may behave as undistorted,radially distorted or hemispherical.Due to the effects of abrasion of the projectile and enhancement of radial upsetting on the duration and amplitude of the secondary rising segment in the pulse shape of projectile deceleration,the predicted DOP had an upper limit.

Using restored two-dimensional X-ray images to reconstruct the three-dimensional magnetopause

Astronomical imaging technologies are basic tools for the exploration of the universe,providing basic data for the research of astronomy and space physics.The Soft X-ray Imager(SXI)carried by the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)aims to capture two-dimensional(2-D)images of the Earth’s magnetosheath by using soft X-ray imaging.However,the observed 2-D images are affected by many noise factors,destroying the contained information,which is not conducive to the subsequent reconstruction of the three-dimensional(3-D)structure of the magnetopause.The analysis of SXI-simulated observation images shows that such damage cannot be evaluated with traditional restoration models.This makes it difficult to establish the mapping relationship between SXIsimulated observation images and target images by using mathematical models.We propose an image restoration algorithm for SXIsimulated observation images that can recover large-scale structure information on the magnetosphere.The idea is to train a patch estimator by selecting noise–clean patch pairs with the same distribution through the Classification–Expectation Maximization algorithm to achieve the restoration estimation of the SXI-simulated observation image,whose mapping relationship with the target image is established by the patch estimator.The Classification–Expectation Maximization algorithm is used to select multiple patch clusters with the same distribution and then train different patch estimators so as to improve the accuracy of the estimator.Experimental results showed that our image restoration algorithm is superior to other classical image restoration algorithms in the SXI-simulated observation image restoration task,according to the peak signal-to-noise ratio and structural similarity.The restoration results of SXI-simulated observation images are used in the tangent fitting approach and the computed tomography approach toward magnetospheric reconstruction techniques,significantly improving the reconstruction results.Hence,the proposed technology may be feasible for processing SXI-simulated observation images.

The Soft X-ray Imager(SXI)on the SMILE Mission

The Soft X-ray Imager(SXI)is part of the scientific payload of the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission.SMILE is a joint science mission between the European Space Agency(ESA)and the Chinese Academy of Sciences(CAS)and is due for launch in 2025.SXI is a compact X-ray telescope with a wide field-of-view(FOV)capable of encompassing large portions of Earth’s magnetosphere from the vantage point of the SMILE orbit.SXI is sensitive to the soft X-rays produced by the Solar Wind Charge eXchange(SWCX)process produced when heavy ions of solar wind origin interact with neutral particles in Earth’s exosphere.SWCX provides a mechanism for boundary detection within the magnetosphere,such as the position of Earth’s magnetopause,because the solar wind heavy ions have a very low density in regions of closed magnetic field lines.The sensitivity of the SXI is such that it can potentially track movements of the magnetopause on timescales of a few minutes and the orbit of SMILE will enable such movements to be tracked for segments lasting many hours.SXI is led by the University of Leicester in the United Kingdom(UK)with collaborating organisations on hardware,software and science support within the UK,Europe,China and the United States.

Background removal from global auroral images:Data-driven dayglow modeling

Global images of auroras obtained by cameras on spacecraft are a key tool for studying the near-Earth environment.However,the cameras are sensitive not only to auroral emissions produced by precipitating particles,but also to dayglow emissions produced by photoelectrons induced by sunlight.Nightglow emissions and scattered sunlight can contribute to the background signal.To fully utilize such images in space science,background contamination must be removed to isolate the auroral signal.Here we outline a data-driven approach to modeling the background intensity in multiple images by formulating linear inverse problems based on B-splines and spherical harmonics.The approach is robust,flexible,and iteratively deselects outliers,such as auroral emissions.The final model is smooth across the terminator and accounts for slow temporal variations and large-scale asymmetries in the dayglow.We demonstrate the model by using the three far ultraviolet cameras on the Imager for Magnetopause-to-Aurora Global Exploration(IMAGE)mission.The method can be applied to historical missions and is relevant for upcoming missions,such as the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission.

Expert Experience and Data-Driven Based Hybrid Fault Diagnosis for High-SpeedWire Rod Finishing Mills

The reliable operation of high-speed wire rod finishing mills is crucial in the steel production enterprise.As complex system-level equipment,it is difficult for high-speed wire rod finishing mills to realize fault location and real-time monitoring.To solve the above problems,an expert experience and data-driven-based hybrid fault diagnosis method for high-speed wire rod finishing mills is proposed in this paper.First,based on its mechanical structure,time and frequency domain analysis are improved in fault feature extraction.The approach of combining virtual value,peak value with kurtosis value index,is adopted in time domain analysis.Speed adjustment and side frequency analysis are proposed in frequency domain analysis to obtain accurate component characteristic frequency and its corresponding sideband.Then,according to time and frequency domain characteristics,fault location based on expert experience is proposed to get an accurate fault result.Finally,the proposed method is implemented in the equipment intelligent diagnosis system.By taking an equipment fault on site,for example,the effectiveness of the proposed method is illustrated in the system.

A review of artificial intelligence applications in high-speed railway systems

In recent years,the global surge of High-speed Railway(HSR)revolutionized ground transportation,providing secure,comfortable,and punctual services.The next-gen HSR,fueled by emerging services like video surveillance,emergency communication,and real-time scheduling,demands advanced capabilities in real-time perception,automated driving,and digitized services,which accelerate the integration and application of Artificial Intelligence(AI)in the HSR system.This paper first provides a brief overview of AI,covering its origin,evolution,and breakthrough applications.A comprehensive review is then given regarding the most advanced AI technologies and applications in three macro application domains of the HSR system:mechanical manufacturing and electrical control,communication and signal control,and transportation management.The literature is categorized and compared across nine application directions labeled as intelligent manufacturing of trains and key components,forecast of railroad maintenance,optimization of energy consumption in railroads and trains,communication security,communication dependability,channel modeling and estimation,passenger scheduling,traffic flow forecasting,high-speed railway smart platform.Finally,challenges associated with the application of AI are discussed,offering insights for future research directions.

Method for evaluation of geological strength index of carbonate cliff rocks:Coupled hyperspectral-digital borehole image technique

The deterioration of unstable rock mass raised interest in evaluating rock mass quality.However,the traditional evaluation method for the geological strength index(GSI)primarily emphasizes the rock structure and characteristics of discontinuities.It ignores the influence of mineral composition and shows a deficiency in assessing the integrity coefficient.In this context,hyperspectral imaging and digital panoramic borehole camera technologies are applied to analyze the mineral content and integrity of rock mass.Based on the carbonate mineral content and fissure area ratio,the strength reduction factor and integrity coefficient are calculated to improve the GSI evaluation method.According to the results of mineral classification and fissure identification,the strength reduction factor and integrity coefficient increase with the depth of rock mass.The rock mass GSI calculated by the improved method is mainly concentrated between 40 and 60,which is close to the calculation results of the traditional method.The GSI error rates obtained by the two methods are mostly less than 10%,indicating the rationality of the hyperspectral-digital borehole image coupled evaluation method.Moreover,the sensitivity of the fissure area ratio(Sr)to GSI is greater than that of the strength reduction factor(a),which means the proposed GSI is suitable for rocks with significant fissure development.The improved method reduces the influence of subjective factors and provides a reliable index for the deterioration evaluation of rock mass.

Deep learning-based inpainting of saturation artifacts in optical coherence tomography images

Limited by the dynamic range of the detector,saturation artifacts usually occur in optical coherence tomography(OCT)imaging for high scattering media.The available methods are difficult to remove saturation artifacts and restore texture completely in OCT images.We proposed a deep learning-based inpainting method of saturation artifacts in this paper.The generation mechanism of saturation artifacts was analyzed,and experimental and simulated datasets were built based on the mechanism.Enhanced super-resolution generative adversarial networks were trained by the clear–saturated phantom image pairs.The perfect reconstructed results of experimental zebrafish and thyroid OCT images proved its feasibility,strong generalization,and robustness.

Human intrusion detection for high-speed railway perimeter under all-weather condition

Purpose – The paper aims to solve the problem of personnel intrusion identification within the limits of highspeed railways. It adopts the fusion method of millimeter wave radar and camera to improve the accuracy ofobject recognition in dark and harsh weather conditions.Design/methodology/approach – This paper adopts the fusion strategy of radar and camera linkage toachieve focus amplification of long-distance targets and solves the problem of low illumination by laser lightfilling of the focus point. In order to improve the recognition effect, this paper adopts the YOLOv8 algorithm formulti-scale target recognition. In addition, for the image distortion caused by bad weather, this paper proposesa linkage and tracking fusion strategy to output the correct alarm results.Findings – Simulated intrusion tests show that the proposed method can effectively detect human intrusionwithin 0–200 m during the day and night in sunny weather and can achieve more than 80% recognitionaccuracy for extreme severe weather conditions.Originality/value – (1) The authors propose a personnel intrusion monitoring scheme based on the fusion ofmillimeter wave radar and camera, achieving all-weather intrusion monitoring;(2) The authors propose a newmulti-level fusion algorithm based on linkage and tracking to achieve intrusion target monitoring underadverse weather conditions;(3) The authors have conducted a large number of innovative simulationexperiments to verify the effectiveness of the method proposed in this article.

SMILE soft X-ray Imager flight model CCD370 pre-flight device characterisation

Throughout the SMILE mission the satellite will be bombarded by radiation which gradually damages the focal plane devices and degrades their performance.In order to understand the changes of the CCD370s within the soft X-ray Imager,an initial characterisation of the devices has been carried out to give a baseline performance level.Three CCDs have been characterised,the two flight devices and the flight spa re.This has been carried out at the Open University in a bespo ke cleanroom measure ment facility.The results show that there is a cluster of bright pixels in the flight spa re which increases in size with tempe rature.However at the nominal ope rating tempe rature(-120℃) it is within the procure ment specifications.Overall,the devices meet the specifications when ope rating at -120℃ in 6 × 6 binned frame transfer science mode.The se rial charge transfer inefficiency degrades with temperature in full frame mode.However any charge losses are recovered when binning/frame transfer is implemented.

Artificial Intelligence and Computer Vision during Surgery: Discussing Laparoscopic Images with ChatGPT4—Preliminary Results

Introduction: Ultrafast latest developments in artificial intelligence (ΑΙ) have recently multiplied concerns regarding the future of robotic autonomy in surgery. However, the literature on the topic is still scarce. Aim: To test a novel AI commercially available tool for image analysis on a series of laparoscopic scenes. Methods: The research tools included OPENAI CHATGPT 4.0 with its corresponding image recognition plugin which was fed with a list of 100 laparoscopic selected snapshots from common surgical procedures. In order to score reliability of received responses from image-recognition bot, two corresponding scales were developed ranging from 0 - 5. The set of images was divided into two groups: unlabeled (Group A) and labeled (Group B), and according to the type of surgical procedure or image resolution. Results: AI was able to recognize correctly the context of surgical-related images in 97% of its reports. For the labeled surgical pictures, the image-processing bot scored 3.95/5 (79%), whilst for the unlabeled, it scored 2.905/5 (58.1%). Phases of the procedure were commented in detail, after all successful interpretations. With rates 4 - 5/5, the chatbot was able to talk in detail about the indications, contraindications, stages, instrumentation, complications and outcome rates of the operation discussed. Conclusion: Interaction between surgeon and chatbot appears to be an interesting frontend for further research by clinicians in parallel with evolution of its complex underlying infrastructure. In this early phase of using artificial intelligence for image recognition in surgery, no safe conclusions can be drawn by small cohorts with commercially available software. Further development of medically-oriented AI software and clinical world awareness are expected to bring fruitful information on the topic in the years to come.

Enhancing Dense Small Object Detection in UAV Images Based on Hybrid Transformer

Transformer-based models have facilitated significant advances in object detection.However,their extensive computational consumption and suboptimal detection of dense small objects curtail their applicability in unmanned aerial vehicle(UAV)imagery.Addressing these limitations,we propose a hybrid transformer-based detector,H-DETR,and enhance it for dense small objects,leading to an accurate and efficient model.Firstly,we introduce a hybrid transformer encoder,which integrates a convolutional neural network-based cross-scale fusion module with the original encoder to handle multi-scale feature sequences more efficiently.Furthermore,we propose two novel strategies to enhance detection performance without incurring additional inference computation.Query filter is designed to cope with the dense clustering inherent in drone-captured images by counteracting similar queries with a training-aware non-maximum suppression.Adversarial denoising learning is a novel enhancement method inspired by adversarial learning,which improves the detection of numerous small targets by counteracting the effects of artificial spatial and semantic noise.Extensive experiments on the VisDrone and UAVDT datasets substantiate the effectiveness of our approach,achieving a significant improvement in accuracy with a reduction in computational complexity.Our method achieves 31.9%and 21.1%AP on the VisDrone and UAVDT datasets,respectively,and has a faster inference speed,making it a competitive model in UAV image object detection.