GAN-DIRNet:A Novel Deformable Image Registration Approach for Multimodal Histological Images

Multi-modal histological image registration tasks pose significant challenges due to tissue staining operations causing partial loss and folding of tissue.Convolutional neural network(CNN)and generative adversarial network(GAN)are pivotal inmedical image registration.However,existing methods often struggle with severe interference and deformation,as seen in histological images of conditions like Cushing’s disease.We argue that the failure of current approaches lies in underutilizing the feature extraction capability of the discriminator inGAN.In this study,we propose a novel multi-modal registration approach GAN-DIRNet based on GAN for deformable histological image registration.To begin with,the discriminators of two GANs are embedded as a new dual parallel feature extraction module into the unsupervised registration networks,characterized by implicitly extracting feature descriptors of specific modalities.Additionally,modal feature description layers and registration layers collaborate in unsupervised optimization,facilitating faster convergence and more precise results.Lastly,experiments and evaluations were conducted on the registration of the Mixed National Institute of Standards and Technology database(MNIST),eight publicly available datasets of histological sections and the Clustering-Registration-Classification-Segmentation(CRCS)dataset on the Cushing’s disease.Experimental results demonstrate that our proposed GAN-DIRNet method surpasses existing approaches like DIRNet in terms of both registration accuracy and time efficiency,while also exhibiting robustness across different image types.

STRONGLY CONVERGENT INERTIAL FORWARD-BACKWARD-FORWARD ALGORITHM WITHOUT ON-LINE RULE FOR VARIATIONAL INEQUALITIES

This paper studies a strongly convergent inertial forward-backward-forward algorithm for the variational inequality problem in Hilbert spaces.In our convergence analysis,we do not assume the on-line rule of the inertial parameters and the iterates,which have been assumed by several authors whenever a strongly convergent algorithm with an inertial extrapolation step is proposed for a variational inequality problem.Consequently,our proof arguments are different from what is obtainable in the relevant literature.Finally,we give numerical tests to confirm the theoretical analysis and show that our proposed algorithm is superior to related ones in the literature.

Nonlinear Registration of Brain Magnetic Resonance Images with Cross Constraints of Intensity and Structure

Many deep learning-based registration methods rely on a single-stream encoder-decoder network for computing deformation fields between 3D volumes.However,these methods often lack constraint information and overlook semantic consistency,limiting their performance.To address these issues,we present a novel approach for medical image registration called theDual-VoxelMorph,featuring a dual-channel cross-constraint network.This innovative network utilizes both intensity and segmentation images,which share identical semantic information and feature representations.Two encoder-decoder structures calculate deformation fields for intensity and segmentation images,as generated by the dual-channel cross-constraint network.This design facilitates bidirectional communication between grayscale and segmentation information,enabling the model to better learn the corresponding grayscale and segmentation details of the same anatomical structures.To ensure semantic and directional consistency,we introduce constraints and apply the cosine similarity function to enhance semantic consistency.Evaluation on four public datasets demonstrates superior performance compared to the baselinemethod,achieving Dice scores of 79.9%,64.5%,69.9%,and 63.5%for OASIS-1,OASIS-3,LPBA40,and ADNI,respectively.

A harmonisation approach to traditional Chinese medicine registration in Asian countries

The traditional Chinese medicine(TCM)industry is critical to not only for public health but also for economic growth.According to the European Union(EU)directives,under the EU framework for(traditional)herbal medicinal products,herbal medicines with long history of use can be registered in EU.However,there is a condition in this directive in which only those that have at least 10e15 years in the EU market are accepted for registration and/or marketing authorization.In author opinion,the condition of 10-15 years of use in EU countries set within the EU regulatory framework is with consideration of the genetic differences which can result in variation in adverse drug responses among different world populations.With this concept in mind,it is reasonable to project the principal of the EU directive to the Asian countries where TCM is originated.Countries like China,Singapore,Japan and South Korea that have well established drug registration framework are in best position in executing the best practice and facilitate harmonization of registration for TCM within the region.Furthermore,the registration process itself allows more safety and efficacy data to be collected systemically before and after product registration/marketing authorization.These are valuable information for future drug development.The therapeutic value of TCM is limitless,it has been left out in the EU regulatory framework,and the opportunity for it to be expanded and carried forward in modern medicines is shadowed by the limited number of TCM that are qualified to be registered under the EU regulatory framework.An early establishment of a harmonized risk-based registration process for TCM in Asian countries is important.This will strengthen the database to substantiate the history of safe use and further preserving and expanding the therapeutic values of TCM within and beyond the Asian region.

Optimization of the Use of Spherical Targets for Point Cloud Registration Using Monte Carlo Simulation

Registrations based on the manual placement of spherical targets are still being employed by many professionals in the industry.However,the placement of those targets usually relies solely on personal experience without scientific evidence supported by numerical analysis.This paper presents a comprehensive investigation,based on Monte Carlo simulation,into determining the optimal number and positions for efficient target placement in typical scenes consisting of a pair of facades.It demonstrates new check-up statistical rules and geometrical constraints that can effectively extract and analyze massive simulations of unregistered point clouds and their corresponding registrations.More than 6×10^(7) sets of the registrations were simulated,whereas more than IOO registrations with real data were used to verify the results of simulation.The results indicated that using five spherical targets is the best choice for the registration of a large typical registration site consisting of two vertical facades and a ground,when there is only a box set of spherical targets available.As a result,the users can avoid placing extra targets to achieve insignificant improvements in registration accuracy.The results also suggest that the higher registration accuracy can be obtained when the ratio between the facade-to-target distance and target-to-scanner distance is approximately 3:2.Therefore,the targets should be placed closer to the scanner rather than in the middle between the facades and the scanner,contradicting to the traditional thought. Besides,the results reveal that the accuracy can be increased by setting the largest projected triangular area of the targets to be large.

The Impact of Simulation Education on Self-Efficacy in Pre-Registration Nursing Students

This literature review primarily aims to explore and synthesise the previous studies in simulation education research conducted over the past five years related to the effects of simulation training on the self-efficacy of undergraduate pre-registration nursing students. The second aim of this study is to explore additional outcome variables that were examined in the previous studies. Five electronic databases were searched systematically. These databases were MEDLINE, CINAHL Plus, Scopus, Embase and PsycINFO. The PICO model was employed to identify the search terms, with a thesaurus being used to provide synonyms. Reference lists of relevant articles were examined and hand searches of journals were also undertaken. The quality of each study was assessed using the Simulation Research Rubric (SRR). A total of 11 studies were included. All studies explored the impact of simulation education on undergraduate pre-registration nursing. Six studies explored nursing students’ competence and performance and two papers examined their critical thinking. Problem solving, learning motivation, communication skills and knowledge acquisition were examined once. The majority of studies indicated that simulation training has a positive impact on pre-registration nursing students’ self-efficacy and other outcome variables. Furthermore, the study results indicate that simulation training is more dependable than traditional training, and students were extremely satisfied with the simulation training. However, most of the studies included in this review had several gaps, including study design, sample size and dissimilarities between the scales used. Further research with large samples, reliable and valid instruments, and outcomes measures (such as critical thinking and transferability of skills) is required to provide better insight into the effectiveness of simulation in undergraduate nursing education. .

Hierarchical Non-linear Image Registration Integrating Deformable Segmentation

A hierarchical non-linear method for image registration was presented, which integrates image segmentation and registration under a variational framework. An improved deformable model is used to simultaneously segment and register feature from multiple images. The objects in the image pair are segmented by evolving a single contour and meanwhile the parameters of affine registration transformation are found out. After that, a contour-constrained elastic registration is applied to register the images correctly. The experimental results indicate that the proposed approach is effective to segment and register medical images.

Disordered Multi-view Registration Method Based on the Soft Trimmed Deep Network

Compared with the pair-wise registration of point clouds,multi-view point cloud registration is much less studied.In this dissertation,a disordered multi-view point cloud registration method based on the soft trimmed deep network is proposed.In this method,firstly,the expression ability of feature extraction module is improved and the registration accuracy is increased by enhancing feature extraction network with the point pair feature.Secondly,neighborhood and angle similarities are used to measure the consistency of candidate points to surrounding neighborhoods.By combining distance consistency and high dimensional feature consistency,our network introduces the confidence estimation module of registration,so the point cloud trimmed problem can be converted to candidate for the degree of confidence estimation problem,achieving the pair-wise registration of partially overlapping point clouds.Thirdly,the results from pair-wise registration are fed into the model fusion to achieve the rough registration of multi-view point clouds.Finally,the hierarchical clustering is used to iteratively optimize the clustering center model by gradually increasing the number of clustering categories and performing clustering and registration alternately.This method achieves rough point cloud registration quickly in the early stage,improves the accuracy of multi-view point cloud registration in the later stage,and makes full use of global information to achieve robust and accurate multi-view registration without initial value.

Natural forest ALS-TLS point cloud data registration without control points

Airborne laser scanning(ALS)and terrestrial laser scanning(TLS)has attracted attention due to their forest parameter investigation and research applications.ALS is limited to obtaining fi ne structure information below the forest canopy due to the occlusion of trees in natural forests.In contrast,TLS is unable to gather fi ne structure information about the upper canopy.To address the problem of incomplete acquisition of natural forest point cloud data by ALS and TLS on a single platform,this study proposes data registration without control points.The ALS and TLS original data were cropped according to sample plot size,and the ALS point cloud data was converted into relative coordinates with the center of the cropped data as the origin.The same feature point pairs of the ALS and TLS point cloud data were then selected to register the point cloud data.The initial registered point cloud data was fi nely and optimally registered via the iterative closest point(ICP)algorithm.The results show that the proposed method achieved highprecision registration of ALS and TLS point cloud data from two natural forest plots of Pinus yunnanensis Franch.and Picea asperata Mast.which included diff erent species and environments.An average registration accuracy of 0.06 m and 0.09 m were obtained for P.yunnanensis and P.asperata,respectively.

One-step Eco-friendly Fabrication of Antibacterial Polyester Via On-line Amination Reaction by Melt Coextrusion

The work is dedicated to develop a one-step eco-friendly method to prepare antibacterial polyethylene terephthalate(PET).We report a one-step eco-friendly method to manufacture antibacterial PET via on-line amination reaction by melt coextrusion.Beside evenly mixing of poly(hexamethylene guanidine)(PHMG)and PET in the melt coextrusion procedure,the amination reaction also occurred between PHMG and PET under high temperature(230-270℃).The antibacterial ability of composite PET showed obvious PHMG concentration dependence,and antibacterial activity reached more than 99%when PHMG content was 2.5 wt%.Moreover,LIVE/DEAD fluorescence test further confirmed that the composite PET could kill bacteria quickly and efiectively(within 30 min);while negligible cytotoxicity was observed to HSF and HUVEC cells.Onestep eco-friendly fabrication of composite antibacterial PET was accomplished by on-line melt coextrusion.The composite antibacterial PET has potential use in multiple fields to combat with pathogenic including textiles,packaging materials,decoration materials and biomedical devices,etc.

Real-time continuous image guidance for endoscopic retrograde cholangiopancreatography based on 3D/2D registration and respiratory compensation

BACKGROUND It has been confirmed that three-dimensional(3D)imaging allows easier identification of bile duct anatomy and intraoperative guidance of endoscopic retrograde cholangiopancreatography(ERCP),which reduces the radiation dose and procedure time with improved safety.However,current 3D biliary imaging does not have good real-time fusion with intraoperative imaging,a process meant to overcome the influence of intraoperative respiratory motion and guide navigation.The present study explored the feasibility of real-time continuous image-guided ERCP.AIM To explore the feasibility of real-time continuous image-guided ERCP.METHODS We selected 23D-printed abdominal biliary tract models with different structures to simulate different patients.The ERCP environment was simulated for the biliary phantom experiment to create a navigation system,which was further tested in patients.In addition,based on the estimation of the patient’s respiratory motion,preoperative 3D biliary imaging from computed tomography of 18 patients with cholelithiasis was registered and fused in real-time with 2D fluoroscopic sequence generated by the C-arm unit during ERCP.RESULTS Continuous image-guided ERCP was applied in the biliary phantom with a registration error of 0.46 mm±0.13 mm and a tracking error of 0.64 mm±0.24mm.After estimating the respiratory motion,3D/2D registration accurately transformed preoperative 3D biliary images to each image in the X-ray image sequence in real-time in 18 patients,with an average fusion rate of 88%.CONCLUSION Continuous image-guided ERCP may be an effective approach to assist the operator and reduce the use of X-ray and contrast agents.

Automatic Extraction of the Sparse Prior Correspondences for Non-Rigid Point Cloud Registration

Non-rigid registration of point clouds is still far from stable,especially for the largely deformed one.Sparse initial correspondences are often adopted to facilitate the process.However,there are few studies on how to build them automatically.Therefore,in this paper,we propose a robust method to compute such priors automatically,where a global and local combined strategy is adopted.These priors in different degrees of deformation are obtained by the locally geometrical-consistent point matches from the globally structural-consistent region correspondences.To further utilize the matches,this paper also proposes a novel registration method based on the Coherent Point Drift framework.This method takes both the spatial proximity and local structural consistency of the priors as supervision of the registration process and thus obtains a robust alignment for clouds with significantly different deformations.Qualitative and quantitative experiments demonstrate the advantages of the proposed method.

Free form deformation and symmetry constraint‐based multimodal brain image registration using generative adversarial nets

Multi‐modal brain image registration has been widely applied to functional localisation,neurosurgery and computational anatomy.The existing registration methods based on the dense deformation fields involve too many parameters,which is not conducive to the exploration of correct spatial correspondence between the float and reference images.Meanwhile,the unidirectional registration may involve the deformation folding,which will result in the change of topology during registration.To address these issues,this work has presented an unsupervised image registration method using the free form deformation(FFD)and the symmetry constraint‐based generative adversarial networks(FSGAN).The FSGAN utilises the principle component analysis network‐based structural representations of the reference and float images as the inputs and uses the generator to learn the FFD model parameters,thereby producing two deformation fields.Meanwhile,the FSGAN uses two discriminators to decide whether the bilateral registration have been realised simultaneously.Besides,the symmetry constraint is utilised to construct the loss function,thereby avoiding the deformation folding.Experiments on BrainWeb,high grade gliomas,IXI and LPBA40 show that compared with state‐of‐the‐art methods,the FSGAN provides superior performance in terms of visual comparisons and such quantitative indexes as dice value,target registration error and computational efficiency.

Application of Opening and Closing Morphology in Deep Learning-Based Brain Image Registration

In order to improve the registration accuracy of brain magnetic resonance images(MRI),some deep learning registration methods use segmentation images for training model.How-ever,the segmentation values are constant for each label,which leads to the gradient variation con-centrating on the boundary.Thus,the dense deformation field(DDF)is gathered on the boundary and there even appears folding phenomenon.In order to fully leverage the label information,the morphological opening and closing information maps are introduced to enlarge the non-zero gradi-ent regions and improve the accuracy of DDF estimation.The opening information maps supervise the registration model to focus on smaller,narrow brain regions.The closing information maps supervise the registration model to pay more attention to the complex boundary region.Then,opening and closing morphology networks(OC_Net)are designed to automatically generate open-ing and closing information maps to realize the end-to-end training process.Finally,a new registra-tion architecture,VM_(seg+oc),is proposed by combining OC_Net and VoxelMorph.Experimental results show that the registration accuracy of VM_(seg+oc) is significantly improved on LPBA40 and OASIS1 datasets.Especially,VM_(seg+oc) can well improve registration accuracy in smaller brain regions and narrow regions.

Automated Registration for Infrared Image Based on Wavelet Analysis

To develop a quick, accurate and antinoise automated image registration technique for infrared images, the wavelet analysis technique was used to extract the feature points in two images followed by the compensation for input image with angle difference between them. A hi erarchical feature matching algorithm was adopted to get the final transform parameters between the two images. The simulation results for two infrared images show that the method can effectively, quickly and accurately register images and be antinoise to some extent.

Sensor Registration in Asynchronous Data Fusion

To find an effective method to estimate and remove the registration error in asynchronous multisensor system, Kalman filtering technique and least squares approach have been proposed to estimate and remove sensor bias and sensor frame tilt errors in multisensor systems with asynchronous data. Simulation results is presented to demonstrate the performance of these approaches. The least squares approach can compress measurements to any time. The Kalman filter algorithm can detect registration errors and use the information to converge tracks from independent sensors. This is particularly important if the data from the sensors are to be fused.

Multi-Sensor Intelligent System for On-Line and Real-Time Moneitoring Tool Cutting State in FMS

The principle and the constitution of an intelligent system for on-line and real-time montitoring tool cutting state were discussed and a synthetic sensors schedule combined a new type fluid acoustic emission sensor (AE) with motor current sensor was presented. The parallel communication between control system of machine tools, the monitoring intelligent system,and several decision-making systems for identifying tool cutting state was established It can auto - matically select the sensor way ,monitoring mode and identifying method in machining process- ing so as to build a successful and effective intelligent system for on -line and real-time moni- toring cutting tool states in FMS.

Kalman Fliter Approach to Multisensor Registration of Moving Platform

Aim To find an effective method to remove the registration error in multi-sensor systems. Methods A Kalman filtering technique was proposed to estimate and remove sensor bias and sensor fare tilt errors in multisensor systems with a moving platform. Results Simulation results are presented to demonstrate the performance of the approach. Conclusion The Kalman filter algorithm am detect registration errors and use this information to converge tracks from independent sensors. This is particularly important if the data from the sensors are to fused.