Multi-Stage-Based Siamese Neural Network for Seal Image Recognition

Seal authentication is an important task for verifying the authenticity of stamped seals used in various domains to protect legal documents from tampering and counterfeiting.Stamped seal inspection is commonly audited manually to ensure document authenticity.However,manual assessment of seal images is tedious and laborintensive due to human errors,inconsistent placement,and completeness of the seal.Traditional image recognition systems are inadequate enough to identify seal types accurately,necessitating a neural network-based method for seal image recognition.However,neural network-based classification algorithms,such as Residual Networks(ResNet)andVisualGeometryGroup with 16 layers(VGG16)yield suboptimal recognition rates on stamp datasets.Additionally,the fixed training data categories make handling new categories to be a challenging task.This paper proposes amulti-stage seal recognition algorithmbased on Siamese network to overcome these limitations.Firstly,the seal image is pre-processed by applying an image rotation correction module based on Histogram of Oriented Gradients(HOG).Secondly,the similarity between input seal image pairs is measured by utilizing a similarity comparison module based on the Siamese network.Finally,we compare the results with the pre-stored standard seal template images in the database to obtain the seal type.To evaluate the performance of the proposed method,we further create a new seal image dataset that contains two subsets with 210,000 valid labeled pairs in total.The proposed work has a practical significance in industries where automatic seal authentication is essential as in legal,financial,and governmental sectors,where automatic seal recognition can enhance document security and streamline validation processes.Furthermore,the experimental results show that the proposed multi-stage method for seal image recognition outperforms state-of-the-art methods on the two established datasets.

Dynamic Multi-Graph Spatio-Temporal Graph Traffic Flow Prediction in Bangkok:An Application of a Continuous Convolutional Neural Network

The ability to accurately predict urban traffic flows is crucial for optimising city operations.Consequently,various methods for forecasting urban traffic have been developed,focusing on analysing historical data to understand complex mobility patterns.Deep learning techniques,such as graph neural networks(GNNs),are popular for their ability to capture spatio-temporal dependencies.However,these models often become overly complex due to the large number of hyper-parameters involved.In this study,we introduce Dynamic Multi-Graph Spatial-Temporal Graph Neural Ordinary Differential Equation Networks(DMST-GNODE),a framework based on ordinary differential equations(ODEs)that autonomously discovers effective spatial-temporal graph neural network(STGNN)architectures for traffic prediction tasks.The comparative analysis of DMST-GNODE and baseline models indicates that DMST-GNODE model demonstrates superior performance across multiple datasets,consistently achieving the lowest Root Mean Square Error(RMSE)and Mean Absolute Error(MAE)values,alongside the highest accuracy.On the BKK(Bangkok)dataset,it outperformed other models with an RMSE of 3.3165 and an accuracy of 0.9367 for a 20-min interval,maintaining this trend across 40 and 60 min.Similarly,on the PeMS08 dataset,DMST-GNODE achieved the best performance with an RMSE of 19.4863 and an accuracy of 0.9377 at 20 min,demonstrating its effectiveness over longer periods.The Los_Loop dataset results further emphasise this model’s advantage,with an RMSE of 3.3422 and an accuracy of 0.7643 at 20 min,consistently maintaining superiority across all time intervals.These numerical highlights indicate that DMST-GNODE not only outperforms baseline models but also achieves higher accuracy and lower errors across different time intervals and datasets.

Application of virtual reality technology improves the functionality of brain networks in individuals experiencing pain

Medical procedures are inherently invasive and carry the risk of inducing pain to the mind and body.Recently,efforts have been made to alleviate the discomfort associated with invasive medical procedures through the use of virtual reality(VR)technology.VR has been demonstrated to be an effective treatment for pain associated with medical procedures,as well as for chronic pain conditions for which no effective treatment has been established.The precise mechanism by which the diversion from reality facilitated by VR contributes to the diminution of pain and anxiety has yet to be elucidated.However,the provision of positive images through VR-based visual stimulation may enhance the functionality of brain networks.The salience network is diminished,while the default mode network is enhanced.Additionally,the medial prefrontal cortex may establish a stronger connection with the default mode network,which could result in a reduction of pain and anxiety.Further research into the potential of VR technology to alleviate pain could lead to a reduction in the number of individuals who overdose on painkillers and contribute to positive change in the medical field.

3D tomographic analysis of equatorial plasma bubble using GNSS-TEC data from Indonesian GNSS Network

Equatorial Plasma Bubbles(EPBs)are ionospheric irregularities that take place near the magnetic equator.EPBs most commonly occur after sunset during the equinox months,although they can also be observed during other seasons.The phenomenon significantly disrupts radio wave signals essential to communication and navigation systems.The national network of Global Navigation Satellite System(GNSS)receivers in Indonesia(>30°longitudinal range)provides an opportunity for detailed EPB studies.To explore this,we conducted preliminary 3D tomography of total electron content(TEC)data captured by GNSS receivers following a geomagnetic storm on December 3,2023,when at least four EPB clusters occurred in the Southeast Asian sector.TEC and extracted TEC depletion with a 120-minute running average were then used as inputs for a 3D tomography program.Their 2D spatial distribution consistently captured the four EPB clusters over time.These tomography results were validated through a classical checkerboard test and comparisons with other ionospheric data sources,such as the Global Ionospheric Map(GIM)and International Reference Ionosphere(IRI)profile.Validation of the results demonstrates the capability of the Indonesian GNSS network to measure peak ionospheric density.These findings highlight the potential for future three-dimensional research of plasma bubbles in low-latitude regions using existing GNSS networks,with extensive longitudinal coverage.

Leveraging ROTI map derived from Indonesian GNSS receiver network for advancing study of Equatorial Plasma Bubble in Southeast/East Asia

This paper highlights the crucial role of Indonesia’s GNSS receiver network in advancing Equatorial Plasma Bubble(EPB)studies in Southeast and East Asia,as ionospheric irregularities within EPB can disrupt GNSS signals and degrade positioning accuracy.Managed by the Indonesian Geospatial Information Agency(BIG),the Indonesia Continuously Operating Reference Station(Ina-CORS)network comprises over 300 GNSS receivers spanning equatorial to southern low-latitude regions.Ina-CORS is uniquely situated to monitor EPB generation,zonal drift,and dissipation across Southeast Asia.We provide a practical tool for EPB research,by sharing two-dimensional rate of Total Electron Content(TEC)change index(ROTI)derived from this network.We generate ROTI maps with a 10-minute resolution,and samples from May 2024 are publicly available for further scientific research.Two preliminary findings from the ROTI maps of Ina-CORS are noteworthy.First,the Ina-CORS ROTI maps reveal that the irregularities within a broader EPB structure persist longer,increasing the potential for these irregularities to migrate farther eastward.Second,we demonstrate that combined ROTI maps from Ina-CORS and GNSS receivers in East Asia and Australia can be used to monitor the development of ionospheric irregularities in Southeast and East Asia.We have demonstrated the combined ROTI maps to capture the development of ionospheric irregularities in the Southeast/East Asian sector during the G5 Geomagnetic Storm on May 11,2024.We observed simultaneous ionospheric irregularities in Japan and Australia,respectively propagating northwestward and southwestward,before midnight,whereas Southeast Asia’s equatorial and low-latitude regions exhibited irregularities post-midnight.By sharing ROTI maps from Indonesia and integrating them with regional GNSS networks,researchers can conduct comprehensive EPB studies,enhancing the understanding of EPB behavior across Southeast and East Asia and contributing significantly to ionospheric research.

Modeling and Comprehensive Review of Signaling Storms in 3GPP-Based Mobile Broadband Networks:Causes,Solutions,and Countermeasures

Control signaling is mandatory for the operation and management of all types of communication networks,including the Third Generation Partnership Project(3GPP)mobile broadband networks.However,they consume important and scarce network resources such as bandwidth and processing power.There have been several reports of these control signaling turning into signaling storms halting network operations and causing the respective Telecom companies big financial losses.This paper draws its motivation from such real network disaster incidents attributed to signaling storms.In this paper,we present a thorough survey of the causes,of the signaling storm problems in 3GPP-based mobile broadband networks and discuss in detail their possible solutions and countermeasures.We provide relevant analytical models to help quantify the effect of the potential causes and benefits of their corresponding solutions.Another important contribution of this paper is the comparison of the possible causes and solutions/countermeasures,concerning their effect on several important network aspects such as architecture,additional signaling,fidelity,etc.,in the form of a table.This paper presents an update and an extension of our earlier conference publication.To our knowledge,no similar survey study exists on the subject.

Global Piecewise Analysis of HIV Model with Bi-Infectious Categories under Ordinary Derivative and Non-Singular Operator with Neural Network Approach

This study directs the discussion of HIV disease with a novel kind of complex dynamical generalized and piecewise operator in the sense of classical and Atangana Baleanu(AB)derivatives having arbitrary order.The HIV infection model has a susceptible class,a recovered class,along with a case of infection divided into three sub-different levels or categories and the recovered class.The total time interval is converted into two,which are further investigated for ordinary and fractional order operators of the AB derivative,respectively.The proposed model is tested separately for unique solutions and existence on bi intervals.The numerical solution of the proposed model is treated by the piece-wise numerical iterative scheme of Newtons Polynomial.The proposed method is established for piece-wise derivatives under natural order and non-singular Mittag-Leffler Law.The cross-over or bending characteristics in the dynamical system of HIV are easily examined by the aspect of this research having a memory effect for controlling the said disease.This study uses the neural network(NN)technique to obtain a better set of weights with low residual errors,and the epochs number is considered 1000.The obtained figures represent the approximate solution and absolute error which are tested with NN to train the data accurately.

Unlocking the future:Mitochondrial genes and neural networks in predicting ovarian cancer prognosis and immunotherapy response

BACKGROUND Mitochondrial genes are involved in tumor metabolism in ovarian cancer(OC)and affect immune cell infiltration and treatment responses.AIM To predict prognosis and immunotherapy response in patients diagnosed with OC using mitochondrial genes and neural networks.METHODS Prognosis,immunotherapy efficacy,and next-generation sequencing data of patients with OC were downloaded from The Cancer Genome Atlas and Gene Expression Omnibus.Mitochondrial genes were sourced from the MitoCarta3.0 database.The discovery cohort for model construction was created from 70% of the patients,whereas the remaining 30% constituted the validation cohort.Using the expression of mitochondrial genes as the predictor variable and based on neural network algorithm,the overall survival time and immunotherapy efficacy(complete or partial response)of patients were predicted.RESULTS In total,375 patients with OC were included to construct the prognostic model,and 26 patients were included to construct the immune efficacy model.The average area under the receiver operating characteristic curve of the prognostic model was 0.7268[95% confidence interval(CI):0.7258-0.7278]in the discovery cohort and 0.6475(95%CI:0.6466-0.6484)in the validation cohort.The average area under the receiver operating characteristic curve of the immunotherapy efficacy model was 0.9444(95%CI:0.8333-1.0000)in the discovery cohort and 0.9167(95%CI:0.6667-1.0000)in the validation cohort.CONCLUSION The application of mitochondrial genes and neural networks has the potential to predict prognosis and immunotherapy response in patients with OC,providing valuable insights into personalized treatment strategies.

Unraveling the mechanism of action of Shangxia Liangji formula for treating insomnia:a metabolomics and network pharmacology approach

Background:Insomnia is a prevalent clinical condition and Shangxia Liangji formula(SXLJF)is a well-established method of treatment.Nevertheless,the specific mechanism of action of SXLJF remains unclear.Methods:The mouse model of insomnia was established by intraperitoneal injection of para-chlorophenylalanine.Forty-two mice were randomly divided into a negative control group,model group,SXLJF group(18.72 g/kg/day),and positive control group(diazepam,2 mg/kg)and treated with the corresponding drugs for 7 consecutive days.The open field test and pentobarbital-induced sleeping test were conducted.LC-MS-based untargeted metabolomics and network pharmacology were applied to explore the potential targets of SXLJF for treating insomnia.Finally,key targets were validated using RT-qPCR.Results:Behavioral tests demonstrated that SXLJF reduced the total distance,average velocity,central distance,and sleep latency,and prolonged sleep duration.Metabolomics and network pharmacology revealed potential targets,signaling pathways,metabolic pathways,and metabolites associated with the anti-insomnia effects of SXLJF.Specifically,tyrosine hydroxylase(TH)and tyrosine metabolism emerged as crucial metabolic pathways and targets,respectively.RT-qPCR results supported the role of TH in the mechanism of SXLJF in treating insomnia.Conclusion:In conclusion,TH and tyrosine metabolism may represent significant targets and pathways for SXLJF in treating insomnia.

Learning the parameters of a class of stochastic Lotka-Volterra systems with neural networks

In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained from the Euler-Maruyama discretization of the underlying stochastic differential equations(SDEs),based on which the loss function is built.The stochastic gradient descent method is applied in the neural network training.Numerical experiments demonstrate the effectiveness of our method.

A Novel Self-Supervised Learning Network for Binocular Disparity Estimation

Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This study proposes a novel end-to-end disparity estimation model to address these challenges.Our approach combines a Pseudo-Siamese neural network architecture with pyramid dilated convolutions,integrating multi-scale image information to enhance robustness against lighting interferences.This study introduces a Pseudo-Siamese structure-based disparity regression model that simplifies left-right image comparison,improving accuracy and efficiency.The model was evaluated using a dataset of stereo endoscopic videos captured by the Da Vinci surgical robot,comprising simulated silicone heart sequences and real heart video data.Experimental results demonstrate significant improvement in the network’s resistance to lighting interference without substantially increasing parameters.Moreover,the model exhibited faster convergence during training,contributing to overall performance enhancement.This study advances endoscopic image processing accuracy and has potential implications for surgical robot applications in complex environments.

Hemispheric asymmetries and network dysfunctions in adolescent depression:A neuroimaging study using resting-state functional magnetic resonance imaging

BACKGROUND Currently,adolescent depression is one of the most significant public health concerns,markedly influencing emotional,cognitive,and social maturation.Despite advancements in distinguish the neurobiological substrates underlying depression,the intricate patterns of disrupted brain network connectivity in adolescents warrant further exploration.AIM To elucidate the neural correlates of adolescent depression by examining brain network connectivity using resting-state functional magnetic resonance imaging(rs-fMRI).METHODS The study cohort comprised 74 depressed adolescents and 59 healthy controls aged 12 to 17 years.Participants underwent rs-fMRI to evaluate functional connectivity within and across critical brain networks,including the visual,default mode network(DMN),dorsal attention,salience,somatomotor,and frontoparietal control networks.RESULTS Analyses revealed pronounced functional disparities within key neural circuits among adolescents with depression.The results demonstrated existence of hemispheric asymmetries characterized by enhanced activity in the left visual network,which contrasted the diminished activity in the right hemisphere.The DMN facilitated increased activity within the left prefrontal cortex and reduced engagement in the right hemisphere,implicating disrupted self-referential and emotional processing mechanisms.Additionally,an overactive right dorsal attention network and a hypoactive salience network were identified,underscoring significant abnormalities in attentional and emotional regulation in adolescent depression.CONCLUSION The findings from this study underscore distinct neural connectivity disruptions in adolescent depression,underscoring the critical role of specific neurobiological markers for precise early diagnosis of adolescent depression.The observed functional asymmetries and network-specific deviations elucidate the complex neurobiological architecture of adolescent depression,supporting the development of targeted therapeutic strategies.

Modeling,Analysis and Validation of Friendship Paradox in Evolving Networks

Friendship paradox states that individuals are likely to have fewer friends than their friends do,on average.Despite of its wide existence and appealing applications in real social networks,the mathematical understanding of friendship paradox is very limited.Only few works provide theoretical evidence of single-step and multi-step friendship paradoxes,given that the neighbors of interest are onehop and multi-hop away from the target node.However,they consider non-evolving networks,as opposed to the topology of real social networks that are constantly growing over time.We are thus motivated to present a first look into friendship paradox in evolving networks,where newly added nodes preferentially attach themselves to those with higher degrees.Our analytical verification of both single-step and multistep friendship paradoxes in evolving networks,along with comparison to the non-evolving counterparts,discloses that“friendship paradox is even more paradoxical in evolving networks”,primarily from three aspects:1)we demonstrate a strengthened effect of single-step friendship paradox in evolving networks,with a larger probability(more than 0.8)of a random node’s neighbors having higher average degree than the random node itself;2)we unravel higher effectiveness of multi-step friendship paradox in seeking for influential nodes in evolving networks,as the rate of reaching the max degree node can be improved by a factor of at least Θ(t^(2/3))with t being the network size;3)we empirically verify our findings through both synthetic and real datasets,which suggest high agreements of results and consolidate the reasonability of evolving model for real social networks.

Resting-state brain network remodeling after different nerve reconstruction surgeries:a functional magnetic resonance imaging study in brachial plexus injury rats

Distinct brain remodeling has been found after different nerve reconstruction strategies,including motor representation of the affected limb.However,differences among reconstruction strategies at the brain network level have not been elucidated.This study aimed to explore intranetwork changes related to altered peripheral neural pathways after different nerve reconstruction surgeries,including nerve repair,endto-end nerve transfer,and end-to-side nerve transfer.Sprague–Dawley rats underwent complete left brachial plexus transection and were divided into four equal groups of eight:no nerve repair,grafted nerve repair,phrenic nerve end-to-end transfer,and end-to-side transfer with a graft sutured to the anterior upper trunk.Resting-state brain functional magnetic resonance imaging was obtained 7 months after surgery.The independent component analysis algorithm was utilized to identify group-level network components of interest and extract resting-state functional connectivity values of each voxel within the component.Alterations in intra-network resting-state functional connectivity were compared among the groups.Target muscle reinnervation was assessed by behavioral observation(elbow flexion)and electromyography.The results showed that alterations in the sensorimotor and interoception networks were mostly related to changes in the peripheral neural pathway.Nerve repair was related to enhanced connectivity within the sensorimotor network,while end-to-side nerve transfer might be more beneficial for restoring control over the affected limb by the original motor representation.The thalamic-cortical pathway was enhanced within the interoception network after nerve repair and end-to-end nerve transfer.Brain areas related to cognition and emotion were enhanced after end-to-side nerve transfer.Our study revealed important brain networks related to different nerve reconstructions.These networks may be potential targets for enhancing motor recovery.

Implementation of CAN-bus Intelligent Network Communication Equipment Based on PLC

The development trend of PLC is that the functions are more, the integration level is greater and the network function is greater. Nowadays, the manufacturers of PLC develop there own network. PLC technique has two development trends. On one hand, PLC network system is not a self-contained closed system any longer and develops towards open system. Various PLC not only has distinctive PLC network systems and completes device control task, but also network with the superior computer management system to realize information exchange, which makes it become one part of information management system. On the other hand, the field-bus technique is widely applied. PLC is connected with the intelligent equipments installed on site such as intelligent instrument, sensor, intelligent solenoid valve, intelligent drive actuator by a transmission media （ such as twisted pair, coaxial cable and cable）, and they transmit information mutually according to the same communication protocol, which can form a field industrial control network. Compared with single PLC remote network, the network not only has the advantages of flexible configurations, easy expansion, low cost and higher cost perfomaance, but also has opening significance.

Convolutional Graph Neural Network with Novel Loss Strategies for Daily Temperature and Precipitation Statistical Downscaling over South China

Traditional meteorological downscaling methods face limitations due to the complex distribution of meteorological variables,which can lead to unstable forecasting results,especially in extreme scenarios.To overcome this issue,we propose a convolutional graph neural network(CGNN)model,which we enhance with multilayer feature fusion and a squeeze-and-excitation block.Additionally,we introduce a spatially balanced mean squared error(SBMSE)loss function to address the imbalanced distribution and spatial variability of meteorological variables.The CGNN is capable of extracting essential spatial features and aggregating them from a global perspective,thereby improving the accuracy of prediction and enhancing the model's generalization ability.Based on the experimental results,CGNN has certain advantages in terms of bias distribution,exhibiting a smaller variance.When it comes to precipitation,both UNet and AE also demonstrate relatively small biases.As for temperature,AE and CNNdense perform outstandingly during the winter.The time correlation coefficients show an improvement of at least 10%at daily and monthly scales for both temperature and precipitation.Furthermore,the SBMSE loss function displays an advantage over existing loss functions in predicting the98th percentile and identifying areas where extreme events occur.However,the SBMSE tends to overestimate the distribution of extreme precipitation,which may be due to the theoretical assumptions about the posterior distribution of data that partially limit the effectiveness of the loss function.In future work,we will further optimize the SBMSE to improve prediction accuracy.

Regional Storm Surge Forecast Method Based on a Neural Network and the Coupled ADCIRC-SWAN Model

Timely and accurate forecasting of storm surges can effectively prevent typhoon storm surges from causing large economic losses and casualties in coastal areas.At present,numerical model forecasting consumes too many resources and takes too long to compute,while neural network forecasting lacks regional data to train regional forecasting models.In this study,we used the DUAL wind model to build typhoon wind fields,and constructed a typhoon database of 75 processes in the northern South China Sea using the coupled Advanced Circulation-Simulating Waves Nearshore(ADCIRC-SWAN)model.Then,a neural network with a Res-U-Net structure was trained using the typhoon database to forecast the typhoon processes in the validation dataset,and an excellent storm surge forecasting effect was achieved in the Pearl River Estuary region.The storm surge forecasting effect of stronger typhoons was improved by adding a branch structure and transfer learning.

Predicting outcomes using neural networks in the intensive care unit

Patients in intensive care units(ICUs)require rapid critical decision making.Modern ICUs are data rich,where information streams from diverse sources.Machine learning(ML)and neural networks(NN)can leverage the rich data for prognostication and clinical care.They can handle complex nonlinear relation-ships in medical data and have advantages over traditional predictive methods.A number of models are used:(1)Feedforward networks;and(2)Recurrent NN and convolutional NN to predict key outcomes such as mortality,length of stay in the ICU and the likelihood of complications.Current NN models exist in silos;their integration into clinical workflow requires greater transparency on data that are analyzed.Most models that are accurate enough for use in clinical care operate as‘black-boxes’in which the logic behind their decision making is opaque.Advan-ces have occurred to see through the opacity and peer into the processing of the black-box.In the near future ML is positioned to help in clinical decision making far beyond what is currently possible.Transparency is the first step toward vali-dation which is followed by clinical trust and adoption.In summary,NNs have the transformative ability to enhance predictive accuracy and improve patient management in ICUs.The concept should soon be turning into reality.

A Generative Adversarial Network with an Attention Spatiotemporal Mechanism for Tropical Cyclone Forecasts

Tropical cyclones(TCs)are complex and powerful weather systems,and accurately forecasting their path,structure,and intensity remains a critical focus and challenge in meteorological research.In this paper,we propose an Attention Spatio-Temporal predictive Generative Adversarial Network(AST-GAN)model for predicting the temporal and spatial distribution of TCs.The model forecasts the spatial distribution of TC wind speeds for the next 15 hours at 3-hour intervals,emphasizing the cyclone's center,high wind-speed areas,and its asymmetric structure.To effectively capture spatiotemporal feature transfer at different time steps,we employ a channel attention mechanism for feature selection,enhancing model performance and reducing parameter redundancy.We utilized High-Resolution Weather Research and Forecasting(HWRF)data to train our model,allowing it to assimilate a wide range of TC motion patterns.The model is versatile and can be applied to various complex scenarios,such as multiple TCs moving simultaneously or TCs approaching landfall.Our proposed model demonstrates superior forecasting performance,achieving a root-mean-square error(RMSE)of 0.71 m s^(-1)for overall wind speed and 2.74 m s^(-1)for maximum wind speed when benchmarked against ground truth data from HWRF.Furthermore,the model underwent optimization and independent testing using ERA5reanalysis data,showcasing its stability and scalability.After fine-tuning on the ERA5 dataset,the model achieved an RMSE of 1.33 m s^(-1)for wind speed and 1.75 m s^(-1)for maximum wind speed.The AST-GAN model outperforms other state-of-the-art models in RMSE on both the HWRF and ERA5 datasets,maintaining its superior performance and demonstrating its effectiveness for spatiotemporal prediction of TCs.

CAN-bus仪表的通讯模块设计

介绍了一种基于CAN总线的自动化仪表的通讯模块的设计方法，该通讯模块可以应用于各种自动化仪表中。