GeoNER:Geological Named Entity Recognition with Enriched Domain Pre-Training Model and Adversarial Training

As important geological data,a geological report contains rich expert and geological knowledge,but the challenge facing current research into geological knowledge extraction and mining is how to render accurate understanding of geological reports guided by domain knowledge.While generic named entity recognition models/tools can be utilized for the processing of geoscience reports/documents,their effectiveness is hampered by a dearth of domain-specific knowledge,which in turn leads to a pronounced decline in recognition accuracy.This study summarizes six types of typical geological entities,with reference to the ontological system of geological domains and builds a high quality corpus for the task of geological named entity recognition(GNER).In addition,Geo Wo BERT-adv BGP(Geological Word-base BERTadversarial training Bi-directional Long Short-Term Memory Global Pointer)is proposed to address the issues of ambiguity,diversity and nested entities for the geological entities.The model first uses the fine-tuned word granularitybased pre-training model Geo Wo BERT(Geological Word-base BERT)and combines the text features that are extracted using the Bi LSTM(Bi-directional Long Short-Term Memory),followed by an adversarial training algorithm to improve the robustness of the model and enhance its resistance to interference,the decoding finally being performed using a global association pointer algorithm.The experimental results show that the proposed model for the constructed dataset achieves high performance and is capable of mining the rich geological information.

A Modified CycleGAN for Multi-Organ Ultrasound Image Enhancement via Unpaired Pre-Training

Handheld ultrasound devices are known for their portability and affordability,making them widely utilized in underdeveloped areas and community healthcare for rapid diagnosis and early screening.However,the image quality of handheld ultrasound devices is not always satisfactory due to the limited equipment size,which hinders accurate diagnoses by doctors.At the same time,paired ultrasound images are difficult to obtain from the clinic because imaging process is complicated.Therefore,we propose a modified cycle generative adversarial network(cycleGAN) for ultrasound image enhancement from multiple organs via unpaired pre-training.We introduce an ultrasound image pre-training method that does not require paired images,alleviating the requirement for large-scale paired datasets.We also propose an enhanced block with different structures in the pre-training and fine-tuning phases,which can help achieve the goals of different training phases.To improve the robustness of the model,we add Gaussian noise to the training images as data augmentation.Our approach is effective in obtaining the best quantitative evaluation results using a small number of parameters and less training costs to improve the quality of handheld ultrasound devices.

Enhancing Relational Triple Extraction in Specific Domains:Semantic Enhancement and Synergy of Large Language Models and Small Pre-Trained Language Models

In the process of constructing domain-specific knowledge graphs,the task of relational triple extraction plays a critical role in transforming unstructured text into structured information.Existing relational triple extraction models facemultiple challenges when processing domain-specific data,including insufficient utilization of semantic interaction information between entities and relations,difficulties in handling challenging samples,and the scarcity of domain-specific datasets.To address these issues,our study introduces three innovative components:Relation semantic enhancement,data augmentation,and a voting strategy,all designed to significantly improve the model’s performance in tackling domain-specific relational triple extraction tasks.We first propose an innovative attention interaction module.This method significantly enhances the semantic interaction capabilities between entities and relations by integrating semantic information fromrelation labels.Second,we propose a voting strategy that effectively combines the strengths of large languagemodels(LLMs)and fine-tuned small pre-trained language models(SLMs)to reevaluate challenging samples,thereby improving the model’s adaptability in specific domains.Additionally,we explore the use of LLMs for data augmentation,aiming to generate domain-specific datasets to alleviate the scarcity of domain data.Experiments conducted on three domain-specific datasets demonstrate that our model outperforms existing comparative models in several aspects,with F1 scores exceeding the State of the Art models by 2%,1.6%,and 0.6%,respectively,validating the effectiveness and generalizability of our approach.

The Citron homology domain of MAP4Ks improves outcomes of traumatic brain injury

The mitogen-activated protein kinase kinase kinase kinases(MAP4Ks)signaling pathway plays a pivotal role in axonal regrowth and neuronal degeneration following insults.Whether targeting this pathway is beneficial to brain injury remains unclear.In this study,we showed that adeno-associated virus-delivery of the Citron homology domain of MAP4Ks effectively reduces traumatic brain injury-induced reactive gliosis,tauopathy,lesion size,and behavioral deficits.Pharmacological inhibition of MAP4Ks replicated the ameliorative effects observed with expression of the Citron homology domain.Mechanistically,the Citron homology domain acted as a dominant-negative mutant,impeding MAP4K-mediated phosphorylation of the dishevelled proteins and thereby controlling the Wnt/β-catenin pathway.These findings implicate a therapeutic potential of targeting MAP4Ks to alleviate the detrimental effects of traumatic brain injury.

Interaction of major facilitator superfamily domain containing 2A with the blood-brain barrier

The functional and structural integrity of the blood-brain barrier is crucial in maintaining homeostasis in the brain microenvironment;however,the molecular mechanisms underlying the formation and function of the blood-brain barrier remain poorly understood.The major facilitator superfamily domain containing 2A has been identified as a key regulator of blood-brain barrier function.It plays a critical role in promoting and maintaining the formation and functional stability of the blood-brain barrier,in addition to the transport of lipids,such as docosahexaenoic acid,across the blood-brain barrier.Furthermore,an increasing number of studies have suggested that major facilitator superfamily domain containing 2A is involved in the molecular mechanisms of blood-brain barrier dysfunction in a variety of neurological diseases;however,little is known regarding the mechanisms by which major facilitator superfamily domain containing 2A affects the blood-brain barrier.This paper provides a comprehensive and systematic review of the close relationship between major facilitator superfamily domain containing 2A proteins and the blood-brain barrier,including their basic structures and functions,cross-linking between major facilitator superfamily domain containing 2A and the blood-brain barrier,and the in-depth studies on lipid transport and the regulation of blood-brain barrier permeability.This comprehensive systematic review contributes to an in-depth understanding of the important role of major facilitator superfamily domain containing 2A proteins in maintaining the structure and function of the blood-brain barrier and the research progress to date.This will not only help to elucidate the pathogenesis of neurological diseases,improve the accuracy of laboratory diagnosis,and optimize clinical treatment strategies,but it may also play an important role in prognostic monitoring.In addition,the effects of major facilitator superfamily domain containing 2A on blood-brain barrier leakage in various diseases and the research progress on cross-blood-brain barrier drug delivery are summarized.This review may contribute to the development of new approaches for the treatment of neurological diseases.

Effective distributed convolutional neural network architecture for remote sensing images target classification with a pre-training approach

How to recognize targets with similar appearances from remote sensing images(RSIs) effectively and efficiently has become a big challenge. Recently, convolutional neural network(CNN) is preferred in the target classification due to the powerful feature representation ability and better performance. However,the training and testing of CNN mainly rely on single machine.Single machine has its natural limitation and bottleneck in processing RSIs due to limited hardware resources and huge time consuming. Besides, overfitting is a challenge for the CNN model due to the unbalance between RSIs data and the model structure.When a model is complex or the training data is relatively small,overfitting occurs and leads to a poor predictive performance. To address these problems, a distributed CNN architecture for RSIs target classification is proposed, which dramatically increases the training speed of CNN and system scalability. It improves the storage ability and processing efficiency of RSIs. Furthermore,Bayesian regularization approach is utilized in order to initialize the weights of the CNN extractor, which increases the robustness and flexibility of the CNN model. It helps prevent the overfitting and avoid the local optima caused by limited RSI training images or the inappropriate CNN structure. In addition, considering the efficiency of the Na¨?ve Bayes classifier, a distributed Na¨?ve Bayes classifier is designed to reduce the training cost. Compared with other algorithms, the proposed system and method perform the best and increase the recognition accuracy. The results show that the distributed system framework and the proposed algorithms are suitable for RSIs target classification tasks.

Pre-training Assessment Through the Web

Web-based training is growing quickly in popularit y for professionals in industrial organizations and large enterprises. The savings in cost and time are significant. The instructor-led trainings are bounded by time and place, not to mention the cost involved in traveling, accommodation and training venue. However, in the most online training courses, all trainees are given same training materials and teaching paradigms. The problem of differentia ting the trainees’ abilities is the main concern. We need a pre-training test t o identify and classify of the weaknesses and strengths of differentiate trainee s so as to devise an appropriate training programs for the trainees. Adaptation of a Web-based Computer adaptive Test (CAT) for the pre-training test make the web-based training more efficient. The advantages of CAT are self-pacing, eff iciency, time and cost saving, immediate scoring and feedback, accuracy and secu rity, etc (Rudner, 1998; UMN, 1999; Novell, 2000; Linacre, 2000; Windowsglore, 2 000). Moreover, Web-based CAT also gives greater flexibility and convenience. T his paper describes how this CAT tool is built, how it helps instructor identify the strengths and weaknesses of trainees, and how to assure quality on the CAT system.

Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Delineating homogeneous domains of fractured rocks using topological manifolds and deep learning

Determining homogeneous domains statistically is helpful for engineering geological modeling and rock mass stability evaluation.In this text,a technique that can integrate lithology,geotechnical and structural information is proposed to delineate homogeneous domains.This technique is then applied to a high and steep slope along a road.First,geological and geotechnical domains were described based on lithology,faults,and shear zones.Next,topological manifolds were used to eliminate the incompatibility between orientations and other parameters(i.e.trace length and roughness)so that the data concerning various properties of each discontinuity can be matched and characterized in the same Euclidean space.Thus,the influence of implicit combined effect in between parameter sequences on the homogeneous domains could be considered.Deep learning technique was employed to quantify abstract features of the characterization images of discontinuity properties,and to assess the similarity of rock mass structures.The results show that the technique can effectively distinguish structural variations and outperform conventional methods.It can handle multisource engineering geological information and multiple discontinuity parameters.This technique can also minimize the interference of human factors and delineate homogeneous domains based on orientations or multi-parameter with arbitrary distributions to satisfy different engineering requirements.

Consistency between domain wall oscillation modes and spin wave modes in nanostrips

Investigations on domain wall(DW) and spin wave(SW) modes in a series of nanostrips with different widths and thicknesses have been carried out using micromagnetic simulation. The simulation results show that the frequencies of SW modes and the corresponding DW modes are consistent with each other if they have the same node number along the width direction. This consistency is more pronounced in wide and thin nanostrips, favoring the DW motion driven by SWs.Further analysis of the moving behavior of a DW driven by SWs is also carried out. The average DW speed can reach a larger value of ~ 140 m/s under two different SW sources. We argue that this study is very meaningful for the potential application of DW motion driven by SWs.

Mapping the antiparallel aligned domain rotation by microwave excitation

The evolution process of magnetic domains in response to external fields is crucial for the modern understanding and application of spintronics.In this study,we investigated the domain rotation in stripe domain films of varying thicknesses by examining their response to microwave excitation in four different orientations.The resonance spectra indicate that the rotation field of stripe domain film under an applied magnetic field approaches the field where the resonance mode of sample changes.The saturation field of the stripe domain film corresponds to the field where the resonance mode disappears when measured in the stripe direction parallel to the microwave magnetic field.The results are reproducible and consistent with micromagnetic simulations,providing additional approaches and techniques for comprehending the microscopic mechanisms of magnetic domains and characterizing their rotation.

Low-Rank Optimal Transport for Robust Domain Adaptation

When encountering the distribution shift between the source(training) and target(test) domains, domain adaptation attempts to adjust the classifiers to be capable of dealing with different domains. Previous domain adaptation research has achieved a lot of success both in theory and practice under the assumption that all the examples in the source domain are welllabeled and of high quality. However, the methods consistently lose robustness in noisy settings where data from the source domain have corrupted labels or features which is common in reality. Therefore, robust domain adaptation has been introduced to deal with such problems. In this paper, we attempt to solve two interrelated problems with robust domain adaptation:distribution shift across domains and sample noises of the source domain. To disentangle these challenges, an optimal transport approach with low-rank constraints is applied to guide the domain adaptation model training process to avoid noisy information influence. For the domain shift problem, the optimal transport mechanism can learn the joint data representations between the source and target domains using a measurement of discrepancy and preserve the discriminative information. The rank constraint on the transport matrix can help recover the corrupted subspace structures and eliminate the noise to some extent when dealing with corrupted source data. The solution to this relaxed and regularized optimal transport framework is a convex optimization problem that can be solved using the Augmented Lagrange Multiplier method, whose convergence can be mathematically proved. The effectiveness of the proposed method is evaluated through extensive experiments on both synthetic and real-world datasets.

Multiple Matching Attenuation Based on Curvelet Domain Extended Filtering

The paper develops a multiple matching attenuation method based on extended filtering in the curvelet domain,which combines the traditional Wiener filtering method with the matching attenuation method in curvelet domain.Firstly,the method uses the predicted multiple data to generate the Hilbert transform records,time derivative records and time derivative records of Hilbert transform.Then,the above records are transformed into the curvelet domain and multiple matching attenuation based on least squares extended filtering is performed.Finally,the attenuation results are transformed back into the time-space domain.Tests on the model data and field data show that the method proposed in the paper effectively suppress the multiples while preserving the primaries well.Furthermore,it has higher accuracy in eliminating multiple reflections,which is more suitable for the multiple attenuation tasks in the areas with complex structures compared to the time-space domain extended filtering method and the conventional curvelet transform method.

BIG HANKEL OPERATORS ON HARDY SPACES OF STRONGLY PSEUDOCONVEX DOMAINS

In this article,we investigate the(big) Hankel operator H_(f) on the Hardy spaces of bounded strongly pseudoconvex domains Ω in C^(n).We observe that H_(f ) is bounded on H~p(Ω)(1 <p <∞) if f belongs to BMO and we obtain some characterizations for Hf on H^(2)(Ω) of other pseudoconvex domains.In these arguments,Amar's L^(p)-estimations and Berndtsson's L^(2)-estimations for solutions of the ■_(b)-equation play a crucial role.In addition,we solve Gleason's problem for Hardy spaces H^(p)(Ω)(1 ≤p≤∞) of bounded strongly pseudoconvex domains.

Complementary-Label Adversarial Domain Adaptation Fault Diagnosis Network under Time-Varying Rotational Speed and Weakly-Supervised Conditions

Recent research in cross-domain intelligence fault diagnosis of machinery still has some problems,such as relatively ideal speed conditions and sample conditions.In engineering practice,the rotational speed of the machine is often transient and time-varying,which makes the sample annotation increasingly expensive.Meanwhile,the number of samples collected from different health states is often unbalanced.To deal with the above challenges,a complementary-label(CL)adversarial domain adaptation fault diagnosis network(CLADAN)is proposed under time-varying rotational speed and weakly-supervised conditions.In the weakly supervised learning condition,machine prior information is used for sample annotation via cost-friendly complementary label learning.A diagnosticmodel learning strategywith discretized category probabilities is designed to avoidmulti-peak distribution of prediction results.In adversarial training process,we developed virtual adversarial regularization(VAR)strategy,which further enhances the robustness of the model by adding adversarial perturbations in the target domain.Comparative experiments on two case studies validated the superior performance of the proposed method.

ON THE SOBOLEV DOLBEAULT COHOMOLOGY OF A DOMAIN WITH PSEUDOCONCAVE BOUNDARIES

In this note,we mainly make use of a method devised by Shaw[15]for studying Sobolev Dolbeault cohomologies of a pseudoconcave domain of the type Ω=Ω\∪_(j=1^(m))Ω_(j),where Ω and {Ω_(j)}_(j=1^(m)■Ω are bounded pseudoconvex domains in ℂ^(n) with smooth boundaries,and Ω_(1),…,Ω_(m) are mutually disjoint.The main results can also be quickly obtained by virtue of[5].

Diabetic retinopathy identification based on multi-sourcefree domain adaptation

AIM:To address the challenges of data labeling difficulties,data privacy,and necessary large amount of labeled data for deep learning methods in diabetic retinopathy(DR)identification,the aim of this study is to develop a source-free domain adaptation(SFDA)method for efficient and effective DR identification from unlabeled data.METHODS:A multi-SFDA method was proposed for DR identification.This method integrates multiple source models,which are trained from the same source domain,to generate synthetic pseudo labels for the unlabeled target domain.Besides,a softmax-consistence minimization term is utilized to minimize the intra-class distances between the source and target domains and maximize the inter-class distances.Validation is performed using three color fundus photograph datasets(APTOS2019,DDR,and EyePACS).RESULTS:The proposed model was evaluated and provided promising results with respectively 0.8917 and 0.9795 F1-scores on referable and normal/abnormal DR identification tasks.It demonstrated effective DR identification through minimizing intra-class distances and maximizing inter-class distances between source and target domains.CONCLUSION:The multi-SFDA method provides an effective approach to overcome the challenges in DR identification.The method not only addresses difficulties in data labeling and privacy issues,but also reduces the need for large amounts of labeled data required by deep learning methods,making it a practical tool for early detection and preservation of vision in diabetic patients.

Magnetic domain structures in ultrathin Bi_(2)Te_(3)/CrTe_(2) heterostructures

Chromium tellurium compounds are important two-dimensional van der Waals ferromagnetic materials with high Curie temperature and chemical stability in air,which is promising for applications in spintronic devices.Here,highquality spin-orbital-torque(SOT)device,Bi_(2)Te_(3)/CrTe_(2)heterostructure was epitaxially grown on Al_(2)O_(3)(0001)substrates.Anomalous Hall measurements indicate the existence of strong ferromagnetism in this device with the CrTe_(2)thickness down to 10 nm.In order to investigate its micromagnetic structure,cryogenic magnetic force microscope(MFM)was utilized to measure the magnetic domain evolutions at various temperatures and magnetic fields.The virgin domain state of the device shows a worm-like magnetic domain structure with the size around 0.6μm-0.8μm.Larger irregular-shape magnetic domains(>1μm)can be induced and pinned,after the field is increased to coercive field and ramped back to low fields.The temperature-dependent MFM signals exhibit a nice mean-field-like ferromagnetic transition with Curie temperature around 201.5 K,indicating a robust ferromagnetic ordering.Such a device can be potentially implemented in future magnetic memory technology.

MINIMIZERS OF L^(2)-SUBCRITICAL VARIATIONAL PROBLEMS WITH SPATIALLY DECAYING NONLINEARITIES IN BOUNDED DOMAINS

This paper is concerned with the minimizers of L^(2)-subcritical constraint variar tional problems with spatially decaying nonlinearities in a bounded domain Ω of R~N(N≥1).We prove that the problem admits minimizers for any M> 0.Moreover,the limiting behavior of minimizers as M→∞ is also analyzed rigorously.

Spatial correlations in time and frequency domains between chlorophyll-a concentration and environmental factors in the Bohai Sea

Based on the reconstructed MODIS data and ECMWF reanalysis data from 2003 to 2021,spatial correlations between chlorophyll a(Chl a)and sea surface temperature(SST),photosynthetically available radiation(PAR),aerosol optical thickness(AOT),and wind speed(WS)in the Bohai Sea were analyzed from the perspective of time domain and frequency domain.Results indicate that the frequency domain analysis was more conducive to revealing the correlations between Chl a and environmental factors.The spatial pattern of time-domain correlations was similar to the isobaths of the Bohai Sea,which was positive in shallow waters and negative in deep waters for SST,PAR,and AOT,and was reversed for WS.Frequency-domain correlations were obtained by performing Fourier Transform and were higher than correlations in time domain.The spatial distributions indicated that the effects of SST and PAR on Chl a were greater than AOT and WS in the Bohai Sea.Additionally,cross-spectrum analysis was applied to explore the response relationships.A depth-dependent pattern was shown in correlations and time lags,indicating that the influential mechanism of environmental factors on Chl-a concentration is related to seawater depth.