Research status and application of artificial intelligence large models in the oil and gas industry

This article elucidates the concept of large model technology,summarizes the research status of large model technology both domestically and internationally,provides an overview of the application status of large models in vertical industries,outlines the challenges and issues confronted in applying large models in the oil and gas sector,and offers prospects for the application of large models in the oil and gas industry.The existing large models can be briefly divided into three categories:large language models,visual large models,and multimodal large models.The application of large models in the oil and gas industry is still in its infancy.Based on open-source large language models,some oil and gas enterprises have released large language model products using methods like fine-tuning and retrieval augmented generation.Scholars have attempted to develop scenario-specific models for oil and gas operations by using visual/multimodal foundation models.A few researchers have constructed pre-trained foundation models for seismic data processing and interpretation,as well as core analysis.The application of large models in the oil and gas industry faces challenges such as current data quantity and quality being difficult to support the training of large models,high research and development costs,and poor algorithm autonomy and control.The application of large models should be guided by the needs of oil and gas business,taking the application of large models as an opportunity to improve data lifecycle management,enhance data governance capabilities,promote the construction of computing power,strengthen the construction of“artificial intelligence+energy”composite teams,and boost the autonomy and control of large model technology.

Evolution and Prospects of Foundation Models: From Large Language Models to Large Multimodal Models

Since the 1950s,when the Turing Test was introduced,there has been notable progress in machine language intelligence.Language modeling,crucial for AI development,has evolved from statistical to neural models over the last two decades.Recently,transformer-based Pre-trained Language Models(PLM)have excelled in Natural Language Processing(NLP)tasks by leveraging large-scale training corpora.Increasing the scale of these models enhances performance significantly,introducing abilities like context learning that smaller models lack.The advancement in Large Language Models,exemplified by the development of ChatGPT,has made significant impacts both academically and industrially,capturing widespread societal interest.This survey provides an overview of the development and prospects from Large Language Models(LLM)to Large Multimodal Models(LMM).It first discusses the contributions and technological advancements of LLMs in the field of natural language processing,especially in text generation and language understanding.Then,it turns to the discussion of LMMs,which integrates various data modalities such as text,images,and sound,demonstrating advanced capabilities in understanding and generating cross-modal content,paving new pathways for the adaptability and flexibility of AI systems.Finally,the survey highlights the prospects of LMMs in terms of technological development and application potential,while also pointing out challenges in data integration,cross-modal understanding accuracy,providing a comprehensive perspective on the latest developments in this field.

Large animal models for Huntington's disease research

Huntington'sdisease(HD)isahereditary neurodegenerative disorder for which there is currently no effectivetreatmentavailable.Consequently,the development of appropriate disease models is critical to thoroughly investigate disease progression.The genetic basis of HD involves the abnormal expansion of CAG repeats in the huntingtin(HTT)gene,leading to the expansion of a polyglutamine repeat in the HTT protein.Mutant HTT carrying the expanded polyglutamine repeat undergoes misfolding and forms aggregates in the brain,which precipitate selective neuronal loss in specific brain regions.Animal models play an important role in elucidating the pathogenesis of neurodegenerative disorders such as HD and in identifying potential therapeutic targets.Due to the marked species differences between rodents and larger animals,substantial efforts have been directed toward establishing large animal models for HD research.These models are pivotal for advancing the discovery of novel therapeutic targets,enhancing effective drug delivery methods,and improving treatment outcomes.We have explored the advantages of utilizing large animal models,particularly pigs,in previous reviews.Since then,however,significant progress has been made in developing more sophisticated animal models that faithfully replicate the typical pathology of HD.In the current review,we provide a comprehensive overview of large animal models of HD,incorporating recent findings regarding the establishment of HD knock-in(KI)pigs and their genetic therapy.We also explore the utilization of large animal models in HD research,with a focus on sheep,non-human primates(NHPs),and pigs.Our objective is to provide valuable insights into the application of these large animal models for the investigation and treatment of neurodegenerative disorders.

A large language model-powered literature review for high-angle annular dark field imaging

High-angle annular dark field(HAADF)imaging in scanning transmission electron microscopy(STEM)has become an indispensable tool in materials science due to its ability to offer sub-°A resolution and provide chemical information through Z-contrast.This study leverages large language models(LLMs)to conduct a comprehensive bibliometric analysis of a large amount of HAADF-related literature(more than 41000 papers).By using LLMs,specifically ChatGPT,we were able to extract detailed information on applications,sample preparation methods,instruments used,and study conclusions.The findings highlight the capability of LLMs to provide a new perspective into HAADF imaging,underscoring its increasingly important role in materials science.Moreover,the rich information extracted from these publications can be harnessed to develop AI models that enhance the automation and intelligence of electron microscopes.

Shallow Convection Dataset Simulated by Three Different Large Eddy Models

Shallow convection plays an important role in transporting heat and moisture from the near-surface to higher altitudes,yet its parameterization in numerical models remains a great challenge,partly due to the lack of high-resolution observations.This study describes a large eddy simulation(LES)dataset for four shallow convection cases that differ primarily in inversion strength,which can be used as a surrogate for real data.To reduce the uncertainty in LES modeling,three different large eddy models were used,including SAM(System for Atmospheric Modeling),WRF(Weather Research and Forecasting model),and UCLA-LES.Results show that the different models generally exhibit similar behavior for each shallow convection case,despite some differences in the details of the convective structure.In addition to grid-averaged fields,conditionally sampled variables,such as in-cloud moisture and vertical velocity,are also provided,which are indispensable for calculation of the entrainment/detrainment rate.Considering the essentiality of the entraining/detraining process in the parameterization of cumulus convection,the dataset presented in this study is potentially useful for validation and improvement of the parameterization of shallow convection.

Optimization of Fixture Number in Large Thin-Walled Parts Assembly Based on IPSO

There are lots of researches on fixture layout optimization for large thin-walled parts.Current researches focus on the positioning problem,i.e.,optimizing the positions of a constant number of fixtures.However,how to determine the number of fixtures is ignored.In most cases,the number of fixtures located on large thin-walled parts is determined based on engineering experience,which leads to huge fixture number and extra waste.Therefore,this paper constructs an optimization model to minimize the number of fixtures.The constraints are set in the optimization model to ensure that the part deformation is within the surface profile tolerance.In addition,the assembly gap between two parts is also controlled.To conduct the optimization,this paper develops an improved particle swarm optimization(IPSO)algorithm by integrating the shrinkage factor and adaptive inertia weight.In the algorithm,particles are encoded according to the fixture position.Each dimension of the particle is assigned to a sub-region by constraining the optional position range of each fixture to improve the optimization efficiency.Finally,a case study on ship curved panel assembly is provided to prove that our method can optimize the number of fixtures while meeting the assembly quality requirements.This research proposes a method to optimize the number of fixtures,which can reduce the number of fixtures and achieve deformation control at the same time.

Tree mycorrhizal associations determine how biodiversity,large trees,and environmental factors drive aboveground carbon stock in temperate forests

Biodiversity,large trees,and environmental conditions such as climate and soil have important effects on forest carbon stocks.However,recent studies in temperate forests suggest that the relative importance of these factors depends on tree mycorrhizal associations,whereby large-tree effects may be driven by ectomycorrhizal(EM)trees,diversity effects may be driven by arbuscular mycorrhizal(AM)trees,and environment effects may depend on differential climate and soil preferences of AM and EM trees.To test this hypothesis,we used forest-inventory data consisting of over 80,000 trees from 631 temperate-forest plots(30 m×30 m)across Northeast China to examine how biodiversity(species diversity and ecological uniqueness),large trees(top 1%of tree diameters),and environmental factors(climate and soil nutrients)differently regulate aboveground carbon stocks of AM trees,EM trees,and AM and EM trees combined(i.e.total aboveground carbon stock).We found that large trees had a positive effect on both AM and EM tree carbon stocks.However,biodiversity and environmental factors had opposite effects on AM vs.EM tree carbon stocks.Specifically,the two components of biodiversity had positive effects on AM tree carbon stocks,but negative effects on EM tree carbon stocks.Environmental heterogeneity(mean annual temperature and soil nutrients)also exhibited contrasting effects on AM and EM tree carbon stocks.Consequently,for the total carbon stock,the positive large-tree effect far surpasses the diversity and environment effect.This is mainly because when integrating AM and EM tree carbon stock into total carbon stock,the opposite diversity-effect(also environment-effect)on AM vs.EM tree carbon stock counteracts each other while the consistent positive large-tree effect on AM and EM tree carbon stock is amplified.In summary,this study emphasized a mycorrhizal viewpoint to better understand the determinants of overarching aboveground carbon profile across regional forests.

Case study on the mechanics of NPR anchor cable compensation for large deformation tunnel in soft rock in the Transverse Mountain area,China

A study was conducted to analyze the deformation mechanism of strongly weathered quartz schist in the Daliangshan Tunnel,located in the western Transverse Mountain area.A large deformation problem was experienced during the tunnel construction.To mitigate this problem,a support system was designed incorporating negative Poisson ratio(NPR)anchor cables with negative Poisson ratio effect.Physical model experiments,field experiments,and numerical simulation experiments were conducted to investigate the compensation mechanical behavior of NPR anchor cables.The large deformations of soft rocks in the Daliangshan Tunnel are caused by a high ground stress,a high degree of joint fracture development,and a high degree of surrounding rock fragmentation.A compensation mechanics support system combining long and short NPR anchor cables was suggested to provide sufficient counter-support force(approximately 350 kN)for the surrounding rock inside the tunnel.Comparing the NPR anchor cable support system with the original support system used in the Daliangshan tunnel showed that an NPR anchor cable support system,combining cables of 6.3 m and 10.3 m in length,effectively prevented convergence of surrounding rock deformation,and the integrated settlement convergence value remained below 300 mm.This study provides an effective scientific basis for resolving large deformation problems in deeply buried soft rocks in western transverse mountain areas.

Features of sampling stream sediments of large river valleys under cryolithogenesis conditions in the Balygychan-Sugoy trough,North-East of Russia

Comprehensive research has been implemented to raise the efficiency of the geochemical survey of stream sediments(SSs)that formed under the cryolithogenesis conditions.The authors analysed the composition,structure and specific features of the formation of exogenous anomalous geochemical fields(AGFs)identified through SSs of large river valleys of IV order.In our case,these were the valleys of Maly Ken,Ken and Tap Rivers.These rivers are located in the central and southern parts of the Balygychan-Sugoy trough enclosed in the Magadan region,North-East of Russia.The authors proposed a new technique to sample loose alluvium of SSs in the large river valleys along the profiles.The profiles were located across the valleys.The AGFs of Au,Ag,Pb,Zn,Sn,Bi,Mo and W were studied.Correlations between elements have been established.These elements are the main indicator elements of Au-Ag,Ag-Pb,Sn-Ag,Mo-W and Sn-W mineralization occurring on the sites under study.The results obtained were compared with the results of geochemical surveys of SSs.It is concluded that the AGFs recognized along the profiles reflect the composition and structure of eroded and drained ore zones,uncover completely and precisely the pattern of element distribution in loose sediments of large water flows.The alluvium fraction<0.25 mm seems to be most significant in a practical sense,as it concentrated numerous ore elements.Sampling of this fraction in the river valleys of IV order does not cause any difficulty,for this kind of material is plentiful.The developed technique of alluvium sampling within large river valleys is efficient in searching for diverse mineralization at all stages of prognostic prospecting.It is applicable for geochemical survey of SSs performed at different scales both in the North-East of Russia,as well as other regions with similar climatic conditions,where the SSs are formed under the cryolithogenesis conditions.

The influence of inter-band rock on rib spalling in longwall panel with large mining height

In order to improve rib stability,failure criteria and instability mode of a thick coal seam with inter-band rock layer are analysed in this study.A three-dimensional mechanical model is established for the rib by considering the rock layer.A safety factor is defined foy the rib,and it is observed that the safety factor exhibits a positive correlation with the thickness and strength of the inter-band rock.A calculation method for determining critical parameters of the rock layer is presented to ensure the rib stability.It is revealed that incomplete propagation of the fracture at the hard rock constitutes a fundamental prerequisite for ensuring the rib stability.The influence of the position of the inter-band rock in the coal seam on failure mechanism of the rib was thoroughly investigated by developing a series of physical models for the rib at the face area.The best position for the inter-band rock in the coal seam is at a height of 1.5 m away from the roof line,which tends to provide a good stability state for the rib.For different inter-band rock positions,two ways of controlling rib by increasing supports stiffness and flexible grouting reinforcement are proposed.

The Immense Impact of Reverse Edges on Large Hierarchical Networks

Hierarchical networks are frequently encountered in animal groups,gene networks,and artificial engineering systems such as multiple robots,unmanned vehicle systems,smart grids,wind farm networks,and so forth.The structure of a large directed hierarchical network is often strongly influenced by reverse edges from lower-to higher-level nodes,such as lagging birds’howl in a flock or the opinions of lowerlevel individuals feeding back to higher-level ones in a social group.This study reveals that,for most large-scale real hierarchical networks,the majority of the reverse edges do not affect the synchronization process of the entire network;the synchronization process is influenced only by a small part of these reverse edges along specific paths.More surprisingly,a single effective reverse edge can slow down the synchronization of a huge hierarchical network by over 60%.The effect of such edges depends not on the network size but only on the average in-degree of the involved subnetwork.The overwhelming majority of active reverse edges turn out to have some kind of“bunching”effect on the information flows of hierarchical networks,which slows down synchronization processes.This finding refines the current understanding of the role of reverse edges in many natural,social,and engineering hierarchical networks,which might be beneficial for precisely tuning the synchronization rhythms of these networks.Our study also proposes an effective way to attack a hierarchical network by adding a malicious reverse edge to it and provides some guidance for protecting a network by screening out the specific small proportion of vulnerable nodes.

Effect of annealing temperature on microstructure and mechanical properties of Mg-Zn-Zr-Nd alloy with large final rolling deformation

In this study,the Mg-3Zn-0.5Zr-χNd(χ=0,0.6)alloys were subjected to final rolling treatment with large deformation of 50%.The impact of annealing temperatures on the microstructure and mechanical properties was investigated.The rolled Mg-3Zn-0.5Zr-0.6Nd alloy exhibited an ultimate tensile strength of 386 MPa,a yield strength of 361 MPa,and an elongation of 7.1%.Annealing at different temperatures resulted in reduced strength and obviously increased elongation for both alloys.Optimal mechanical properties for the Mg-3Zn-0.5Zr-0.6Nd alloy were achieved after annealing at 200℃,with an ultimate tensile strength of 287 MPa,a yield strength of 235 MPa,and an elongation of 26.1%.The numerous deformed microstructures,twins,and precipitated phases in the rolled alloy could impede the deformation at room temperature and increase the work hardening rate.After annealing,a decrease in the work hardening effect and an increase in the dynamic recovery effect were obtained due to the formation of fine equiaxed grains,and the increased volume fraction of precipitated phases,which significantly improved the elongation of the alloy.Additionally,the addition of Nd element could enhance the annealing recrystallization rate,reduce the Schmid factor difference between basal and prismatic slip systems,facilitate multi-system slip initiation and improve the alloy plasticity.

Improvement in Tol2 transposon for efficient large-cargo capacity transgene applications in cultured cells and zebrafish(Danio rerio)

Most viruses and transposons serve as effective carriers for the introduction of foreign DNA up to 11 kb into vertebrate genomes.However,their activity markedly diminishes with payloads exceeding 11 kb.Expanding the payload capacity of transposons could facilitate more sophisticated cargo designs,improving the regulation of expression and minimizing mutagenic risks associated with molecular therapeutics,metabolic engineering,and transgenic animal production.In this study,we improved the Tol2 transposon by increasing protein expression levels using a translational enhancer(QBI SP163,ST)and enhanced the nuclear targeting ability using the nuclear localization protein H2B(SHT).The modified Tol2 and ST transposon efficiently integrated large DNA cargos into human cell cultures(H1299),comparable to the well-established super PiggyBac system.Furthermore,mRNA from ST and SHT showed a significant increase in transgene delivery efficiency of large DNA payloads(8 kb,14 kb,and 24 kb)into zebrafish(Danio rerio).This study presents a modified Tol2 transposon as an enhanced nonviral vector for the delivery of large DNA payloads in transgenic applications.

Thin-walled and large-sized magnesium alloy die castings for passenger car cockpit:Application,materials,and manufacture

In order to effectively reduce energy consumption and increase range mile,new energy vehicles represented by Tesla have greatly aroused the application of integrated magnesium(Mg)alloy die casting technology in automobiles.Previously,the application of Mg alloys in automobiles,especially in automotive cockpit components,is quite extensive,while it has almost disappeared for a period of time due to its relatively high cost,causing a certain degree of information loss in the application technology of Mg alloy parts in automobiles.The rapid development of automotive technology has led to a higher requirement for the automotive components compared with those traditional one.Therefore,whatever the components themselves,or the Mg alloy materials and die casting process have to face an increasing challenge,needing to be upgraded.In addition,owing to its high integration characteristics,the application of Mg alloy die casting technology in large-sized and thin-walled automotive parts has inherent advantages and needs to be expanded urgently.Indeed,it necessitates exploring advance Mg alloys and new product structures and optimizing die casting processes.This article summarizes and analyzes the development status of thin-walled and large-sized die casting Mg alloy parts in passenger car cockpit and corresponding material selection methods,die casting processes as well as mold design techniques.Furthermore,this work will aid researchers in establishing a comprehensive understanding of the manufacture of thin-walled and large-sized die casting Mg alloy parts in automobile cockpit.It will also assist them in developing new Mg alloys with improved comprehensive performance and new processes to meet the high requirements for die casting automotive components.

Frontogenesis and Frontolysis of a Cold Filament Driven by the Cross-Filament Wind and Wave Fields Simulated by a Large Eddy Simulation

The variations of the frontogenetic trend of a cold filament induced by the cross-filament wind and wave fields are studied by a non-hydrostatic large eddy simulation. Five cases with different strengths of wind and wave fields are studied.The results show that the intense wind and wave fields further break the symmetries of submesoscale flow fields and suppress the levels of filament frontogenesis. The changes of secondary circulation directions—that is, the conversion between the convergence and divergence of the surface cross-filament currents with the downwelling and upwelling jets in the filament center—are associated with the inertial oscillation. The filament frontogenesis and frontolysis caused by the changes of secondary circulation directions may periodically sharpen and smooth the gradient of submesoscale flow fields.The lifecycle of the cold filament may include multiple stages of filament frontogenesis and frontolysis.

Multi-blade rubbing characteristics of the shaft-disk-blade-casing system with large rotation

Blade rubbing faults cause detrimental impact on the operation of aeroengines. Most of the existing studies on blade rubbing in the shaft-disk-blade-casing(SDBC) system have overlooked the elastic deformation of the blade, while some only consider the whirl of the rotor, neglecting its spin. To address these limitations, this paper proposes a dynamic model with large rotation for the SDBC system. The model incorporates the spin and whirl of the rotor, enabling the realistic reproduction of multiblade rubbing faults. To verify the accuracy of the SDBC model with large rotation and demonstrate its capability to effectively consider the rotational effects such as the centrifugal stiffening and gyroscopic effects, the natural characteristics and dynamic responses of the proposed model are compared with those obtained from reported research and experimental results. Furthermore, the effects of the rotating speed, contact stiffness,and blade number on the dynamic characteristics of the SDBC system with multi-blade rubbing are investigated. The results indicate that the phase angle between the rotor deflection and the unbalance excitation force increases with the increasing rotating speed,which significantly influences the rubbing penetration of each blade. The natural frequency of the SDBC system with rubbing constrain can be observed in the acceleration response of the casing and the torsional response of the shaft, and the frequency is related to the contact stiffness. Moreover, the vibration amplitude increases significantly with the product of the blade number under rubbing, and the rotating frequency approaches the natural frequency of the SDBC system. The proposed model can provide valuable insight for the fault diagnosis of rubbing in bladed rotating machinery.

DeBERTa-GRU: Sentiment Analysis for Large Language Model

Modern technological advancements have made social media an essential component of daily life.Social media allow individuals to share thoughts,emotions,and ideas.Sentiment analysis plays the function of evaluating whether the sentiment of the text is positive,negative,neutral,or any other personal emotion to understand the sentiment context of the text.Sentiment analysis is essential in business and society because it impacts strategic decision-making.Sentiment analysis involves challenges due to lexical variation,an unlabeled dataset,and text distance correlations.The execution time increases due to the sequential processing of the sequence models.However,the calculation times for the Transformer models are reduced because of the parallel processing.This study uses a hybrid deep learning strategy to combine the strengths of the Transformer and Sequence models while ignoring their limitations.In particular,the proposed model integrates the Decoding-enhanced with Bidirectional Encoder Representations from Transformers(BERT)attention(DeBERTa)and the Gated Recurrent Unit(GRU)for sentiment analysis.Using the Decoding-enhanced BERT technique,the words are mapped into a compact,semantic word embedding space,and the Gated Recurrent Unit model can capture the distance contextual semantics correctly.The proposed hybrid model achieves F1-scores of 97%on the Twitter Large Language Model(LLM)dataset,which is much higher than the performance of new techniques.

Multi-environment BSA-seq using large F3 populations is able to achieve reliable QTL mapping with high power and resolution: An experimental demonstration in rice

Bulked-segregant analysis by deep sequencing(BSA-seq) is a widely used method for mapping QTL(quantitative trait loci) due to its simplicity, speed, cost-effectiveness, and efficiency. However, the ability of BSA-seq to detect QTL is often limited by inappropriate experimental designs, as evidenced by numerous practical studies. Most BSA-seq studies have utilized small to medium-sized populations, with F2populations being the most common choice. Nevertheless, theoretical studies have shown that using a large population with an appropriate pool size can significantly enhance the power and resolution of QTL detection in BSA-seq, with F_(3)populations offering notable advantages over F2populations. To provide an experimental demonstration, we tested the power of BSA-seq to identify QTL controlling days from sowing to heading(DTH) in a 7200-plant rice F_(3)population in two environments, with a pool size of approximately 500. Each experiment identified 34 QTL, an order of magnitude greater than reported in most BSA-seq experiments, of which 23 were detected in both experiments, with 17 of these located near41 previously reported QTL and eight cloned genes known to control DTH in rice. These results indicate that QTL mapping by BSA-seq in large F_(3)populations and multi-environment experiments can achieve high power, resolution, and reliability.

Microstructure and properties of 35 kg large aluminum alloy flywheel housing components formed by squeeze casting with local pressure compensation

The squeeze casting method with local pressure compensation was proposed to form a flywheel housing component with a weight of 35 kg.The numerical simulation,microstructure observation and phase characterization were performed,and the influence of local pressure compensation on feeding of thick-wall position,microstructure and mechanical properties of the formed components were discussed.Results show that the molten metal keeps a good fluidity and the filling is complete during the filling process.Although the solidification at thick-wall positions of the mounting ports is slow,the local pressure compensation effectively realizes the local forced feeding,significantly eliminating the shrinkage cavity defects.In the microstructure of AlSi9Mg alloy,α-Al primarily consists of fragmented dendrites and rosette grains,while eutectic Si predominantly comprises needles and short rods.The impact of local pressure compensation on strength is relatively minimal,yet its influence on elongation is considerable.Following local pressure compensation,the average elongation at the compensated areas is 9.18%,which represents a 44.90%higher than that before compensation.The average tensile strength is 209.1 MPa,and the average yield strength is 100.6 MPa.The local pressure compensation can significantly reduce or even eliminate the internal defects in the 35 kg large-weight components formed by squeeze casting.

Computing large deviation prefactors of stochastic dynamical systems based on machine learning

We present a large deviation theory that characterizes the exponential estimate for rare events in stochastic dynamical systems in the limit of weak noise.We aim to consider a next-to-leading-order approximation for more accurate calculation of the mean exit time by computing large deviation prefactors with the aid of machine learning.More specifically,we design a neural network framework to compute quasipotential,most probable paths and prefactors based on the orthogonal decomposition of a vector field.We corroborate the higher effectiveness and accuracy of our algorithm with two toy models.Numerical experiments demonstrate its powerful functionality in exploring the internal mechanism of rare events triggered by weak random fluctuations.