Evolution and Prospects of Foundation Models: From Large Language Models to Large Multimodal Models

Since the 1950s,when the Turing Test was introduced,there has been notable progress in machine language intelligence.Language modeling,crucial for AI development,has evolved from statistical to neural models over the last two decades.Recently,transformer-based Pre-trained Language Models(PLM)have excelled in Natural Language Processing(NLP)tasks by leveraging large-scale training corpora.Increasing the scale of these models enhances performance significantly,introducing abilities like context learning that smaller models lack.The advancement in Large Language Models,exemplified by the development of ChatGPT,has made significant impacts both academically and industrially,capturing widespread societal interest.This survey provides an overview of the development and prospects from Large Language Models(LLM)to Large Multimodal Models(LMM).It first discusses the contributions and technological advancements of LLMs in the field of natural language processing,especially in text generation and language understanding.Then,it turns to the discussion of LMMs,which integrates various data modalities such as text,images,and sound,demonstrating advanced capabilities in understanding and generating cross-modal content,paving new pathways for the adaptability and flexibility of AI systems.Finally,the survey highlights the prospects of LMMs in terms of technological development and application potential,while also pointing out challenges in data integration,cross-modal understanding accuracy,providing a comprehensive perspective on the latest developments in this field.

Literature Review, Meta-Analysis, and Mega-Analysis in Ecological and Agricultural Sciences

Literature review is an important component in any scientific research. In ecological and agricultural sciences, many studies have been conducted over years. With accumulation of scientific studies and published papers, it is critical to summarize and evaluate these previous research findings. Different literature review methods have been applied, including traditional qualitative literature review, quantitative meta-analysis, and more recently, mega-analysis, or meta-meta-analysis. Here we briefly describe these different approaches and draw attention to the recent development of data synthesis. Several case studies were used to illustrate the application of these methods in the ecological and agricultural sciences.

Improved Data Stream Clustering Method: Incorporating KD-Tree for Typicality and Eccentricity-Based Approach

Data stream clustering is integral to contemporary big data applications.However,addressing the ongoing influx of data streams efficiently and accurately remains a primary challenge in current research.This paper aims to elevate the efficiency and precision of data stream clustering,leveraging the TEDA(Typicality and Eccentricity Data Analysis)algorithm as a foundation,we introduce improvements by integrating a nearest neighbor search algorithm to enhance both the efficiency and accuracy of the algorithm.The original TEDA algorithm,grounded in the concept of“Typicality and Eccentricity Data Analytics”,represents an evolving and recursive method that requires no prior knowledge.While the algorithm autonomously creates and merges clusters as new data arrives,its efficiency is significantly hindered by the need to traverse all existing clusters upon the arrival of further data.This work presents the NS-TEDA(Neighbor Search Based Typicality and Eccentricity Data Analysis)algorithm by incorporating a KD-Tree(K-Dimensional Tree)algorithm integrated with the Scapegoat Tree.Upon arrival,this ensures that new data points interact solely with clusters in very close proximity.This significantly enhances algorithm efficiency while preventing a single data point from joining too many clusters and mitigating the merging of clusters with high overlap to some extent.We apply the NS-TEDA algorithm to several well-known datasets,comparing its performance with other data stream clustering algorithms and the original TEDA algorithm.The results demonstrate that the proposed algorithm achieves higher accuracy,and its runtime exhibits almost linear dependence on the volume of data,making it more suitable for large-scale data stream analysis research.

On fractional discrete financial system:Bifurcation,chaos,and control

The dynamic analysis of financial systems is a developing field that combines mathematics and economics to understand and explain fluctuations in financial markets.This paper introduces a new three-dimensional(3D)fractional financial map and we dissect its nonlinear dynamics system under commensurate and incommensurate orders.As such,we evaluate when the equilibrium points are stable or unstable at various fractional orders.We use many numerical methods,phase plots in 2D and 3D projections,bifurcation diagrams and the maximum Lyapunov exponent.These techniques reveal that financial maps exhibit chaotic attractor behavior.This study is grounded on the Caputo-like discrete operator,which is specifically influenced by the variance of the commensurate and incommensurate orders.Furthermore,we confirm the presence and measure the complexity of chaos in financial maps by the 0-1 test and the approximate entropy algorithm.Additionally,we offer nonlinear-type controllers to stabilize the fractional financial map.The numerical results of this study are obtained using MATLAB.

An Efficient Smoothing and Thresholding Image Segmentation Framework with Weighted Anisotropic-Isotropic Total Variation

In this paper,we design an efficient,multi-stage image segmentation framework that incorporates a weighted difference of anisotropic and isotropic total variation(AITV).The segmentation framework generally consists of two stages:smoothing and thresholding,thus referred to as smoothing-and-thresholding(SaT).In the first stage,a smoothed image is obtained by an AITV-regularized Mumford-Shah(MS)model,which can be solved efficiently by the alternating direction method of multipliers(ADMMs)with a closed-form solution of a proximal operator of the l_(1)-αl_(2) regularizer.The convergence of the ADMM algorithm is analyzed.In the second stage,we threshold the smoothed image by K-means clustering to obtain the final segmentation result.Numerical experiments demonstrate that the proposed segmentation framework is versatile for both grayscale and color images,effcient in producing high-quality segmentation results within a few seconds,and robust to input images that are corrupted with noise,blur,or both.We compare the AITV method with its original convex TV and nonconvex TVP(O<p<1)counterparts,showcasing the qualitative and quantitative advantages of our proposed method.

Bayesian and Non-Bayesian Analysis for the Sine Generalized Linear Exponential Model under Progressively Censored Data

This article introduces a novel variant of the generalized linear exponential(GLE)distribution,known as the sine generalized linear exponential(SGLE)distribution.The SGLE distribution utilizes the sine transformation to enhance its capabilities.The updated distribution is very adaptable and may be efficiently used in the modeling of survival data and dependability issues.The suggested model incorporates a hazard rate function(HRF)that may display a rising,J-shaped,or bathtub form,depending on its unique characteristics.This model includes many well-known lifespan distributions as separate sub-models.The suggested model is accompanied with a range of statistical features.The model parameters are examined using the techniques of maximum likelihood and Bayesian estimation using progressively censored data.In order to evaluate the effectiveness of these techniques,we provide a set of simulated data for testing purposes.The relevance of the newly presented model is shown via two real-world dataset applications,highlighting its superiority over other respected similar models.

A Review of Lightweight Security and Privacy for Resource-Constrained IoT Devices

The widespread and growing interest in the Internet of Things(IoT)may be attributed to its usefulness in many different fields.Physical settings are probed for data,which is then transferred via linked networks.There are several hurdles to overcome when putting IoT into practice,from managing server infrastructure to coordinating the use of tiny sensors.When it comes to deploying IoT,everyone agrees that security is the biggest issue.This is due to the fact that a large number of IoT devices exist in the physicalworld and thatmany of themhave constrained resources such as electricity,memory,processing power,and square footage.This research intends to analyse resource-constrained IoT devices,including RFID tags,sensors,and smart cards,and the issues involved with protecting them in such restricted circumstances.Using lightweight cryptography,the information sent between these gadgets may be secured.In order to provide a holistic picture,this research evaluates and contrasts well-known algorithms based on their implementation cost,hardware/software efficiency,and attack resistance features.We also emphasised how essential lightweight encryption is for striking a good cost-to-performance-to-security ratio.

Solar Radiation Estimation Based on a New Combined Approach of Artificial Neural Networks (ANN) and Genetic Algorithms (GA) in South Algeria

When designing solar systems and assessing the effectiveness of their many uses,estimating sun irradiance is a crucial first step.This study examined three approaches(ANN,GA-ANN,and ANFIS)for estimating daily global solar radiation(GSR)in the south of Algeria:Adrar,Ouargla,and Bechar.The proposed hybrid GA-ANN model,based on genetic algorithm-based optimization,was developed to improve the ANN model.The GA-ANN and ANFIS models performed better than the standalone ANN-based model,with GA-ANN being better suited for forecasting in all sites,and it performed the best with the best values in the testing phase of Coefficient of Determination(R=0.9005),Mean Absolute Percentage Error(MAPE=8.40%),and Relative Root Mean Square Error(rRMSE=12.56%).Nevertheless,the ANFIS model outperformed the GA-ANN model in forecasting daily GSR,with the best values of indicators when testing the model being R=0.9374,MAPE=7.78%,and rRMSE=10.54%.Generally,we may conclude that the initial ANN stand-alone model performance when forecasting solar radiation has been improved,and the results obtained after injecting the genetic algorithm into the ANN to optimize its weights were satisfactory.The model can be used to forecast daily GSR in dry climates and other climates and may also be helpful in selecting solar energy system installations and sizes.

A Review and Bibliometric Analysis of the Current Studies for the 6G Networks

The race to develop the next generation of wireless networks,known as Sixth Generation(6G)wireless,which will be operational in 2030,has already begun.To realize its full potential over the next decade,6G will undoubtedly necessitate additional improvements that integrate existing solutions with cutting-edge ones.However,the studies about 6G are mainly limited and scattered,whereas no bibliometric study covers the 6G field.Thus,this study aims to review,examine,and summarize existing studies and research activities in 6G.This study has examined the Scopus database through a bibliometric analysis of more than 1,000 papers published between 2017 and 2021.Then,we applied the bibliometric analysis methods by including(1)document type,(2)subject area,(3)author,and(4)country of publication.The study’s results reflect the research 6G community’s trends,highlight important research challenges,and elucidate potential directions for future research in this interesting area.

Investigating ischemia and reperfusion-induced organ damage in severe cardiac arrest:A comprehensive proteomics perspective

Cardiac arrest(CA)is a life-threatening condition with complex pathophysiology and limited treatment options.To gain deeper insights into the pathological state of vital organs,we employed a proteomics analysis in rodents to assess proteome alterations in the brain,heart,kidney,and liver using a rat model of CA.The brain displayed severe protein alterations in essential cellular pathways,including three major energy-generating pathways after CA,which worsened after resuscitation,resulting in the most significant overall protein changes among the organs.Conversely,the liver,experiencing the most substantial protein alterations post-CA,demonstrated significant recovery,presenting the least protein changes post-resuscitation.

The Influence of Internet Use on Women’s Depression and Its Countermeasures—Empirical Analysis Based on Data from CFPS

Based on China Family Panel Studies(CFPS)2018 data,the multiple linear regression model is used to analyze the effects of Internet use on women’s depression,and to test the robustness of the regression results.At the same time,the effects of Internet use on mental health of women with different residence,age,marital status and physical health status are analyzed.Then,we can obtain that Internet use has a significant promoting effect on women’s mental health,while the degree of Internet use has a significant inhibitory effect on women’s mental health.In addition,the study found that women’s age,education,place of residence,marital status,length of sleep,working status and physical health status are the main factors affecting the mental health of Chinese women.In the heterogeneity investigation of residence,age,marital status and physical health status,Internet use has a greater negative impact on the Center for Epidemiological Studies Depression Scale(CES-D8)scores of women in rural areas,has a significant positive impact on the mental health of middle-aged and elderly women or women with spouses,and has a positive impact on the mental health of physically unhealthy women.Therefore,in view of women’s mental health needs and the problems existing in the use of the Internet,this paper puts forward some suggestions to further improve the overall mental health level of women.

Numerical Predictions of Laminar Forced Convection Heat Transfer with and without Buoyancy Effects from an Isothermal Horizontal Flat Plate to Supercritical Nitrogen

Numerical predictions are made for Laminar Forced convection heat transfer with and without buoyancy effects for Supercritical Nitrogen flowing over an isothermal horizontal flat plate with a heated surface facing downwards.Computations are performed by varying the value ofΔT from5 to 30 K and P_(∞)/P_(cr)ratio from1.1 to 1.5.Variation of all the thermophysical properties of supercritical Nitrogen is considered.The wall temperatures are chosen in such a way that two values of Tw are less than T∗(T*is the temperature at which the fluid has a maximum value of Cp for the given pressure),one value equal to T∗and two values greater than T∗.Three different values of U∞are used to obtain Re∞range of 3.6×10_(4)to 4.74×10^(5)for forced convection without buoyancy effects and Gr_(∞)/Re^(2)_(∞)range of 0.011 to 3.107 for the case where buoyancy effects are predominant.Six different forms of correlations are proposed based on numerical predictions and are compared with actual numerical predictions.It has been found that in all six forms of correlations,the maximum deviations are found to occur in those cases where the pseudocritical temperature TT∗lies between the wall temperature and bulk fluid temperature.

Necessary and Sufficient Conditions for Oscillations of the Generalized Liénard Systems

In this paper, we study the second-order nonlinear differential systems of Liénard-type x˙=1a(x)[ h(y)−F(x) ], y˙=−a(x)g(x). Necessary and sufficient conditions to ensure that all nontrivial solutions are oscillatory are established by using a new nonlinear integral inequality. Our results substantially extend and improve previous results known in the literature.

Theoretical Assessment of Environmental Factors and Untreated Infectious Individuals in the Transmission Dynamics of Buruli ulcer

Buruli ulcer is the third most common mycobacterial disease worldwide, posing a significant public health burden, especially in impoverished regions of West and Central Africa, such as Benin. The management of Buruli ulcer (BU) in Africa is often hindered by limited resources, delays in treatment, and inadequate medical facilities. Additionally, a portion of the population does not seek hospital care, which facilitates the continued presence of the pathogen in the environment. This paper aims to investigate the role of environmental factors in the transmission of Buruli ulcer. We develop a mathematical model to describe the dynamics of Buruli ulcer transmission, incorporating the presence of the bacterium in the environment. Theoretical results are presented to demonstrate that the model is well-posed. We compute the equilibria, including the disease-free equilibrium and the endemic equilibrium, and study their stability. To achieve this, we derive a threshold parameter called the basic reproduction number ℛ0, which determines whether the disease will persist in a human population. If ℛ0is less than one, the disease will eventually die out;if ℛ0is greater than one, the disease will persist. Sensitivity analysis is performed to understand the impact of various parameters on the dynamics of Buruli ulcer transmission and to identify the parameters that influence the basic reproduction number ℛ0. Finally, numerical simulations are conducted to validate the theoretical results obtained from the mathematical analysis.

Subplanes of PG( 2, q 3 ) and the Ruled Varieties V 2 5 of PG( 6,q )

In this note we study subplanes of order q of the projective plane Π=PG( 2, q 3 ) and the ruled varieties V 2 5 of Σ=PG( 6,q ) using the spatial representation of Π in Σ, by fixing a hyperplane Σ ′ with a regular spread of planes. First are shown some configurations of the affine q-subplanes. Then to prove that a variety V 2 5 of Σ represents a non-affine subplane of order q of Π, after having shown basic incidence properties of it, such a variety V 2 5 is constructed by choosing appropriately the two directrix curves in two complementary subspaces of Σ. The result can be translated into further incidence properties of the affine points of V 2 5 . Then a maximal bundle of varieties V 2 5 having in common one directrix cubic curve is constructed.

Subplanes of PG(2,qr), Ruled Varieties V2r-12 in PG( 2r,q), and Related Codes

In this note we consider ruled varieties V22r−1of PG(2r,q), generalizing some results shown for r=2,3in previous papers. By choosing appropriately two directrix curves, a V22r−1represents a non-affine subplane of order qof the projective plane PG(2,qr)represented in PG(2r,q)by a spread of a hyperplane. That proves the conjecture assumed in [1]. Finally, a large family of linear codes dependent on r≥2is associated with projective systems defined both by V22r−1and by a maximal bundle of such varieties with only an r-directrix in common, then are shown their basic parameters.

Prediction of cyanotic and acyanotic congenital heart disease using machine learning models

BACKGROUND Congenital heart disease is most commonly seen in neonates and it is a major cause of pediatric illness and childhood morbidity and mortality.AIM To identify and build the best predictive model for predicting cyanotic and acyanotic congenital heart disease in children during pregnancy and identify their potential risk factors.METHODS The data were collected from the Pediatric Cardiology Department at Chaudhry Pervaiz Elahi Institute of Cardiology Multan,Pakistan from December 2017 to October 2019.A sample of 3900 mothers whose children were diagnosed with identify the potential outliers.Different machine learning models were compared,and the best-fitted model was selected using the area under the curve,sensitivity,and specificity of the models.RESULTS Out of 3900 patients included,about 69.5%had acyanotic and 30.5%had cyanotic congenital heart disease.Males had more cases of acyanotic(53.6%)and cyanotic(54.5%)congenital heart disease as compared to females.The odds of having cyanotic was 1.28 times higher for children whose mothers used more fast food frequently during pregnancy.The artificial neural network model was selected as the best predictive model with an area under the curve of 0.9012,sensitivity of 65.76%,and specificity of 97.23%.CONCLUSION Children having a positive family history are at very high risk of having cyanotic and acyanotic congenital heart disease.Males are more at risk and their mothers need more care,good food,and physical activity during pregnancy.The best-fitted model for predicting cyanotic and acyanotic congenital heart disease is the artificial neural network.The results obtained and the best model identified will be useful for medical practitioners and public health scientists for an informed decision-making process about the earlier diagnosis and improve the health condition of children in Pakistan.

Detection of Cocoa Leaf Diseases Using the CNN-Based Feature Extractor and XGBOOST Classifier

Among all the plagues threatening cocoa cultivation in general, and particularly in West Africa, the swollen shoot viral disease is currently the most dangerous. The greatest challenge in the fight to eradicate this pandemic remains its early detection. Traditional methods of swollen shoot detection are mostly based on visual observations, leading to late detection and/or diagnostic errors. The use of machine learning algorithms is now an alternative for effective plant disease detection. It is therefore crucial to provide efficient solutions to farmers’ cooperatives. In our study, we built a database of healthy and diseased cocoa leaves. We then explored the power of feature extractors based on convolutional neural networks such as VGG 19, Inception V3, DenseNet 201, and a custom CNN, combining their strengths with the XGBOOST classifier. The results of our experiments showed that this fusion of methods with XGBOOST yielded highly promising scores, outperforming the results of algorithms using the sigmoid function. These results were further consolidated by the use of evaluation metrics such as accuracy, mean squared error, F score, recall, and Matthews’s correlation coefficient. The proposed approach, combining state of the art feature extractors and the XGBOOST classifier, offers an efficient and reliable solution for the early detection of swollen shoot. Its implementation could significantly assist West African cocoa farmers in combating this devastating disease and preserving their crops.

Intelligent Detection and Identification of Attacks in IoT Networks Based on the Combination of DNN and LSTM Methods with a Set of Classifiers

Internet of Things (IoT) networks present unique cybersecurity challenges due to their distributed and heterogeneous nature. Our study explores the effectiveness of two types of deep learning models, long-term memory neural networks (LSTMs) and deep neural networks (DNNs), for detecting attacks in IoT networks. We evaluated the performance of six hybrid models combining LSTM or DNN feature extractors with classifiers such as Random Forest, k-Nearest Neighbors and XGBoost. The LSTM-RF and LSTM-XGBoost models showed lower accuracy variability in the face of different types of attack, indicating greater robustness. The LSTM-RF and LSTM-XGBoost models show variability in results, with accuracies between 58% and 99% for attack types, while LSTM-KNN has higher but more variable accuracies, between 72% and 99%. The DNN-RF and DNN-XGBoost models show lower variability in their results, with accuracies between 59% and 99%, while DNN-KNN has higher but more variable accuracies, between 71% and 99%. LSTM-based models are proving to be more effective for detecting attacks in IoT networks, particularly for sophisticated attacks. However, the final choice of model depends on the constraints of the application, taking into account a trade-off between accuracy and complexity.

Stability of a Delayed Stochastic Epidemic COVID-19 Model with Vaccination and with Differential Susceptibility

In this paper, we treat the spread of COVID-19 using a delayed stochastic SVIRS (Susceptible, Infected, Recovered, Susceptible) epidemic model with a general incidence rate and differential susceptibility. We start with a deterministic model, then add random perturbations on the contact rate using white noise to obtain a stochastic model. We first show that the delayed stochastic differential equation that describes the model has a unique global positive solution for any positive initial value. Under the condition R0 ≤ 1, we prove the almost sure asymptotic stability of the disease-free equilibrium of the model.