Attribute Reduction of Hybrid Decision Information Systems Based on Fuzzy Conditional Information Entropy

The presence of numerous uncertainties in hybrid decision information systems(HDISs)renders attribute reduction a formidable task.Currently available attribute reduction algorithms,including those based on Pawlak attribute importance,Skowron discernibility matrix,and information entropy,struggle to effectively manages multiple uncertainties simultaneously in HDISs like the precise measurement of disparities between nominal attribute values,and attributes with fuzzy boundaries and abnormal values.In order to address the aforementioned issues,this paper delves into the study of attribute reduction withinHDISs.First of all,a novel metric based on the decision attribute is introduced to solve the problem of accurately measuring the differences between nominal attribute values.The newly introduced distance metric has been christened the supervised distance that can effectively quantify the differences between the nominal attribute values.Then,based on the newly developed metric,a novel fuzzy relationship is defined from the perspective of“feedback on parity of attribute values to attribute sets”.This new fuzzy relationship serves as a valuable tool in addressing the challenges posed by abnormal attribute values.Furthermore,leveraging the newly introduced fuzzy relationship,the fuzzy conditional information entropy is defined as a solution to the challenges posed by fuzzy attributes.It effectively quantifies the uncertainty associated with fuzzy attribute values,thereby providing a robust framework for handling fuzzy information in hybrid information systems.Finally,an algorithm for attribute reduction utilizing the fuzzy conditional information entropy is presented.The experimental results on 12 datasets show that the average reduction rate of our algorithm reaches 84.04%,and the classification accuracy is improved by 3.91%compared to the original dataset,and by an average of 11.25%compared to the other 9 state-of-the-art reduction algorithms.The comprehensive analysis of these research results clearly indicates that our algorithm is highly effective in managing the intricate uncertainties inherent in hybrid data.

Integrating unascertained measurement and information entropy theory to assess blastability of rock mass

Due to the complex features of rock mass blastability assessment systems, an evaluation model of rock mass blastability was established on the basis of the unascertained measurement （UM） theory and the actual characteristics of the project. Considering a comprehensive range of intact rock properties and discontinuous structures of rock mass, twelve main factors influencing the evaluation blastability of rock mass were taken into account in the UM model, and the blastability evaluation index system of rock mass was constructed. The unascertained evaluation indices corresponding to the selected factors for the actual situation were solved both qualitatively and quantitatively. Then, the UM function of each evaluation index was obtained based on the initial data for the analysis of the blastability of six rock mass at a highway improvement cutting site in North Wales. The index weights of the factors were calculated by entropy theory, and credible degree identification （CDI） criteria were established according to the UM theory. The results of rock mass blastability evaluation were obtained by the CDI criteria. The results show that the UM model assessment results agree well with the actual records, and are consistent with those of the fuzzy sets evaluation method. Meanwhile, the unascertained superiority degree of rock mass blastability of samples S1-$6 which can be calculated by scoring criteria are 3.428 5, 3.453 3, 4.058 7, 3.675 9, 3.516 7 and 3.289 7, respectively. Furthermore, the proposed method can take into account large amount of uncertain information in blastability evaluation, which can provide an effective, credible and feasible way for estimating the blastability of rock mass. Engineering practices show that it can complete the blastability assessment systematically and scientifically without any assumption by the proposed model, which can be applied to practical engineering.

Experimental investigation on predicting precursory changes in entropy for dominant frequency of rockburst

Rockburst is a dynamic phenomenon accompanied by acoustic emission(AE)activities.It is difficult to predict rockburst accurately.Based on the fast Fourier transform(FFT)method and the information entropy theory,the evolution model of dominant frequency entropy was established.The AE energy,frequency and stress were synthetically considered to predict rockburst.Under the triaxial and the single-face unloading tests,the relationship between AE energy and the development of internal cracks was analyzed.Using the FFT method,the distribution characteristics of AE dominant frequency values were obtained.Based on the information entropy theory,the dominant frequencies evolved patterns were ascertained.It was observed that the evolution models of the dominant frequency entropy were nearly the same and shared a characteristic“undulation-decrease-rise-sharp decrease”pattern.Results show that AE energy will be released suddenly before rockburst.The density of intermediate frequency increased prior to rockburst.The dominant frequency entropy reached a relative maximum value before rockburst,and then decreased sharply.These features could be used as a precursory information for predicting rockburst.The proposed relative maximum value could be as a key point to predict rockburst.This is a meaningful attempt on predicting rockburst.

Determination of neutron-skin thickness using configurational information entropy

Configurational information entropy(CIE)theory was employed to determine the neutron-skin thickness of neutron-rich calcium isotopes.The nuclear density distributions and fragment cross sections in 350 MeV/u ^(40-60)Ca+^(9)Be projectile fragmentation reactions were calculated using a modified statistical abrasion-ablation model.CIE quantities were determined from the nuclear density,isotopic,mass,and charge distributions.The linear correlations between the CIE determined using the isotopic,mass,and charge distributions and the neutron-skin thickness of the projectile nucleus show that CIE provides new methods to extract the neutron-skin thickness of neutron-rich nuclei.

Novel detection method for infrared small targets using weighted information entropy

This paper presents a method for detecting the small infrared target under complex background. An algorithm, named local mutation weighted information entropy （LMWIE）, is proposed to suppress background. Then, the grey value of targets is enhanced by calculating the local energy. Image segmentation based on the adaptive threshold is used to solve the problems that the grey value of noise is enhanced with the grey value improvement of targets. Experimental results show that compared with the adaptive Butterworth high-pass filter method, the proposed algorithm is more effective and faster for the infrared small target detection.

An Intelligent Fault Diagnosis Method of Multi-Scale Deep Feature Fusion Based on Information Entropy

For a single-structure deep learning fault diagnosis model,its disadvantages are an insufficient feature extraction and weak fault classification capability.This paper proposes a multi-scale deep feature fusion intelligent fault diagnosis method based on information entropy.First,a normal autoencoder,denoising autoencoder,sparse autoencoder,and contractive autoencoder are used in parallel to construct a multi-scale deep neural network feature extraction structure.A deep feature fusion strategy based on information entropy is proposed to obtain low-dimensional features and ensure the robustness of the model and the quality of deep features.Finally,the advantage of the deep belief network probability model is used as the fault classifier to identify the faults.The effectiveness of the proposed method was verified by a gearbox test-bed.Experimental results show that,compared with traditional and existing intelligent fault diagnosis methods,the proposed method can obtain representative information and features from the raw data with higher classification accuracy.

Maximum Entropy Distribution Function and Uncertainty Evaluation Criteria

Marine environmental design parameter extrapolation has important applications in marine engineering and coastal disaster prevention.The distribution models used for environmental design parameter usually pass the hypothesis tests in statistical analysis,but the calculation results of different distribution models often vary largely.In this paper,based on the information entropy,the overall uncertainty test criteria were studied for commonly used distributions including Gumbel,Weibull,and Pearson-III distribution.An improved method for parameter estimation of the maximum entropy distribution model is proposed on the basis of moment estimation.The study in this paper shows that the number of sample data and the degree of dispersion are proportional to the information entropy,and the overall uncertainty of the maximum entropy distribution model is minimal compared with other models.

Application of Maximum Entropy Principle to Studying the Distribution of Wave Heights in A Random Wave Field

Based on the maximum entropy principle, a probability density function (PDF) is derived for the distribution of wave heights in a random wave field, without any more hypothesis. The present PDF, being a non-Rayleigh form, involves two parameters: the average wave height H— and the state parameter γ. The role of γ in the distribution of wave heights is examined. It is found that γ may be a certain measure of sea state. A least square method for determining γ from measured data is proposed. In virtue of the method, the values of γ are determined for three sea states from the data measured in the East China Sea. The present PDF is compared with the well known Rayleigh PDF of wave height and it is shown that it much better fits the data than the Rayleigh PDF. It is expected that the present PDF would fit some other wave variables, since its derivation is not restricted only to the wave height.

Configurational information entropy analysis of fragment mass cross distributions to determine the neutron skin thickness of projectile nuclei

Configurational information entropy(CIE)analysis has been shown to be applicable for determining the neutron skin thickness(δnp)of neutron-rich nuclei from fragment production in projectile fragmentation reactions.The BNN+FRACS machine learning model was adopted to predict the fragment mass cross-sections(σ_(A))of the projectile fragmentation reactions induced by calcium isotopes from ^(36)Ca to ^(56)Ca on a ^(9)Be target at 140MeV/u.The fast Fourier transform was adopted to decompose the possible information compositions inσA distributions and determine the quantity of CIE(S_(A)[f]).It was found that the range of fragments significantly influences the quantity of S_(A)[f],which results in different trends of S_(A)[f]~δnp correlation.The linear S_(A)[f]~δnp correlation in a previous study[Nucl.Sci.Tech.33,6(2022)]could be reproduced using fragments with relatively large mass fragments,which verifies that S_(A)[f]determined from fragmentσAis sensitive to the neutron skin thickness of neutron-rich isotopes.

Multi-objectives fuzzy optimization model for ship form demonstration based on information entropy

Selecting optimization ship form scheme is an important content in the process of concept design of ship. Multi-objective fuzzy decision-making model for ship form demonstration is set up according to the fuzzy pattern-recognition theory. Weight coefficients of each target of ship form scheme are determined by information entropy and individual subjective partiality. This model is used to select the optimal ship form scheme, the example shows that the model is exact and the resuh is credible. It can provide a reference for choosing the optimization scheme of ship form.

Time dependence of entropy flux and entropy production for a dynamical system driven by noises with coloured cross-correlation

This paper shows the Fokker-Planck equation of a dynamical system driven by coloured cross-correlated white noises in the absence and presence of a small external force. Based on the Fokker-Planck equation and the definition of Shannon＇s information entropy, the time dependence of entropy flux and entropy production can be calculated. The present results can be used to explain the extremal behaviour of time dependence of entropy flux and entropy production in view of the dissipative parameter γ of the system, coloured cross-correlation time τ and coloured cross-correlation strength λ.

Information Entropy Squeezing for a Atom in Mode-Mode Competition System

The entropy squeezing properties for a two-level atom interacting with a two-mode field via two differentcompeting transitions are investigated from a quantum information point of view.The influences of the initial state of thesystem and the relative coupling strength between the atom and the field on the atomic information entropy squeezingare discussed.Our results show that the squeezed direction and the frequency of the information entropy squeezing canbe controlled by choosing the phase of the atom dipole and the relative competing strength of atom-field,respectively.We find that,under the same condition,no atomic variance squeezing is predicted from the HUR while optimal entropysqueezing is obtained from the EUR,so the quantum information entropy is a remarkable precision measure for theatomic squeezing in the considered system.

Upper bound for the time derivative of entropy for a dynamical system driven by coloured cross-correlated white noises

It is shown how the cross-correlation time and strength of coloured cross-correlated white noises can set an upper bound for the time derivative of entropy in a nonequilibrium system. The value of upper bound can be calculated directly based on the Schwartz inequality principle and the Fokker-Planck equation of the dynamical system driven by coloured cross-correlated white noises. The present calculations can be used to interpret the interplay of the dissipative constant and cross-correlation time and strength of coloured cross-correlated white noises on the upper bound.

Entropy-based link prediction in weighted networks

Information entropy has been proved to be an effective tool to quantify the structural importance of complex networks.In a previous work [Xu et al. Physica A, 456 294（2016）], we measure the contribution of a path in link prediction with information entropy. In this paper, we further quantify the contribution of a path with both path entropy and path weight,and propose a weighted prediction index based on the contributions of paths, namely weighted path entropy（WPE）, to improve the prediction accuracy in weighted networks. Empirical experiments on six weighted real-world networks show that WPE achieves higher prediction accuracy than three other typical weighted indices.

Time Dependence of Entropy Flux and Entropy Production of a Dissipative Dynamical System Driven by Non-Gaussian Noise

A stochastic dissipative dynamical system driven by non-Gaussian noise is investigated. A general approximate Fokker-Planck equation of the system is derived through a path-integral approach. Based on the definition of Shannon＇s information entropy, the exact time dependence of entropy flux and entropy production of the system is calculated both in the absence and in the presence of non-equilibrium constraint. The present calculation can be used to interpret the interplay of the dissipative constant and non-Gaussian noise on the entropy flux and entropy production.

A Heuristic Clustering Algorithm forIntrusion Detection Based on Information Entropy

This paper studied on the clustering problem for intrusion detection with the theory of information entropy, it was put forward that the clustering problem for exact intrusion detection based on information entropy is NP complete, therefore, the heuristic algorithm to solve the clustering problem for intrusion detection was designed, this algorithm has the characteristic of incremental development, it can deal with the database with large connection records from the internet.

Time evolution of information entropy for a stochastic system with double singularities driven by quasimonochromatic noise

This paper deals with the time evolution of information entropy for a stochastic system with double singularities driven by quasimonochromatic noise. The dimension of the Fokker Planck equation is reduced by the linear transfor- mation. The exact expression of the time dependence of information entropy is obtained based on the definition of Shannon＇s information entropy. The relationships between the properties of dissipative parameters, system singularity strength parameter, quasimonochromatic noise, and their effects on information entropy are discussed.

An outlier recognition approach in surveying data based on information entropy

A novel outlier recognition method in surveying data is presented based on Shannon information entropy. The probability distribution of surveying data does not need to be known or hypothesized in this method, and it is not only accurate but also convenient to calculate in this method compared with statistical recognition method.

k-NN Based Bypass Entropy and Mutual Information Estimation for Incremental Remote-Sensing Image Compressibility Evaluation

Incremental image compression techniques using priori information are of significance to deal with the explosively increasing remote-sensing image data. However, the potential benefi ts of priori information are still to be evaluated quantitatively for effi cient compression scheme designing. In this paper, we present a k-nearest neighbor(k-NN) based bypass image entropy estimation scheme, together with the corresponding mutual information estimation method. Firstly, we apply the k-NN entropy estimation theory to split image blocks, describing block-wise intra-frame spatial correlation while avoiding the curse of dimensionality. Secondly, we propose the corresponding mutual information estimator based on feature-based image calibration and straight-forward correlation enhancement. The estimator is designed to evaluate the compression performance gain of using priori information. Numerical results on natural and remote-sensing images show that the proposed scheme obtains an estimation accuracy gain by 10% compared with conventional image entropy estimators. Furthermore, experimental results demonstrate both the effectiveness of the proposed mutual information evaluation scheme, and the quantitative incremental compressibility by using the priori remote-sensing frames.

Possibilistic entropy-based measure of importance in fault tree analysis

With respect to the subjective factors and nonlinear characteristics inherent in the important identification of fault tree analysis （FTA）, a new important measure of FTA is proposed based on possibilistic information entropy. After investigating possibilistic information semantics, measure-theoretic terms, and entropy-like models, a two-dimensional framework has been constructed by combining both the set theory and the measure theory. By adopting the possibilistic assumption in place of the probabilistic one, an axiomatic index of importance is defined in the possibility space and then the modelling principles are presented. An example of the fault tree is thus provided, along with the concordance analysis and other discussions. The more conservative numerical results of importance rankings, which involve the more choices can be viewed as “soft” fault identification under a certain expected value. In the end, extension to evidence space and further research perspectives are discussed.