Attribute Reduction of Hybrid Decision Information Systems Based on Fuzzy Conditional Information Entropy

The presence of numerous uncertainties in hybrid decision information systems(HDISs)renders attribute reduction a formidable task.Currently available attribute reduction algorithms,including those based on Pawlak attribute importance,Skowron discernibility matrix,and information entropy,struggle to effectively manages multiple uncertainties simultaneously in HDISs like the precise measurement of disparities between nominal attribute values,and attributes with fuzzy boundaries and abnormal values.In order to address the aforementioned issues,this paper delves into the study of attribute reduction withinHDISs.First of all,a novel metric based on the decision attribute is introduced to solve the problem of accurately measuring the differences between nominal attribute values.The newly introduced distance metric has been christened the supervised distance that can effectively quantify the differences between the nominal attribute values.Then,based on the newly developed metric,a novel fuzzy relationship is defined from the perspective of“feedback on parity of attribute values to attribute sets”.This new fuzzy relationship serves as a valuable tool in addressing the challenges posed by abnormal attribute values.Furthermore,leveraging the newly introduced fuzzy relationship,the fuzzy conditional information entropy is defined as a solution to the challenges posed by fuzzy attributes.It effectively quantifies the uncertainty associated with fuzzy attribute values,thereby providing a robust framework for handling fuzzy information in hybrid information systems.Finally,an algorithm for attribute reduction utilizing the fuzzy conditional information entropy is presented.The experimental results on 12 datasets show that the average reduction rate of our algorithm reaches 84.04%,and the classification accuracy is improved by 3.91%compared to the original dataset,and by an average of 11.25%compared to the other 9 state-of-the-art reduction algorithms.The comprehensive analysis of these research results clearly indicates that our algorithm is highly effective in managing the intricate uncertainties inherent in hybrid data.

A framework of force of information influence and application for C4KISR system

The subversive nature of information war lies not only in the information itself, but also in the circulation and application of information. It has always been a challenge to quantitatively analyze the function and effect of information flow through command, control, communications, computer, kill, intelligence,surveillance, reconnaissance (C4KISR) system. In this work, we propose a framework of force of information influence and the methods for calculating the force of information influence between C4KISR nodes of sensing, intelligence processing,decision making and fire attack. Specifically, the basic concept of force of information influence between nodes in C4KISR system is formally proposed and its mathematical definition is provided. Then, based on the information entropy theory, the model of force of information influence between C4KISR system nodes is constructed. Finally, the simulation experiments have been performed under an air defense and attack scenario. The experimental results show that, with the proposed force of information influence framework, we can effectively evaluate the contribution of information circulation through different C4KISR system nodes to the corresponding tasks. Our framework of force of information influence can also serve as an effective tool for the design and dynamic reconfiguration of C4KISR system architecture.

Novel detection method for infrared small targets using weighted information entropy

This paper presents a method for detecting the small infrared target under complex background. An algorithm, named local mutation weighted information entropy （LMWIE）, is proposed to suppress background. Then, the grey value of targets is enhanced by calculating the local energy. Image segmentation based on the adaptive threshold is used to solve the problems that the grey value of noise is enhanced with the grey value improvement of targets. Experimental results show that compared with the adaptive Butterworth high-pass filter method, the proposed algorithm is more effective and faster for the infrared small target detection.

Determination of neutron-skin thickness using configurational information entropy

Configurational information entropy(CIE)theory was employed to determine the neutron-skin thickness of neutron-rich calcium isotopes.The nuclear density distributions and fragment cross sections in 350 MeV/u ^(40-60)Ca+^(9)Be projectile fragmentation reactions were calculated using a modified statistical abrasion-ablation model.CIE quantities were determined from the nuclear density,isotopic,mass,and charge distributions.The linear correlations between the CIE determined using the isotopic,mass,and charge distributions and the neutron-skin thickness of the projectile nucleus show that CIE provides new methods to extract the neutron-skin thickness of neutron-rich nuclei.

An Intelligent Fault Diagnosis Method of Multi-Scale Deep Feature Fusion Based on Information Entropy

For a single-structure deep learning fault diagnosis model,its disadvantages are an insufficient feature extraction and weak fault classification capability.This paper proposes a multi-scale deep feature fusion intelligent fault diagnosis method based on information entropy.First,a normal autoencoder,denoising autoencoder,sparse autoencoder,and contractive autoencoder are used in parallel to construct a multi-scale deep neural network feature extraction structure.A deep feature fusion strategy based on information entropy is proposed to obtain low-dimensional features and ensure the robustness of the model and the quality of deep features.Finally,the advantage of the deep belief network probability model is used as the fault classifier to identify the faults.The effectiveness of the proposed method was verified by a gearbox test-bed.Experimental results show that,compared with traditional and existing intelligent fault diagnosis methods,the proposed method can obtain representative information and features from the raw data with higher classification accuracy.

Configurational information entropy analysis of fragment mass cross distributions to determine the neutron skin thickness of projectile nuclei

Configurational information entropy(CIE)analysis has been shown to be applicable for determining the neutron skin thickness(δnp)of neutron-rich nuclei from fragment production in projectile fragmentation reactions.The BNN+FRACS machine learning model was adopted to predict the fragment mass cross-sections(σ_(A))of the projectile fragmentation reactions induced by calcium isotopes from ^(36)Ca to ^(56)Ca on a ^(9)Be target at 140MeV/u.The fast Fourier transform was adopted to decompose the possible information compositions inσA distributions and determine the quantity of CIE(S_(A)[f]).It was found that the range of fragments significantly influences the quantity of S_(A)[f],which results in different trends of S_(A)[f]~δnp correlation.The linear S_(A)[f]~δnp correlation in a previous study[Nucl.Sci.Tech.33,6(2022)]could be reproduced using fragments with relatively large mass fragments,which verifies that S_(A)[f]determined from fragmentσAis sensitive to the neutron skin thickness of neutron-rich isotopes.

A Heuristic Clustering Algorithm forIntrusion Detection Based on Information Entropy

This paper studied on the clustering problem for intrusion detection with the theory of information entropy, it was put forward that the clustering problem for exact intrusion detection based on information entropy is NP complete, therefore, the heuristic algorithm to solve the clustering problem for intrusion detection was designed, this algorithm has the characteristic of incremental development, it can deal with the database with large connection records from the internet.

Time evolution of information entropy for a stochastic system with double singularities driven by quasimonochromatic noise

This paper deals with the time evolution of information entropy for a stochastic system with double singularities driven by quasimonochromatic noise. The dimension of the Fokker Planck equation is reduced by the linear transfor- mation. The exact expression of the time dependence of information entropy is obtained based on the definition of Shannon＇s information entropy. The relationships between the properties of dissipative parameters, system singularity strength parameter, quasimonochromatic noise, and their effects on information entropy are discussed.

A Method of Using Information Entropy of an Image as an Effective Feature for Com-puter-Aided Diagnostic Applications

Computer-aided detection and diagnosis (CAD) systems are increasingly being used as an aid by clinicians for detection and interpretation of diseases. In general, a CAD system employs a classifier to detect or distinguish between abnormal and normal tissues on images. In the phase of classification, a set of image features and/or texture features extracted from the images are commonly used. In this article, we investigated the characteristic of the output entropy of an image and demonstrated the usefulness of the output entropy acting as a texture feature in CAD systems. In order to validate the effectiveness and superiority of the output-entropy-based texture feature, two well-known texture features, i.e., mean and standard deviation were used for comparison. The database used in this study comprised 50 CT images obtained from 10 patients with pulmonary nodules, and 50 CT images obtained from 5 normal subjects. We used a support vector machine for classification. A leave-one-out method was employed for training and classification. Three combinations of texture features, i.e., mean and entropy, standard deviation and entropy, and standard deviation and mean were used as the inputs to the classifier. Three different regions of interest (ROI) sizes, i.e., 11 × 11, 9 × 9 and 7 × 7 pixels from the database were selected for computation of the feature values. Our experimental results show that the combination of entropy and standard deviation is significantly better than both the combination of mean and entropy and that of standard deviation and mean in the case of the ROI size of 11 × 11 pixels (p < 0.05). These results suggest that information entropy of an image can be used as an effective feature for CAD applications.

Fault Diagnosis of a Rotary Machine Based on Information Entropy and Rough Set

There exists some discord or contradiction of information during the process of fault diagnosis for rotary machine. But the traditional methods used in fault diagnosis can not dispose of the information. A model of fault diagnosis for a rotary machine based on information entropy theory and rough set theory is presented in this paper. The model has clear mathematical definition and can dispose both complete unification information and complete inconsistent information of vibration faults. By using the model, decision rules of six typical vibration faults of a steam turbine and electric generating set are deduced from experiment samples. Finally, the decision rules are validated by selected samples and good identification results are acquired.

A Method of Rotating Machinery Fault Diagnosis Based on the Close Degree of Information Entropy

This paper presents a method of rotating machinery fault diagnosis based on the close degree of information entropy. In the view of the information entropy, we introduce four information entropy features of the rotating machinery, which describe the vibration condition of the machinery. The four features are, respectively, denominated as singular spectrum entropy, power spectrum entropy, wavelet space state feature entropy and wavelet power spectrum entropy. The value scopes of the four information entropy features of the rotating machinery in some typical fault conditions are gained by experiments, which can be acted as the standard features of fault diagnosis. According to the principle of the shorter distance between the more similar models, the decision-making method based on the close degree of information entropy is put forward to deal with the recognition of fault patterns. We demonstrate the effectiveness of this approach in an instance involving the fault pattern recognition of some rotating machinery.

Effect of time delay on the upper bound of the time derivative of information entropy in a stochastic dynamical system

The effects of the time delay on the upper bound of the time derivative of information entropy are investigated in a time-delayed dynamical system driven by correlated noise. Using the Markov approximation of the stochastic delay differential equations and the Schwartz inequality principle, we obtain an analytical expression for the upper bound UB（t） of the time derivative of the information entropy. The results show that there is a critical value of T （delay time）, and UB（t） presents opposite behaviours on difference sides of the critical value. For the case of the weak additive noise, T can induce a reentrance transition. Delay time T also causes a reversal behaviour in UB（t）-λplot, where λ denotes the degree of the correlation between the two noises.

The remote sensing composite information entropy and types of Nansha coral reef atolls

In the viempint that the coral reef atolls' growth index of the Nansha Islands is influenced by many factors, the measured remote sensing comopite information including some mutually related factors is divided into 10 geographic events as N1, N2 ..., N10, and the analysis of the atolls' information entropy is made. From the value of theentropy, the closed related factors with the index of the emerged atolls are shown. In proper order, the factors are reeftop's area(0. 319), lagoon's area(0. 324), open-degree of atoll(0. 336), trend of atoll(0. 551 ). On the basis of thiswork, a new description function of the emerged atoll growth index is proposed. This function can be used to identifythe open my of Nansha atoll growth.

Information entropy for static spherically symmetric black holes

By using the new equation of state density derived from the generalized uncertainty relation, the number of the quantum states near event horizon is obtained, with which then the information entropy of static spherically symmetric black holes has been discussed. It is found that the divergent integral of quantum states near the event horizon can be naturally avoided if using the new equation of state density without introducing the ultraviolet cut-off. The information entropy of black holes can be obtained precisely by the residue theorem, which is shown to be proportional to the horizon area. The information entropy of black holes obtained agrees with the Bechenstein-Hawking entropy when the suitable cutoff factor is adopted.

Quantum watermarking based on threshold segmentation using quantum informational entropy

We propose a new quantum watermarking scheme based on threshold selection using informational entropy of quantum image.The core idea of this scheme is to embed information into object and background of cover image in different ways.First,a threshold method adopting the quantum informational entropy is employed to determine a threshold value.The threshold value can then be further used for segmenting the cover image to a binary image,which is an authentication key for embedding and extraction information.By a careful analysis of the quantum circuits of the scheme,that is,translating into the basic gate sequences which show the low complexity of the scheme.One of the simulation-based experimental results is entropy difference which measures the similarity of two images by calculating the difference in quantum image informational entropy between watermarked image and cover image.Furthermore,the analyses of peak signal-to-noise ratio,histogram and capacity of the scheme are also provided.

Quantum information entropy for one-dimensional system undergoing quantum phase transition

Calculations of the quantum information entropy have been extended to a non-analytically solvable situation. Specifically, we have investigated the information entropy for a one-dimensional system with a schematic ＂Landau＂ potential in a numerical way. Particularly, it is found that the phase transitional behavior of the system can be well expressed by the evolution of quantum information entropy. The calculated results also indicate that the position entropy S_x and the momentum entropy S_p at the critical point of phase transition may vary with the mass parameter M but their sum remains as a constant independent of M for a given excited state. In addition, the entropy uncertainty relation is proven to be robust during the whole process of the phase transition.

Novel Fault Detection Optimization Algorithm for Single Event Effect system Based on Multi-information Entropy Fusion

Fault detection caused by single event effect( SEE) in system was studied,and an improved fault detection algorithm by fusing multi-information entropy for detecting soft error was proposed based on multi-objective detection approach and classification management method. In the improved fault detection algorithm, the analysis model of posteriori information with corresponding multi-fault alternative detection points was formulated through correlation information matrix, and the maximum incremental information entropy was chosen as the classification principle for the optimal detection points. A system design example was given to prove the rationality and feasibility of this algorithm.This fault detection algorithm can achieve the purpose of fault detection and resource configuration with high efficiency.

Invariance and Noises of Shannon Entropy for Information on Oxidative Activity of DNA in All Living Cells for Medical Diagnostics

We analyze oxidative activity of DNA due to fluorescence of chromosomes inside cells, using flow cytometry method with nanometer spatial resolution. Statistics of fluorescence is presented in histogram as frequency distributions of flashes in the dependence on their intensity and in distributions of Shannon entropy, which was defined on the base of normalized distribution of information in original histogram for frequency of flashes. We show that overall sum of entropy, i.e. total entropy E , for any histogram is invariant and has identical trends of changes all values of E(r) = lnr at reduction of histogram’ rank r. This invariance reflects informational homeostasis of chromosomes activity in multi-scale networks of entropy inside all cells in various samples of blood for DNA inside neutrophils, lymphocytes, inside all leukocytes of human and inside chicken erythrocytes for various dyes, colors and various excitations of fluorescence. Informational homeostasis of oxidative activity of 3D DNA in the full set of chromosomes inside living cells exists for any Shannon-Weaver index of biodiversity of cells, at any state of health different beings. Regulation perturbations in information activity DNA provides informational adaptability and vitality of cells at homeostasis support. Noises of entropy, during regulation of informational homeostasis, depend on the states of health in real time. The main structural reconstructions of chromosomal correlations, corresponding to self-regulation of homeostasis, occur in the most large-scale networks of entropy, for rank r<32. We show that stability of homeostasis is supported by activity of all 46 chromosomes inside cells. Patterns, hidden switching and branching in sequences of averages of H?lder and central moments for noises in regulation of homeostasis define new opportunities in diagnostics of health and immunity. All people and all aerobic beings have one overall homeostatic level for countdown of information activity of DNA inside cells. We noted very bad and dangerous properties of artificial cells with other levels of informational homeostasis for all aerobic beings in foods, medical treatment and in biotechnologies.

Shannon Entropy as a Measurement of the Information in a Multiconfiguration Dirac-Fock Wavefunction

Discrete Shannon entropy is applied to describe the information in a multiconfiguration Dirac Fock wavefunction. The dependence of Shannon entropy is shown as enlarging the configuration space and it can reach saturation when there are enough configuration state wavefunctions to obtain the convergent energy levels; that is, the calculation procedure in multiconfiguration Dirae Fock method is an entropy saturation process. At the same accuracy level, the basis sets for the smallest entropy are best able to describe the energy state. Additionally, a connection between the sudden change of Shannon information entropies and energy level crossings along with isoelectronic sequence can be set up, which is helpful to find the energy level crossings of interest in interpreting and foreseeing the inversion scheme of energy levels for an x-ray laser.

A Diagnosis Method of Vibration Fault of a Steam Turbine Based on Information Entropy and Grey Correlation Analysis

The vibration fault, one of the common faults in the steam turbine generator unit, brings great damage to the production and the running process. It is well known that the information entropy is to describe the degree of indeterminacy of the system, so the information entropy can be used to measure Despite its efficiency, one kind of information entropy is just enabled to identify make up for this limitation, based on nalysis was studied for vibration fault the vibration condition of the unit. certain part of the faults. In order to the faulty signals collected from the rotor test platform, the grey correlation adiagnosis of steam turbine shafting in this paper. The reference faulty matrix and the calculation model of grey correlation degree was established based on three kinds of information entropy. The analysis shows that grey correlation analysis is a useful method for fault diagnosis of shafting and can be used as a quantitative index for fault diagnosis.