Activation Redistribution Based Hybrid Asymmetric Quantization Method of Neural Networks

The demand for adopting neural networks in resource-constrained embedded devices is continuously increasing.Quantization is one of the most promising solutions to reduce computational cost and memory storage on embedded devices.In order to reduce the complexity and overhead of deploying neural networks on Integeronly hardware,most current quantization methods use a symmetric quantization mapping strategy to quantize a floating-point neural network into an integer network.However,although symmetric quantization has the advantage of easier implementation,it is sub-optimal for cases where the range could be skewed and not symmetric.This often comes at the cost of lower accuracy.This paper proposed an activation redistribution-based hybrid asymmetric quantizationmethod for neural networks.The proposedmethod takes data distribution into consideration and can resolve the contradiction between the quantization accuracy and the ease of implementation,balance the trade-off between clipping range and quantization resolution,and thus improve the accuracy of the quantized neural network.The experimental results indicate that the accuracy of the proposed method is 2.02%and 5.52%higher than the traditional symmetric quantization method for classification and detection tasks,respectively.The proposed method paves the way for computationally intensive neural network models to be deployed on devices with limited computing resources.Codes will be available on https://github.com/ycjcy/Hybrid-Asymmetric-Quantization.

In situ calibrated angle between the quantization axis and the propagating direction of the light field for trapping neutral atoms

The recently developed magic-intensity trapping technique of neutral atoms efficiently mitigates the detrimental effect of light shifts on atomic qubits and substantially enhances the coherence time. This technique relies on applying a bias magnetic field precisely parallel to the wave vector of a circularly polarized trapping laser field. However, due to the presence of the vector light shift experienced by the trapped atoms, it is challenging to precisely define a parallel magnetic field, especially at a low bias magnetic field strength, for the magic-intensity trapping of85Rb qubits. In this work, we present a method to calibrate the angle between the bias magnetic field and the trapping laser field with the compensating magnetic fields in the other two directions orthogonal to the bias magnetic field direction. Experimentally, with a constantdepth trap and a fixed bias magnetic field, we measure the respective resonant frequencies of the atomic qubits in a linearly polarized trap and a circularly polarized one via the conventional microwave Rabi spectra with different compensating magnetic fields and obtain the corresponding total magnetic fields via the respective resonant frequencies using the Breit–Rabi formula. With known total magnetic fields, the angle is a function of the other two compensating magnetic fields.Finally, the projection value of the angle on either of the directions orthogonal to the bias magnetic field direction can be reduced to 0(4)° by applying specific compensating magnetic fields. The measurement error is mainly attributed to the fluctuation of atomic temperature. Moreover, it also demonstrates that, even for a small angle, the effect is strong enough to cause large decoherence of Rabi oscillation in a magic-intensity trap. Although the compensation method demonstrated here is explored for the magic-intensity trapping technique, it can be applied to a variety of similar precision measurements with trapped neutral atoms.

Learning Vector Quantization-Based Fuzzy Rules Oversampling Method

Imbalanced datasets are common in practical applications,and oversampling methods using fuzzy rules have been shown to enhance the classification performance of imbalanced data by taking into account the relationship between data attributes.However,the creation of fuzzy rules typically depends on expert knowledge,which may not fully leverage the label information in training data and may be subjective.To address this issue,a novel fuzzy rule oversampling approach is developed based on the learning vector quantization(LVQ)algorithm.In this method,the label information of the training data is utilized to determine the antecedent part of If-Then fuzzy rules by dynamically dividing attribute intervals using LVQ.Subsequently,fuzzy rules are generated and adjusted to calculate rule weights.The number of new samples to be synthesized for each rule is then computed,and samples from the minority class are synthesized based on the newly generated fuzzy rules.This results in the establishment of a fuzzy rule oversampling method based on LVQ.To evaluate the effectiveness of this method,comparative experiments are conducted on 12 publicly available imbalance datasets with five other sampling techniques in combination with the support function machine.The experimental results demonstrate that the proposed method can significantly enhance the classification algorithm across seven performance indicators,including a boost of 2.15%to 12.34%in Accuracy,6.11%to 27.06%in G-mean,and 4.69%to 18.78%in AUC.These show that the proposed method is capable of more efficiently improving the classification performance of imbalanced data.

Reinforcement Learning Based Quantization Strategy Optimal Assignment Algorithm for Mixed Precision

The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to databit width. Reducing the data bit width will result in a loss of accuracy. Therefore, it is difficult to determinethe optimal bit width for different parts of the network with guaranteed accuracy. Mixed precision quantizationcan effectively reduce the amount of computation while keeping the model accuracy basically unchanged. In thispaper, a hardware-aware mixed precision quantization strategy optimal assignment algorithm adapted to low bitwidth is proposed, and reinforcement learning is used to automatically predict the mixed precision that meets theconstraints of hardware resources. In the state-space design, the standard deviation of weights is used to measurethe distribution difference of data, the execution speed feedback of simulated neural network accelerator inferenceis used as the environment to limit the action space of the agent, and the accuracy of the quantization model afterretraining is used as the reward function to guide the agent to carry out deep reinforcement learning training. Theexperimental results show that the proposed method obtains a suitable model layer-by-layer quantization strategyunder the condition that the computational resources are satisfied, and themodel accuracy is effectively improved.The proposed method has strong intelligence and certain universality and has strong application potential in thefield of mixed precision quantization and embedded neural network model deployment.

Finite-time H_(∞) filtering for Markov jump systems with uniform quantization

This paper is concerned with finite-time H_(∞) filtering for Markov jump systems with uniform quantization. The objective is to design quantized mode-dependent filters to ensure that the filtering error system is not only mean-square finite-time bounded but also has a prescribed finite-time H_(∞) performance. First, the case where the switching modes of the filter align with those of the MJS is considered. A numerically tractable filter design approach is proposed utilizing a mode-dependent Lyapunov function, Schur’s complement, and Dynkin’s formula. Then, the study is extended to a scenario where the switching modes of the filter can differ from those of the MJS. To address this situation, a mode-mismatched filter design approach is developed by leveraging a hidden Markov model to describe the asynchronous mode switching and the double expectation formula. Finally, a spring system model subject to a Markov chain is employed to validate the effectiveness of the quantized filter design approaches.

DNA Computing with Water Strider Based Vector Quantization for Data Storage Systems

The exponential growth of data necessitates an effective data storage scheme,which helps to effectively manage the large quantity of data.To accomplish this,Deoxyribonucleic Acid(DNA)digital data storage process can be employed,which encodes and decodes binary data to and from synthesized strands of DNA.Vector quantization(VQ)is a commonly employed scheme for image compression and the optimal codebook generation is an effective process to reach maximum compression efficiency.This article introduces a newDNAComputingwithWater StriderAlgorithm based Vector Quantization(DNAC-WSAVQ)technique for Data Storage Systems.The proposed DNAC-WSAVQ technique enables encoding data using DNA computing and then compresses it for effective data storage.Besides,the DNAC-WSAVQ model initially performsDNA encoding on the input images to generate a binary encoded form.In addition,aWater Strider algorithm with Linde-Buzo-Gray(WSA-LBG)model is applied for the compression process and thereby storage area can be considerably minimized.In order to generate optimal codebook for LBG,the WSA is applied to it.The performance validation of the DNAC-WSAVQ model is carried out and the results are inspected under several measures.The comparative study highlighted the improved outcomes of the DNAC-WSAVQ model over the existing methods.

A Secure and Effective Energy-Aware Fixed-Point Quantization Scheme for Asynchronous Federated Learning

Asynchronous federated learning(AsynFL)can effectivelymitigate the impact of heterogeneity of edge nodes on joint training while satisfying participant user privacy protection and data security.However,the frequent exchange of massive data can lead to excess communication overhead between edge and central nodes regardless of whether the federated learning(FL)algorithm uses synchronous or asynchronous aggregation.Therefore,there is an urgent need for a method that can simultaneously take into account device heterogeneity and edge node energy consumption reduction.This paper proposes a novel Fixed-point Asynchronous Federated Learning(FixedAsynFL)algorithm,which could mitigate the resource consumption caused by frequent data communication while alleviating the effect of device heterogeneity.FixedAsynFL uses fixed-point quantization to compress the local and global models in AsynFL.In order to balance energy consumption and learning accuracy,this paper proposed a quantization scale selection mechanism.This paper examines the mathematical relationship between the quantization scale and energy consumption of the computation/communication process in the FixedAsynFL.Based on considering the upper bound of quantization noise,this paper optimizes the quantization scale by minimizing communication and computation consumption.This paper performs pertinent experiments on the MNIST dataset with several edge nodes of different computing efficiency.The results show that the FixedAsynFL algorithm with an 8-bit quantization can significantly reduce the communication data size by 81.3%and save the computation energy in the training phase by 74.9%without significant loss of accuracy.According to the experimental results,we can see that the proposed AsynFixedFL algorithm can effectively solve the problem of device heterogeneity and energy consumption limitation of edge nodes.

Metaheuristics with Vector Quantization Enabled Codebook Compression Model for Secure Industrial Embedded Environment

At the present time,the Industrial Internet of Things(IIoT)has swiftly evolved and emerged,and picture data that is collected by terminal devices or IoT nodes are tied to the user's private data.The use of image sensors as an automa-tion tool for the IIoT is increasingly becoming more common.Due to the fact that this organisation transfers an enormous number of photographs at any one time,one of the most significant issues that it has is reducing the total quantity of data that is sent and,as a result,the available bandwidth,without compromising the image quality.Image compression in the sensor,on the other hand,expedites the transfer of data while simultaneously reducing bandwidth use.The traditional method of protecting sensitive data is rendered less effective in an environment dominated by IoT owing to the involvement of third parties.The image encryp-tion model provides a safe and adaptable method to protect the confidentiality of picture transformation and storage inside an IIoT system.This helps to ensure that image datasets are kept safe.The Linde–Buzo–Gray(LBG)methodology is an example of a vector quantization algorithm that is extensively used and a rela-tively new form of picture reduction known as vector quantization(VQ).As a result,the purpose of this research is to create an artificial humming bird optimi-zation approach that combines LBG-enabled codebook creation and encryption(AHBO-LBGCCE)for use in an IIoT setting.In the beginning,the AHBO-LBGCCE method used the LBG model in conjunction with the AHBO algorithm in order to construct the VQ.The Burrows-Wheeler Transform(BWT)model is used in order to accomplish codebook compression.In addition,the Blowfish algorithm is used in order to carry out the encryption procedure so that security may be attained.A comprehensive experimental investigation is carried out in order to verify the effectiveness of the proposed algorithm in comparison to other algorithms.The experimental values ensure that the suggested approach and the outcomes are examined in a variety of different perspectives in order to further enhance them.

Path Integral Quantization of Non-Natural Lagrangian

Path integral technique is discussed using Hamilton Jacobi method. The Hamilton Jacobi function of non-natural Lagrangian is obtained using separation of variables method. This function makes an important role in path integral quantization. The path integral is obtained as integration over the canonical phase space coordinates, which contains the generalized coordinate q and the generalized momentum p. One illustrative example is considered to explain the application of our formalism.

Quantization of Time Independent Damping Systems Using WKB Approximation

In this work time independent damping systems are studied using Lagrangian and Hamiltonian for time independent damping, which are present through the factor eλq. The Hamilton Jacobi equation is formulated to find the Hamilton Jacobi function S using separation of variables technique. We can form this function in compact form of two parts the first part as a function of coordinate q, and the second part as a function of time t. Finally, we find the ability of these systems to quantize through an illustrative example.

Photon Structure and Wave Function from the Vector Potential Quantization

A photon structure is advanced based on the experimental evidence and the vector potential quantization at a single photon level. It is shown that the photon is neither a point particle nor an infinite wave but behaves rather like a local “wave-corpuscle” extended over a wavelength, occupying a minimum quantization volume and guided by a non-local vector potential real wave function. The quantized vector potential oscillates over a wavelength with circular left or right polarization giving birth to orthogonal magnetic and electric fields whose amplitudes are proportional to the square of the frequency. The energy and momentum are carried by the local wave-corpuscle guided by the non-local vector potential wave function suitably normalized.

Quantization of the Kinetic Energy of Deterministic Chaos

In previous works, the theoretical and experimental deterministic scalar kinematic structures, the theoretical and experimental deterministic vector kinematic structures, the theoretical and experimental deterministic scalar dynamic structures, and the theoretical and experimental deterministic vector dynamic structures have been developed to compute the exact solution for deterministic chaos of the exponential pulsons and oscillons that is governed by the nonstationary three-dimensional Navier-Stokes equations. To explore properties of the kinetic energy, rectangular, diagonal, and triangular summations of a matrix of the kinetic energy and general terms of various sums have been used in the current paper to develop quantization of the kinetic energy of deterministic chaos. Nested structures of a cumulative energy pulson, an energy pulson of propagation, an internal energy oscillon, a diagonal energy oscillon, and an external energy oscillon have been established. In turn, the energy pulsons and oscillons include group pulsons of propagation, internal group oscillons, diagonal group oscillons, and external group oscillons. Sequentially, the group pulsons and oscillons contain wave pulsons of propagation, internal wave oscillons, diagonal wave oscillons, and external wave oscillons. Consecutively, the wave pulsons and oscillons are composed of elementary pulsons of propagation, internal elementary oscillons, diagonal elementary oscillons, and external elementary oscillons. Topology, periodicity, and integral properties of the exponential pulsons and oscillons have been studied using the novel method of the inhomogeneous Fourier expansions via eigenfunctions in coordinates and time. Symbolic computations of the exact expansions have been performed using the experimental and theoretical programming in Maple. Results of the symbolic computations have been justified by probe visualizations.

带有状态/输入量化的无人船自适应模糊跟踪控制

针对海上通讯带宽受限情况下无人船的航迹跟踪控制问题,设计了一种带有状态量化和输入量化的自适应反馈跟踪控制方案。在保证有效跟踪的同时,减少执行器执行频次,降低控制幅度。首先,在不考虑量化情况下基于自适应反步法设计了系统跟踪控制律,并结合动态面技术有效降低了虚拟控制律的计算量膨胀问题。对于控制系统中存在的不确定项,利用模糊逻辑系统进行逼近。其次,采用均匀量化器分别对控制系统中的状态变量和输入变量进行量化,且量化后的状态反馈信息被用于无人船航迹跟踪控制器的设计。根据所得到的量化信息,给出了同时考虑状态量化和输入量化的无人船航迹跟踪控制律。在稳定性分析中,通过Lyapunov稳定性理论证明了在不考虑量化的情况下闭环控制系统的稳定性,并根据递归的方法证明了闭环控制系统中量化变量和非量化变量之间误差的有界性。基于给定的引理,最终证明了在同时考虑状态量化和输入量化的情况下,所设计的带有状态量化和输入量化的模糊自适应反馈跟踪控制系统的稳定性。最后,通过两组仿真实验验证了所提方案的实用性。即在同时考虑状态量化和输入量化的情况下,无人船仍能保持对理想轨迹良好的跟踪性能,并有效减轻了执行器的执行频次,更符合航海工程实践。

带有状态/输入量化的无人艇航向跟踪控制

[目的]针对水面无人艇(USV)的海上通信受限的问题,提出一种带有状态/输入量化的USV航向跟踪控制方法。[方法]基于反步法设计系统控制律,结合动态面技术降低虚拟控制律的计算量膨胀问题。对于控制系统中存在的不确定项及外界干扰,利用扩张状态观测器(ESO)进行估计。采用均匀量化器分别对控制系统中的状态变量和控制输入进行量化,且量化后的状态反馈信息仅用于跟踪控制。利用量化状态递归设计基于ESO的USV航向控制器,证明闭环控制系统中量化变量和非量化变量间误差的有界性。[结果]基于李雅普诺夫稳定性理论,提出了量化误差考量及闭环系统稳定性判定方法,严格证明了所设计的带有状态量化和输入量化的USV航向跟踪控制系统的稳定性,仿真实验验证了该控制策略的有效性。[结论]结果表明,所提方法可为USV航向跟踪控制提供借鉴。

含丢包和量化的网络控制系统随机鲁棒稳定

针对一类含有随机丢包和考虑信号量化情况下的网络控制系统,通过量化状态反馈控制方法,研究了系统的随机鲁棒稳定性问题。采用满足伯努利分布的随机变量对丢包过程进行建模;同时,采用对数量化器对传感器-控制器通道的信号进行量化,利用扇形界的方法将产生的量化误差描述为扇形界的不确定性。设计状态反馈控制器,结合所设计的量化器和随机丢包模型,利用Lyapunov函数和线性矩阵不等式方法得到系统稳定和鲁棒稳定的充分条件。最后,利用数值仿真实例验证了所提方法的有效性。

基于高倍过采样与加窗插值FFT的电力谐波分析

为提高谐波分析精度,分析了信号加窗引起的信噪比损失以及AD转换产生的量化误差,阐述了过采样技术提高信噪比的原理。在此基础上,提出了基于高倍过采样和加窗插值快速傅里叶变换(fast Fourier transform, FFT)的谐波分析方法。该方法充分利用AD转换器的潜力,以尽量高的采样速率进行AD采样,同时通过均值滤波避免高倍过采样引起的采样数据量激增问题。详细研究了所提谐波分析方法对信号中谐波分量幅值和相位的影响,并给出了简洁实用的谐波幅值和相位校正方法。仿真表明,所提方法可在不增加系统成本的前提下改善加窗插值FFT的抗噪声能力,提高谐波分析精度。

基于最大均值差异的能量侧信道泄露量化评估

能量侧信道分析是通过对密码设备运行时的能量消耗进行分析,推导出运行时的操作及操作涉及的敏感中间值.对密码设备进行能量泄露量化评估是分析密码设备信息泄露程度的重要手段,目前主流的评估方案主要关注于能量迹上单个样本点的泄露,并未充分考虑高阶攻击模型下的泄露评估问题,对于采用掩码防御措施的密码芯片来说,一旦发生泄露,通常表现为多变量联合泄露,因此采用传统的单样本点方法进行泄露评估会存在假阴性的问题.本文研究多点联合泄露评估问题,引入最大均值差异方法,提取能量迹的多变量联合特征,构建基于最大均值差异的能量泄露量化评估模型,提供了一种有效的能量侧信道泄露量化评估方法.通过实现无防御对策和有防御对策的AES算法,使用DPA contest v2、ASCAD v1和自采能量迹数据集进行实验,结果表明,基于最大均值差异的泄露量化评估方法能够有效降低单样本点检测方法出现假阴性的风险,HAC、MTD和Bartlett-F检验的对照结果也进一步验证了该方法的有效性.

基于光谱成像仪的量子化能级测试与分析

以反射式光栅和CCD为核心器件,搭建了反射式光谱成像仪,开发程序对CCD输出的光敏像元与待测光谱波长之间的关系进行快速定标和可视化处理,进而对特定气体原子或分子的量子化能级进行测试和光谱分析,并对该量子化能级测量试验仪的性能进行了评估与不确定评定.实验系统的搭建与测试,增加了学生的动手能力,加深了学生对能级的量子化、原子内部结构和运动特征等知识的深入理解.

具有介质访问约束的网络化控制系统H∞状态估计

研究了一类存在介质访问约束和信号量化的网络化控制系统的H∞状态估计问题。首先,考虑到介质访问约束和信号量化的影响,将信号量化误差转化为扇形有界的不确定性,对由于访问约束而未获得网络传输的系统输出采用加权补偿策略,根据网络介质的随机访问机制将网络化系统建模为具有不确定性的马尔可夫跳跃系统。然后,在此基础上借助李雅普诺夫稳定性理论和H∞性能约束条件,利用线性矩阵不等式(linear matrix inequality,LMI)方法给出状态估计器存在的充分条件,所设计的状态估计器使得估计误差系统渐近稳定且具有给定的H∞性能。最后,通过仿真实例验证了该设计方法的有效性。

钬离子掺杂氟氧钇亚微米晶的荧光量子化表征与温度传感特性研究

采用水热合成法和高温煅烧法相结合制备了Ho^(3+)/Yb^(3+)共掺杂三方晶系的YOF亚微米晶体,该晶体具有较强的量子产率和良好的灵敏度。在977 nm激光泵浦下对晶体颗粒的上转换发光性能进行表征,利用荧光光谱测试系统绘制出样品的光谱功率分布。计算了光量子数分布和量子产率等绝对荧光参量。展示了在303~433 K温度范围内的荧光上转换发光性能并计算了灵敏度。测试结果表明,在977 nm激光激发下泵浦功率密度为73 m W/mm~2时,总光通量达到3.35 mlm,Ho^(3+)的绿光和红光的量子产率分别为2.97×10^(-5)和1.40×10^(-5),较高的量子产率确保了足够的荧光强度来实现温度反馈。在303 K时有最大相对灵敏度为0.437%K^(-1),当温度升至433 K时相对灵敏度仍能保持在0.331%K^(-1)。因此Ho^(3+)/Yb^(3+)共掺杂YOF亚微米晶体作为一种高效发光和高温度灵敏度材料为温度传感领域提供了一种潜在的选择。