Adaptive Multi-Step Evaluation Design With Stability Guarantee for Discrete-Time Optimal Learning Control

This paper is concerned with a novel integrated multi-step heuristic dynamic programming(MsHDP)algorithm for solving optimal control problems.It is shown that,initialized by the zero cost function,MsHDP can converge to the optimal solution of the Hamilton-Jacobi-Bellman(HJB)equation.Then,the stability of the system is analyzed using control policies generated by MsHDP.Also,a general stability criterion is designed to determine the admissibility of the current control policy.That is,the criterion is applicable not only to traditional value iteration and policy iteration but also to MsHDP.Further,based on the convergence and the stability criterion,the integrated MsHDP algorithm using immature control policies is developed to accelerate learning efficiency greatly.Besides,actor-critic is utilized to implement the integrated MsHDP scheme,where neural networks are used to evaluate and improve the iterative policy as the parameter architecture.Finally,two simulation examples are given to demonstrate that the learning effectiveness of the integrated MsHDP scheme surpasses those of other fixed or integrated methods.

Nonlinear system PID-type multi-step predictive control

A compound neural network was constructed during the process of identification and multi-step prediction. Under the PID-type long-range predictive cost function, the control signal was calculated based on gradient algorithm. The nonlinear controller’s structure was similar to the conventional PID controller. The parameters of this controller were tuned by using a local recurrent neural network on-line. The controller has a better effect than the conventional PID controller. Simulation study shows the effectiveness and good performance.

Chaos control of gear system with elastomeric web based on multi-parameter multi-step method

This paper employs a multi-parameter multi-step chaos control method, which is built up on the OGY method, to stabilize desirable UPOs of a gear system with elastomeric web as a high-dimensional and non-hyperbolic chaotic system, and the analyses are carried out. Three types of relations between components of a certain control parameter combination are defined in a certain control process. Special emphasis is put on the comparison of control efficiencies of the multi-parameter multi-step method and single-parameter multi-step method. The numerical experiments show the ability to switch between different orbits and the method can be a good chaos control alternative since it provides a more effective UPOs stabilization of high-dimensional and non-hyperbolic chaotic systems than the single-parameter chaos control, and according to the relation between components of each parameter combination, the best combination for chaos control in a certain UPO stabilization process are obtained.

Secure Data Sharing with Confidentiality,Integrity and Access Control in Cloud Environment

Cloud storage is an incipient technology in today’s world.Lack of security in cloud environment is one of the primary challenges faced these days.This scenario poses new security issues and it forms the crux of the current work.The current study proposes Secure Interactional Proof System(SIPS)to address this challenge.This methodology has a few key essential components listed herewith to strengthen the security such as authentication,confidentiality,access control,integrity and the group of components such as AVK Scheme(Access List,Verifier and Key Generator).It is challenging for every user to prove their identity to the verifier who maintains the access list.Verification is conducted by following Gulliou-Quisquater protocol which determines the security level of the user in multi-step authentication process.Here,RSA algorithm performs the key generation process while the proposed methodology provides data integrity as well as confidentiality using asymmetric encryption.Various methodological operations such as time consumption have been used as performance evaluators in the proposed SIPS protocol.The proposed solution provides a secure system for firm data sharing in cloud environment with confidentiality,authentication and access control.Stochastic Timed Petri(STPN)Net evaluation tool was used to verify and prove the formal analysis of SIPS methodology.This evidence established the effectiveness of the proposed methodology in secure data sharing in cloud environment.

A Content-Aware Bitrate Selection Method Using Multi-Step Prediction for 360-Degree Video Streaming

A content-aware multi-step prediction control(CAMPC)algorithm is proposed to determine the bitrate of 360-degree videos,aim⁃ing to enhance the quality of experience(QoE)of users and reduce the cost of video content providers(VCP).The CAMPC algorithm first em⁃ploys a neural network to generate the content richness and combines it with the current field of view(FOV)to accurately predict the probability distribution of tiles being viewed.Then,for the tiles in the predicted viewport which directly affect QoE,the CAMPC algorithm utilizes a multi-step prediction for future system states,and accordingly selects the bitrates of multiple subsequent steps,instead of an instantaneous state.Meanwhile,it controls the buffer occupancy to eliminate the impact of prediction errors.We implement CAMPC on players by building a 360-degree video streaming platform and evaluating other advanced adaptive bitrate(ABR)rules through the real network.Experimental results show that CAMPC can save 83.5%of bandwidth resources compared with the scheme that completely transmits the tiles outside the viewport with the Dynamic Adaptive Streaming over HTTP(DASH)protocol.Besides,the proposed method can improve the system utility by 62.7%and 27.6%compared with the DASH official and viewport-based rules,respectively.

Corrosion Properties of Light-weight and High-strength 2195 Al-Li Alloy

The intergranular corrosion and exfoliation corrosion of 2195 Al-Li alloy treated by multi-step heating-rate controlled aging （MSRC） are studied. The corrosion features of 2195 Al-Li alloys which are respectively treated by high-temperature nucleation MSRC （H-M） and low-temperature nucleation MSRC （L-M） are contrasted. And the corrosion mechanism of 2195 A1-Li alloy is also discussed from the viewpoint of microstructure （types, distribution, etc.） of the strengthening phase. The results show that 2195 A1-Li alloy after H-M is more susceptible to intergranular corrosion and exfoliation corrosion than that of alloy after L-M. The degree of intergranular corrosion increases with the increase of predeformation amount and the surface parallel to the rolling direction is more prone to exfoliation corrosion. The main reason of intergranular corrosion and exfoliation corrosion is the formation of corrosion galvanic couples among T1 phase, θ＇ phase and grain boundary precipitate-free zones （PFZ）.