Path Planning and Tracking Control for Parking via Soft Actor-Critic Under Non-Ideal Scenarios

Parking in a small parking lot within limited space poses a difficult task. It often leads to deviations between the final parking posture and the target posture. These deviations can lead to partial occupancy of adjacent parking lots, which poses a safety threat to vehicles parked in these parking lots. However, previous studies have not addressed this issue. In this paper, we aim to evaluate the impact of parking deviation of existing vehicles next to the target parking lot(PDEVNTPL) on the automatic ego vehicle(AEV) parking, in terms of safety, comfort, accuracy, and efficiency of parking. A segmented parking training framework(SPTF) based on soft actor-critic(SAC) is proposed to improve parking performance. In the proposed method, the SAC algorithm incorporates strategy entropy into the objective function, to enable the AEV to learn parking strategies based on a more comprehensive understanding of the environment. Additionally, the SPTF simplifies complex parking tasks to maintain the high performance of deep reinforcement learning(DRL). The experimental results reveal that the PDEVNTPL has a detrimental influence on the AEV parking in terms of safety, accuracy, and comfort, leading to reductions of more than 27%, 54%, and 26%respectively. However, the SAC-based SPTF effectively mitigates this impact, resulting in a considerable increase in the parking success rate from 71% to 93%. Furthermore, the heading angle deviation is significantly reduced from 2.25 degrees to 0.43degrees.

Robust fixed-time flight controller for a dual-system convertible UAV in the cruise mode

This paper investigates the attitude tracking control problem for the cruise mode of a dual-system convertible unmanned aerial vehicle(UAV)in the presence of parameter uncertainties,unmodeled uncertainties and wind disturbances.First,a fixed-time disturbance observer(FXDO)based on the bi-limit homogeneity theory is designed to estimate the lumped disturbance of the convertible UAV model.Then,a fixed-time integral sliding mode control(FXISMC)is combined with the FXDO to achieve strong robustness and chattering reduction.Bi-limit homogeneity theory and Lyapunov theory are applied to provide detailed proof of the fixed-time stability.Finally,numerical simulation experimental results verify the robustness of the proposed algorithm to model parameter uncertainties and wind disturbances.In addition,the proposed algorithm is deployed in a open-source UAV autopilot and its effectiveness is further demonstrated by hardware-in-the-loop experimental results.

Ultimately Bounded Output Feedback Control for Networked Nonlinear Systems With Unreliable Communication Channel: A Buffer-Aided Strategy

This paper concerns ultimately bounded output-feedback control problems for networked systems with unknown nonlinear dynamics. Sensor-to-observer signal transmission is facilitated over networks that has communication constraints.These transmissions are carried out over an unreliable communication channel. In order to enhance the utilization rate of measurement data, a buffer-aided strategy is novelly employed to store historical measurements when communication networks are inaccessible. Using the neural network technique, a novel observer-based controller is introduced to address effects of signal transmission behaviors and unknown nonlinear dynamics.Through the application of stochastic analysis and Lyapunov stability, a joint framework is constructed for analyzing resultant system performance under the introduced controller. Subsequently, existence conditions for the desired output-feedback controller are delineated. The required parameters for the observerbased controller are then determined by resolving some specific matrix inequalities. Finally, a simulation example is showcased to confirm method efficacy.

Path Tracking Controller Design of Automated Parking Systems via NMPC with an Instructible Solution

Parking difficulties have become a social issue that people have to solve.Automated parking system is practicable for quick par operations without a driver which can also greatly reduces the probability of parking accidents.The paper proposes a Lyapunov-based nonlinear model predictive controller embedding an instructable solution which is generated by the modified rear-wheel feedback method(RF-LNMPC)in order to improve the overall path tracking accuracy in parking conditions.Firstly,A discrete-time RF-LNMPC considering the position and attitude of the parking vehicle is proposed to increase the success rate of automated parking effectively.Secondly,the RF-LNMPC problem with a multi-objective cost function is solved by the Interior-Point Optimization,of which the iterative initial values are described as the instructable solutions calculated by combining modified rear-wheel feedback to improve the performance of local optimal solution.Thirdly,the details on the computation of the terminal constraint and terminal cost for the linear time-varying case is presented.The closed-loop stability is verified via Lyapunov techniques by considering the terminal constraint and terminal cost theoretically.Finally,the proposed RF-LNMPC is implemented on a selfdriving Lincoln MKZ platform and the experiment results have shown improved performance in parallel and vertical parking conditions.The Monte Carlo analysis also demonstrates good stability and repeatability of the proposed method which can be applied in practical use in the near future.

On-Chip Micro Temperature Controllers Based on Freestanding Thermoelectric Nano Films for Low-Power Electronics

Multidimensional integration and multifunctional com-ponent assembly have been greatly explored in recent years to extend Moore’s Law of modern microelectronics.However,this inevitably exac-erbates the inhomogeneity of temperature distribution in microsystems,making precise temperature control for electronic components extremely challenging.Herein,we report an on-chip micro temperature controller including a pair of thermoelectric legs with a total area of 50×50μm^(2),which are fabricated from dense and flat freestanding Bi2Te3-based ther-moelectric nano films deposited on a newly developed nano graphene oxide membrane substrate.Its tunable equivalent thermal resistance is controlled by electrical currents to achieve energy-efficient temperature control for low-power electronics.A large cooling temperature difference of 44.5 K at 380 K is achieved with a power consumption of only 445μW,resulting in an ultrahigh temperature control capability over 100 K mW^(-1).Moreover,an ultra-fast cooling rate exceeding 2000 K s^(-1) and excellent reliability of up to 1 million cycles are observed.Our proposed on-chip temperature controller is expected to enable further miniaturization and multifunctional integration on a single chip for microelectronics.

Laboratory Implementation of Direct Torque Controller based Speed Loop Pseudo Derivative Feedforward Controller for PMSM Drive

This paper,evaluate the effectiveness of a proposed speed loop pseudo derivative feedforward(PDFF)controller-based direct torque controller(DTC)for a PMSM drive against the performance of existing PI speed controller-based DTC and hysteresis current controller(HCC).The proposed PDFF-based speed regulator effectively reduces oscillation and overshoot associated with rotor angular speed,electromagnetic torque,and stator current.Two case studies,one using forward-to-reverse motoring operation and the other involving reverse-to-forward braking operation,has been validated to show the effectiveness of the proposed control strategy.The proposed controller's superior performance is demonstrated through experimental verification utilizing an FPGA controller for a 1.5 kW PMSM drive laboratory prototype.

Enhancing Safety in Autonomous Vehicle Navigation:An Optimized Path Planning Approach Leveraging Model Predictive Control

This paper explores the application of Model Predictive Control(MPC)to enhance safety and efficiency in autonomous vehicle(AV)navigation through optimized path planning.The evolution of AV technology has progressed rapidly,moving from basic driver-assistance systems(Level 1)to fully autonomous capabilities(Level 5).Central to this advancement are two key functionalities:Lane-Change Maneuvers(LCM)and Adaptive Cruise Control(ACC).In this study,a detailed simulation environment is created to replicate the road network between Nantun andWuri on National Freeway No.1 in Taiwan.The MPC controller is deployed to optimize vehicle trajectories,ensuring safe and efficient navigation.Simulated onboard sensors,including vehicle cameras and millimeterwave radar,are used to detect and respond to dynamic changes in the surrounding environment,enabling real-time decision-making for LCM and ACC.The simulation resultshighlight the superiority of the MPC-based approach in maintaining safe distances,executing controlled lane changes,and optimizing fuel efficiency.Specifically,the MPC controller effectively manages collision avoidance,reduces travel time,and contributes to smoother traffic flow compared to traditional path planning methods.These findings underscore the potential of MPC to enhance the reliability and safety of autonomous driving in complex traffic scenarios.Future research will focus on validating these results through real-world testing,addressing computational challenges for real-time implementation,and exploring the adaptability of MPC under various environmental conditions.This study provides a significant step towards achieving safer and more efficient autonomous vehicle navigation,paving the way for broader adoption of MPC in AV systems.

Safe Motion Planning and Control Framework for Automated Vehicles with Zonotopic TRMPC

Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles(AVs).The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal trajectories that are individually optimized by the AV's planning layer.To address this issue,this study proposes a safe motion planning and control(SMPAC)framework for AVs.For the control layer,a dynamic model including multi-dimensional uncertainties is established.A zonotopic tube-based robust model predictive control scheme is proposed to constrain the uncertain system in a bounded minimum robust positive invariant set.A flexible tube with varying cross-sections is constructed to reduce the controller conservatism.For the planning layer,a concept of safety sets,representing the geometric boundaries of the ego vehicle and obstacles under uncertainties,is proposed.The safety sets provide the basis for the subsequent evaluation and ranking of the generated trajectories.An efficient collision avoidance algorithm decides the desired trajectory through the intersection detection of the safety sets between the ego vehicle and obstacles.A numerical simulation and hardware-in-the-loop experiment validate the effectiveness and real-time performance of the SMPAC.The result of two driving scenarios indicates that the SMPAC can guarantee the safety of automated driving under multi-dimensional uncertainties.

Contact detumbling toward a nutating target through deformable effectors and prescribed performance controller

Detumbling operation toward a rotating target with nutation is meaningful for debris removal but challenging. In this study, a deformable end-effector is first designed based on the requirements for contacting the nutating target. A dual-arm robotic system installed with the deformable end-effectors is modeled and the movement of the end-tips is analyzed. The complex operation of the contact toward a nutating target places strict requirements on control accuracy and controller robustness. Thus, an improvement of the tracking error transformation is proposed and an adaptive sliding mode controller with prescribed performance is designed to guarantee the fast and precise motion of the effector during the contact detumbling.Finally, by employing the proposed effector and the controller,numerical simulations are carried out to verify the effectiveness and efficiency of the contact detumbling toward a nutating target.

Hierarchical Controller Synthesis Under Linear Temporal Logic Specifications Using Dynamic Quantization

Linear temporal logic(LTL)is an intuitive and expressive language to specify complex control tasks,and how to design an efficient control strategy for LTL specification is still a challenge.In this paper,we implement the dynamic quantization technique to propose a novel hierarchical control strategy for nonlinear control systems under LTL specifications.Based on the regions of interest involved in the LTL formula,an accepting path is derived first to provide a high-level solution for the controller synthesis problem.Second,we develop a dynamic quantization based approach to verify the realization of the accepting path.The realization verification results in the necessity of the controller design and a sequence of quantization regions for the controller design.Third,the techniques of dynamic quantization and abstraction-based control are combined together to establish the local-to-global control strategy.Both abstraction construction and controller design are local and dynamic,thereby resulting in the potential reduction of the computational complexity.Since each quantization region can be considered locally and individually,the proposed hierarchical mechanism is more efficient and can solve much larger problems than many existing methods.Finally,the proposed control strategy is illustrated via two examples from the path planning and tracking problems of mobile robots.

Guaranteed Cost Attitude Tracking Control for Uncertain Quadrotor Unmanned Aerial Vehicle Under Safety Constraints

In this paper,guaranteed cost attitude tracking con-trol for uncertain quadrotor unmanned aerial vehicle(QUAV)under safety constraints is studied.First,an augmented system is constructed by the tracking error system and reference system.This transformation aims to convert the tracking control prob-lem into a stabilization control problem.Then,control barrier function and disturbance attenuation function are designed to characterize the violations of safety constraints and tolerance of uncertain disturbances,and they are incorporated into the reward function as penalty items.Based on the modified reward function,the problem is simplified as the optimal regulation problem of the nominal augmented system,and a new Hamilton-Jacobi-Bellman equation is developed.Finally,critic-only rein-forcement learning algorithm with a concurrent learning tech-nique is employed to solve the Hamilton-Jacobi-Bellman equa-tion and obtain the optimal controller.The proposed algorithm can not only ensure the reward function within an upper bound in the presence of uncertain disturbances,but also enforce safety constraints.The performance of the algorithm is evaluated by the numerical simulation.

Intelligent Fractional-Order Controller for SMES Systems in Renewable Energy-Based Microgrid

An autonomous microgrid that runs on renewable energy sources is presented in this article.It has a supercon-ducting magnetic energy storage(SMES)device,wind energy-producing devices,and an energy storage battery.However,because such microgrids are nonlinear and the energy they create varies with time,controlling and managing the energy inside them is a difficult issue.Fractional-order proportional integral(FOPI)controller is recommended for the current research to enhance a standalone microgrid’s energy management and performance.The suggested dedicated control for the SMES comprises two loops:the outer loop,which uses the FOPI to regulate the DC-link voltage,and the inner loop,responsible for regulating the SMES current,is constructed using the intelligent FOPI(iFOPI).The FOPI+iFOPI parameters are best developed using the dandelion optimizer(DO)approach to achieve the optimum performance.The suggested FOPI+iFOPI controller’s performance is contrasted with a conventional PI controller for variations in wind speed and microgrid load.The optimal FOPI+iFOPI controller manages the voltage and frequency of the load.The behavior of the microgrid as a reaction to step changes in load and wind speed was measured using the proposed controller.MATLAB simulations were used to evaluate the recommended system’s performance.The results of the simulations showed that throughout all interruptions,the recommended microgrid provided the load with AC power with a constant amplitude and frequency.In addition,the required load demand was accurately reduced.Furthermore,the microgrid functioned incredibly well despite SMES and varying wind speeds.Results obtained under identical conditions were compared with and without the best FOPI+iFOPI controller.When utilizing the optimal FOPI+iFOPI controller with SMES,it was found that the microgrid performed better than the microgrid without SMES.

Adaptive Sensor-Fault Tolerant Control of Unmanned Underwater Vehicles With Input Saturation

This paper investigates the tracking control problem for unmanned underwater vehicles(UUVs)systems with sensor faults,input saturation,and external disturbance caused by waves and ocean currents.An active sensor fault-tolerant control scheme is proposed.First,the developed method only requires the inertia matrix of the UUV,without other dynamic information,and can handle both additive and multiplicative sensor faults.Subsequently,an adaptive fault-tolerant controller is designed to achieve asymptotic tracking control of the UUV by employing robust integral of the sign of error feedback method.It is shown that the effect of sensor faults is online estimated and compensated by an adaptive estimator.With the proposed controller,the tracking error and estimation error can asymptotically converge to zero.Finally,simulation results are performed to demonstrate the effectiveness of the proposed method.

Two-Stage Planning of Distributed Power Supply and Energy Storage Capacity Considering Hierarchical Partition Control of Distribution Network with Source-Load-Storage

Aiming at the consumption problems caused by the high proportion of renewable energy being connected to the distribution network,it also aims to improve the power supply reliability of the power system and reduce the operating costs of the power system.This paper proposes a two-stage planning method for distributed generation and energy storage systems that considers the hierarchical partitioning of source-storage-load.Firstly,an electrical distance structural index that comprehensively considers active power output and reactive power output is proposed to divide the distributed generation voltage regulation domain and determine the access location and number of distributed power sources.Secondly,a two-stage planning is carried out based on the zoning results.In the phase 1 distribution network-zoning optimization layer,the network loss is minimized so that the node voltage in the area does not exceed the limit,and the distributed generation configuration results are initially determined;in phase 2,the partition-node optimization layer is planned with the goal of economic optimization,and the distance-based improved ant lion algorithm is used to solve the problem to obtain the optimal distributed generation and energy storage systemconfiguration.Finally,the IEEE33 node systemwas used for simulation.The results showed that the voltage quality was significantly improved after optimization,and the overall revenue increased by about 20.6%,verifying the effectiveness of the two-stage planning.

A Double-Interactively Recurrent Fuzzy Cerebellar Model Articulation Controller Model Combined with an Improved Particle Swarm Optimization Method for Fall Detection

In many Eastern and Western countries,falling birth rates have led to the gradual aging of society.Older adults are often left alone at home or live in a long-term care center,which results in them being susceptible to unsafe events(such as falls)that can have disastrous consequences.However,automatically detecting falls fromvideo data is challenging,and automatic fall detection methods usually require large volumes of training data,which can be difficult to acquire.To address this problem,video kinematic data can be used as training data,thereby avoiding the requirement of creating a large fall data set.This study integrated an improved particle swarm optimization method into a double interactively recurrent fuzzy cerebellar model articulation controller model to develop a costeffective and accurate fall detection system.First,it obtained an optical flow(OF)trajectory diagram from image sequences by using the OF method,and it solved problems related to focal length and object offset by employing the discrete Fourier transform(DFT)algorithm.Second,this study developed the D-IRFCMAC model,which combines spatial and temporal(recurrent)information.Third,it designed an IPSO(Improved Particle Swarm Optimization)algorithm that effectively strengthens the exploratory capabilities of the proposed D-IRFCMAC(Double-Interactively Recurrent Fuzzy Cerebellar Model Articulation Controller)model in the global search space.The proposed approach outperforms existing state-of-the-art methods in terms of action recognition accuracy on the UR-Fall,UP-Fall,and PRECIS HAR data sets.The UCF11 dataset had an average accuracy of 93.13%,whereas the UCF101 dataset had an average accuracy of 92.19%.The UR-Fall dataset had an accuracy of 100%,the UP-Fall dataset had an accuracy of 99.25%,and the PRECIS HAR dataset had an accuracy of 99.07%.

Leader trajectory planning method considering constraints of formation controller

To ensure safe flight of multiple fixed-wing unmanned aerial vehicles(UAVs)formation,considering trajectory planning and formation control together,a leader trajectory planning method based on the sparse A*algorithm is introduced.Firstly,a formation controller based on prescribed performance theory is designed to control the transient and steady formation configuration,as well as the formation forming time,which not only can form the designated formation configuration but also can guarantee collision avoidance and terrain avoidance theoretically.Next,considering the constraints caused by formation controller on trajectory planning such as the safe distance,turn angle and step length,as well as the constraint of formation shape,a leader trajectory planning method based on sparse A^(*)algorithm is proposed.Simulation results show that the UAV formation can arrive at the destination safely with a short trajectory no matter keeping the formation or encountering formation transformation.

基于ANN和XGB算法的锈蚀钢筋混凝土高温粘结强度预测方法

为准确评估锈蚀钢筋混凝土(CRC)结构在突发火灾下的结构承载力,锈蚀钢筋混凝土高温粘结强度的统一预测方法研究亟待开展。然而,粘结退化机理复杂,粘结因素众多,实验方法不能考虑所有粘结因素的相关复杂关系的影响。在现有大量试验数据的基础上,采用机器学习方法可以有效地通过数据建立输入和输出特征之间的回归关系。该文利用ANN和XGB两种机器学习算法建立了一个统一的锈蚀钢筋混凝土高温粘结强度预测模型。基于612组高温锈蚀钢筋混凝土的试验研究数据,进行模型训练和测试。结果表明:ML模型的预测结果与实验结果十分吻合。此外,针对机器学习算法本身存在的黑盒子问题,使用SHAP方法来解决锈蚀钢筋混凝土高温粘结强度预测过程中的模型可解释性问题。同时,还将ML模型的计算结果与三种理论计算公式的结果进行了比较,结果表明:ML模型具有明显的优势。新构建的混合机器学习模型很有可能成为准确评估CRC结构经受高温后的损伤程度问题的新选择。

基于ANN的RECFST短柱轴压承载力预测

目的针对相关设计规范和文献在计算圆端形截面钢管混凝土短柱轴压承载力上的局限性,开发高精高效的轴压承载力预测模型。方法首先,基于国内外已有的RECFST短柱轴压试验研究结果建立有限元模型,并通过验证;其次,基于Python脚本批量生成有限元模型,建立涵盖广泛输入参数的数据集;然后,利用数据集开发高精度的ANN模型并与相关规范和文献结果进行比较;最后,基于ANN模型开发GUI图形用户界面工具。结果ANN模型预测值与试验结果之比的平均值N ANN/N u=0.98,模型预测误差远低于相关规范和文献公式预测误差;ANN模型的均方误差K MSE=7.3734×10-7,总数据样本回归值R=0.99963,表明了ANN模型的有效性以及预测结果的精确性。结论ANN模型可以准确预测RECFST短柱的轴压承载力,基于模型开发的GUI工具简便实用。

基于SEM与ANN混合方法的社交问答平台用户转移行为

社交问答平台得到了用户的广泛使用,但由于各平台的功能类似,用户转移起来较为容易,这将导致用户流失。基于PPM模型,研究社交问答平台用户转移行为。采集447份有效数据,采用SEM(结构方程模型)与ANN(人工神经网络)混合方法进行分析。结果发现:推力因素(不满意度、厌倦性)和拉力因素(内容质量、用户体验)正向影响用户的转移意向,锚定因素(转移成本)负向影响转移意向,且负向调节推力因素和拉力因素的作用。ANN结果显示:不满意度是影响转移意向的最重要因素。因此,社交问答平台需要提高内容质量,改善用户体验,降低用户的不满意度和厌倦性,从而防止用户的转移行为,实现用户保持。

MPC-based Motion Planning and Control Enables Smarter and Safer Autonomous Marine Vehicles:Perspectives and a Tutorial Survey

Autonomous marine vehicles(AMVs)have received considerable attention in the past few decades,mainly because they play essential roles in broad marine applications such as environmental monitoring and resource exploration.Recent advances in the field of communication technologies,perception capability,computational power and advanced optimization algorithms have stimulated new interest in the development of AMVs.In order to deploy the constrained AMVs in the complex dynamic maritime environment,it is crucial to enhance the guidance and control capabilities through effective and practical planning,and control algorithms.Model predictive control(MPC)has been exceptionally successful in different fields due to its ability to systematically handle constraints while optimizing control performance.This paper aims to provide a review of recent progress in the context of motion planning and control for AMVs from the perceptive of MPC.Finally,future research trends and directions in this substantial research area of AMVs are highlighted.