Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

AN ADAPTIVE AQM TO PROVIDE DELAY GUARANTEES FOR DIFFERENTIATED SERVICES

RIO(RED with IN and OUT) is the primary queue management mechanism proposed for assured forwarding in the DiffServ (Differentiated Service) framework. Although RIO can generally provide bandwidth guarantees, its queuing delay is sensitive to the traffic load. This paper presents a qualitative explanation for its origin. As a solution, an Adaptive RIO for Delay (ARIO-D) is proposed to provide guaranteed delay for multimedia traffic. Simulation results show that by trading loss for delay, ARIO-D can effectively improve the robustness of RIO under different and dynamic traffic, and provide stable and differentiated performance of queuing delay without any degradation in performance of throughput.

Modeling Policyholder Behavior through Insurance Resonant Marts for Pricing Options and Guarantees

Background: The 11th Annual Conference of Asia-Pacific Risk and Insurance Association was held on July 22-25, 2007 in Taipei, Taiwan. The first author participated in this annual conference where he met the second author who was invited to deliver two plenary speeches on Corporate Governance and Financial Institution Regulation [1] and Alternative Investments for Financial Institutions [2]. The first author was then working as consultant with i-flex solutions, a subsidiary of Oracle and the second author was Vice President of Strategic Business Initiatives Units at ING Life Insurance in its Taiwan operation. The two authors decided to start collaborating on a research paper titled “Modeling Policyholder Behavior through Insurance Resonant Marts for Pricing Options and Guarantees.” The first version of the paper was submitted for research purposes to ING Insurance Risk Management Global Conference 2007 [3] which was held in Beijing, China. Although it was neither presented nor published, the working draft was constantly updated and revised. In 2015, after eight years of continuous research collaboration, the two authors decided to submit the final version of the paper to the 5th World Congress on Engineering and Technology for scholarly presentation. Aim: The competition in the insurance industry is extremely fierce. Insurance companies are under tremendous pressure to retain and increase their customer base, to offer services at attractive rates and provide returns competitive with mutual funds, equities and banks, to achieve profitability across various lines of insurance, to comply with statutory norms etc. Despite having the best of breeds, such as accountants, actuaries [4], lawyers, underwriters, IT experts, consultants, etc., many insurance companies face severe problems to cope with and survive under such pressures. Insurance companies are now striving towards creating innovative products that can match the expectation of the customers with respect to investment returns and risk coverage at competitive rates, which is a very challenging task. Also it is very important to measure the expectations of the customers keeping in mind that those customers are already owners of other financial products. Pricing always follows the expectations and without proper data support, Model risk is imminent. Even if a product is correctly priced, without understanding the behavior of the policyholder towards various financial products will lead to heavy lapses [4]. The authors describe a new framework called UIRDM Approach (Unified Insurance Resonant Data Mart) for the insurance companies wherein this approach stresses the need to think beyond the insurance boundaries.

The impact of the Rural Minimum Living Standard Guarantee(Rural Dibao)Program on child nutrition outcomes

The Rural Minimum Living Standard Guarantee(Rural Dibao)is an important unconditional cash transfer program to alleviate poverty in rural China.Despite the importance of children’s nutrition in breaking poverty cycles,little is known about the impact of Rural Dibao on child nutrition outcomes.Using China Family Panel Studies(CFPS),this paper examines the effects of Rural Dibao on child nutrition outcomes and investigates potential pathways and heterogeneous effects.We exploit propensity score matching and difference-in-differences techniques to evaluate the effects of the Rural Dibao program on child nutrition outcomes.Our results suggest that Rural Dibao significantly impacts the nutrition outcomes of children up to 15 years of age.Specifically,our results suggest that Rural Dibao improves child height-to-age z-scores by 1.05 standard deviations and lowers the probability of stunting by 11.9 percentage points.Additional analyses suggest that increased protein intake is the main pathway through which Rural Dibao participation contributes to better nutrition outcomes.We also find that the effect of the program is more pronounced among girls,children who are non-left-behind or live with highly educated mothers,and those from low-income families and poor areas.Our findings suggest that Rural Dibao participation helps improve child nutrition outcomes through improving diet quality.

Improving China's Legal System for Product Quality Guarantees ——A legal analysi s of product quality guarantee regulation by the Government

It is the responsibility of governments to supervise and regulateproduct quality to protect consumers and prevent failures in the product qualityguarantee system.Appropriate supervision will help safeguard the interests ofconsumers,promote product quality,and resolve disputes.The extent of supervisionshould be guided by the principle of need for state intervention andneeds to be highly diversified.

Local Government Implicit Guarantees in China＇ s Farmland Financial System

With the massive and intensive development of the operation mode of rural land in China,the financing problem of the new rural land managers has gradually attracted more attention.The reasonable design of farmland financial system is of great importance to promote rural financial resource allocation optimization.This paper chooses two types of measures of local government implicit guarantees which are commonly used in promoting rural land mortgage loan.The measures are establishing guarantee mechanism to provide guaranties to borrowers and purchasing debt assets from financial institutions.The analysis framework is based on the financing ability theory of Holmstrom &Tirole.Research shows that when considering the collateral disposal cost,the two measures both could contribute to expand the coverage of farmland financial service.Meanwhile,local government implicit guarantees also exists some negative effects.The suggestions of the paper are reducing the collateral disposal costs of farmland loan /encouraging the market-oriented guarantee institutions to enter the rural credit market further standardizing the operation of policy guarantee mechanism and making the use range of risk fund and disposal fund clear.

Joint computation offloading and parallel scheduling to maximize delay-guarantee in cooperative MEC systems

The growing development of the Internet of Things(IoT)is accelerating the emergence and growth of new IoT services and applications,which will result in massive amounts of data being generated,transmitted and pro-cessed in wireless communication networks.Mobile Edge Computing(MEC)is a desired paradigm to timely process the data from IoT for value maximization.In MEC,a number of computing-capable devices are deployed at the network edge near data sources to support edge computing,such that the long network transmission delay in cloud computing paradigm could be avoided.Since an edge device might not always have sufficient resources to process the massive amount of data,computation offloading is significantly important considering the coop-eration among edge devices.However,the dynamic traffic characteristics and heterogeneous computing capa-bilities of edge devices challenge the offloading.In addition,different scheduling schemes might provide different computation delays to the offloaded tasks.Thus,offloading in mobile nodes and scheduling in the MEC server are coupled to determine service delay.This paper seeks to guarantee low delay for computation intensive applica-tions by jointly optimizing the offloading and scheduling in such an MEC system.We propose a Delay-Greedy Computation Offloading(DGCO)algorithm to make offloading decisions for new tasks in distributed computing-enabled mobile devices.A Reinforcement Learning-based Parallel Scheduling(RLPS)algorithm is further designed to schedule offloaded tasks in the multi-core MEC server.With an offloading delay broadcast mechanism,the DGCO and RLPS cooperate to achieve the goal of delay-guarantee-ratio maximization.Finally,the simulation results show that our proposal can bound the end-to-end delay of various tasks.Even under slightly heavy task load,the delay-guarantee-ratio given by DGCO-RLPS can still approximate 95%,while that given by benchmarked algorithms is reduced to intolerable value.The simulation results are demonstrated the effective-ness of DGCO-RLPS for delay guarantee in MEC.

China's Employment Promotion Law Guarantees Right to Employment

China＇s legislature is soliciting comments and suggestions to the draft of Employment Promotion Law as an endeavor to democratize its process of legislation. Up to April 25 the National People＇s Congress had received over 11,000 items of comments and suggestions.

Guarantee Strategy for the Safety of Agricultural Industry in Hunan Province

The safety of agricultural industry in Hunan Province shows an upward trend from"basically safe"to"very safe",but the state in the"safe"or"very safe"range is still unstable.In view of this,Hunan Province should guarantee the agricultural production ability,cultivate and enhance the core competitiveness of agriculture,firmly grasp the agricultural control power,attach importance to the export quality of agri-cultural products and other aspects to ensure the safety of agricultural industry.

基于Assume-Guarantee搜索复用的C程序验证方法

提出了一种基于Assume-Guarantee搜索复用的验证方法,对C程序源代码进行验证.其思想是,在程序的每点处都引入一个保守假设条件,并假设从任意点出发,变量取值满足该点假设条件的所有执行路径都不会违背给定性质,然后根据这些假设条件遍历所有可能的执行路径以验证给定的时序安全性质,并在遍历的过程中验证这些假设条件是否满足,如果不满足,则不断对其精化和加强.验证方法总是在保证假设条件可靠的前提下尽量使用较弱的条件,使得大量的执行路径由于满足假设条件而可以搜索复用,从而降低验证代价.应用该方法验证了Linux操作系统中SSL协议的实现程序openssl-0.9.6c满足SSL协议的初始握手规范.实验结果表明,该方法具有良好的实用性和可扩展性.

Research on Guaranteed Scheduling Algorithms

Guaranteed scheduling is necessary for hard real time systems, because each process of them must meet their deadline, or a serious consequence will result.In this paper we discuss two guaranteed schedule algorithms:backtracking and branch and bound,introduce the process to find the optimal solution by both methods,propose the concept of logical node and physical node.Through some experiments for different process sets,we have made comparisons between the two algorithms in branch nodes,comparing time,topology of the search tree,memory size needed,etc.

Establishment of Safety Guarantee System of Mountainous Tourism——A Case Study of High and Higher Mountains

After summarizing researches on domestic and foreign tourism safety,it was found that there were few research results on mountainous tourism safety,especially tourism safety and tourism safety guarantee system of high and higher mountains with high risk.The paper had concluded hidden dangers and sources of safe accidents of mountainous tourism,and studied tourism safety guarantee system of high and higher mountains.Furthermore,it proposed that tourism safety guarantee system was composed of tourism safety policies and regulations,tourism precaution,tourism safety control,tourism safety rescue and tourism insurance;and finally pointed out components of each factor.

The Present Situation of Chattel Guarantee System and Its Improvements—Taking the Angle of American Uniform Commercial Code(UCC)

Although there are appropriate stipulations for the chattel guarantees in the law of China, this guarantee system could not adapt to the request of economy's development because of the following reasons: the scope of chattel guarantees is narrow according to relevant stipulations; the transaction cost of the chattel is high; mortgage registration of chattel is in a mess; lack of efficiently executive guarantee system, etc. To counter the problems existing in the present Chinese chattel guarantee system, in this article, the author proposed some corresponding suggestions and countermeasures, hoping to perfect the chattel guarantee system in China.

Decentralized robust guaranteed cost control for a class of interconnected singular large-scale systems with time-delay and parameter uncertainty

The decentralized robust guaranteed cost control problem is studied for a class of interconnected singular large-scale systems with time-delay and norm-bounded time-invariant parameter uncertainty under a given quadratic cost performance function. The problem that is addressed in this study is to design a decentralized robust guaranteed cost state feedback controller such that the closed-loop system is not only regular, impulse-free and stable, but also guarantees an adequate level of performance for all admissible uncertainties. A sufficient condition for the existence of the decentralized robust guaranteed cost state feedback controllers is proposed in terms of a linear matrix inequality （LMI） via LMI approach. When this condition is feasible, the desired state feedback decentralized robust guaranteed cost controller gain matrices can be obtained. Finally, an illustrative example is provided to demonstrate the effectiveness of the proposed approach.

Guaranteed Cost Consensus for High-dimensional Multi-agent Systems With Time-varying Delays

Guaranteed cost consensus analysis and design problems for high-dimensional multi-agent systems with time varying delays are investigated. The idea of guaranteed cost con trol is introduced into consensus problems for high-dimensiona multi-agent systems with time-varying delays, where a cos function is defined based on state errors among neighboring agents and control inputs of all the agents. By the state space decomposition approach and the linear matrix inequality(LMI)sufficient conditions for guaranteed cost consensus and consensu alization are given. Moreover, a guaranteed cost upper bound o the cost function is determined. It should be mentioned that these LMI criteria are dependent on the change rate of time delays and the maximum time delay, the guaranteed cost upper bound is only dependent on the maximum time delay but independen of the Laplacian matrix. Finally, numerical simulations are given to demonstrate theoretical results.

Delay-independent robust guaranteed-cost control for uncertain linear neutral systems

This article concerns the delay-independent guaranteed-cost control problem via memoryless state feedback for a class of neutral-type systems with structural uncertainty and a given quadratic cost function. New delay-independent conditions for the existence of the guaranteed-cost controller are presented in the term of LMIs. An algorithm involving optimization is proposed to design a controller achieving an optimal guaranteed-cost, such that, the system can be stabilized for all admissible uncertainties. A numerical example is provided to illustrate the feasibility of the proposed method.

The eco-environmental guarantee for China's urbanization process

Studying the change of resources consumption and eco-environmental carrying capacity are of importance to the sustainable development of urbanization.Based on the China's economic and social statistical data from 1950 to 2006,the ecological footprint,eco-logical footprint intensity,ecological deficit and surplus,and eco-environment quality com-prehensive index are calculated,the correlation between urbanization and eco-environmental change is analyzed and the eco-environmental guarantee for China's urbanization in 2030 is forecasted.The major results could be summarized as follows:(1) there is a positive linear relation between urbanization and ecological footprint,negative linear relation between ur-banization and ecological footprint intensity,ecological deficit and surplus and the negative exponential relation between urbanization and eco-environment quality comprehensive index.(2) By 2030,the urbanization level will reach 61.32%,the ecological deficit will increase to 42.2866×108 hm2 and the eco-environment quality comprehensive index will drop to 0.3016 on the condition that the total quantity ecological footprint achieves 55.9348×108 hm2.(3) Under the existing urban development pattern,the ecological overload will be more serious in the next 24 years.Constructing the reasonable industrial structure and establishing the intensive resources utilization system to alleviate the eco-environmental pressure are the tough challenges in China's urbanization process.

Guaranteed cost control with constructing switching law of uncertain discrete-time switched systems

A guaranteed cost control problem for a class of linear discrete-time switched systems with norm-bounded uncertainties is considered in this article. The purpose is to construct a switching rule and design a state feedback control law, such that, the closed-loop system is asymptotically stable and the closed-loop cost function value is not more than a specified upper bound for all admissible uncertainties under the constructed switching rule. A sufficient condition for the existence of guaranteed cost controllers and switching rules is derived based on the Lyapunov theory together with the linear matrix inequality （LMI） approach. Furthermore, a convex optimization problem with LMI constraints is formulated to select the suboptimal guaranteed cost controller. A numerical example demonstrates the validity of the proposed design approach.

Robust reliable guaranteed cost control for uncertain singular systems with time-delay

The robust reliable guaranteed cost control for uncertain singular delay systems with actuator failures and a given quadratic cost function is studied. The system under consideration involves constant time-delay and norm-bounded parameter uncertainties. The purpose is to design state feedback controllers which can tolerate actuator failure, such that the closed-loop system is stable, and the specified cost function has an upper bound for all admissible uncertainties. The sufficient conditions for the solvability of this problem are obtained by a linear matrix inequality （LMI） method. Furthermore, a numerical example is given to demonstrate the applicability of the proposed approach.