Approximate Dynamic Programming for Self-Learning Control

This paper introduces a self-learning control approach based on approximate dynamic programming. Dynamic programming was introduced by Bellman in the 1950's for solving optimal control problems of nonlinear dynamical systems. Due to its high computational complexity, the applications of dynamic programming have been limited to simple and small problems. The key step in finding approximate solutions to dynamic programming is to estimate the performance index in dynamic programming. The optimal control signal can then be determined by minimizing (or maximizing) the performance index. Artificial neural networks are very efficient tools in representing the performance index in dynamic programming. This paper assumes the use of neural networks for estimating the performance index in dynamic programming and for generating optimal control signals, thus to achieve optimal control through self-learning.

Pollution Control Programs of Large-Scale Livestock and Poultry Farms in the Dianchi Lake Basin

With the enlarging scale and intensifying production of livestock and poultry breeding, the environment pollution becomes increasingly prominent in the Dianchi Lake Basin since 1990s. According to the survey of ＂The First National Census of Pollution Sources＂, occurrence and discharge of pollutants in large-scale livestock and poultry farms in this region were first understood. The pollution characteristics of large-scale live- stock and poultry breeding were also analyzed deeply. On this basis, the significance of pollution control programs for environment protection was investigated from aspects of pollution control policy, technology management and publicity.

Program structures and synchronization schemes in numerical coordinate controllers of three-wire welding

In the three-wire welding system, a welding process consists of the operations of four devices, namely three welding machines and one bogie. The operations need to be synchronized by a numerical coordinate controller （ NCC ）. In this paper, we will discuss a tnsk-job-procedure cubic program structure. Under this structure, the devices are synchronized and isolated at the same time. This cubic program structure can also be used as a reference for other multi-device or multi-unit manufacturing processes.

Linear Programming for Optimum PID Controller Tuning

This work presents a new methodology based on Linear Programming (LP) to tune Proportional-Integral-Derivative (PID) control parameters. From a specification of a desired output time domain of the plant, a linear optimization system is proposed to adjust the PID controller leading the output signal to stable operation condition with minimum oscillations. The constraint set used in the optimization process is defined by using numerical integration approach. The generated optimization problem is convex and easily solved using an interior point algorithm. Results obtained using familiar plants from literature have shown that the proposed linear programming problem is very effective for tuning PID controllers.

Optimal Control for a Class of Complex Singular System Based on Adaptive Dynamic Programming

This paper presents a new design approach to achieve decentralized optimal control of high-dimension complex singular systems with dynamic uncertainties. Based on robust adaptive dynamic programming(robust ADP) method, controllers for solving the singular systems optimal control problem are designed. The proposed algorithm can work well when the system model is not exactly known but the input and output data can be measured. The policy iteration of each controller only uses their own states and input information for learning,and do not need to know the whole system dynamics. Simulation results on the New England 10-machine 39-bus test system show the effectiveness of the designed controller.

CONTROLLING ROBOT MANIPULATORS BY DYNAMIC PROGRAMMING

A certain number of considerations should be taken into account in the dynamic control of robot manipulators as highly complex non-linear systems.In this article,we provide a detailed presentation of the mechanical and electrical impli- cations of robots equipped with DC motor actuators.This model takes into account all non-linear aspects of the system.Then,we develop computational algorithms for optimal control based on dynamic programming.The robot's trajectory must be predefined,but performance criteria and constraints applying to the system are not limited and we may adapt them freely to the robot and the task being studied.As an example,a manipulator arm with 3 degrees of freedom is analyzed.

Safety control program for complex system based on behavior science

To control complex system's safety effectively,safety control program was supported based on the principles of behavioral science that shapes organizational be- havior,and organizational behavior produced individual behavior.The program can be structured into a model that consists of three modules including individual behavior rectifi- cation,organization behavior diagnosis and model of safety culture.The research result not only reveals the deep cause of complex system accidents but also provides structural descriptions with the accidents cause.

Control strategy optimization using dynamic programming method for synergic electric system on hybrid electric vehicle

Dynamic Programming (DP) algorithm is used to find the optimal trajectories under Beijing cycle for the power management of synergic electric system (SES) which is composed of battery and super capacitor. Feasible rules are derived from analyzing the optimal trajectories, and it has the highest contribution to Hybrid Electric Vehicle (HEV). The methods of how to get the best performance is also educed. Using the new Rule-based power management strat-egy adopted from the optimal results, it is easy to demonstrate the effectiveness of the new strategy in further improvement of the fuel economy by the synergic hybrid system.

Using Automation Controller System and Simulation Program for Testing Closed Circuits of Mini-Sprinkler Irrigation System

The field experiments were conducted at the experimental farm of Faculty of agricultural, southern Illinois University SIUC, USA. The project makes the irrigation automated. With the use of low cost sensors and the simple circuitry makes currently project a low cost product, which can be bought even by a poor farmer. This research work is best suited for places where water is scares and has to be used in limited quantity and this proposal is a model to modernize the agriculture industries at a mass scale with optimum expenditure. In the field of agricultural engineering, use of sensor method of irrigation operation is important and it is well known that closed circuits of Mini-sprinkler irrigation system are very economical and efficient. Closed circuits are considered one of the modifications of Mini-sprinkler irrigation system, and added advantages to Mini-sprinkler irrigation system because it can relieve low operating pressures problem at the end of the lateral lines. In the conventional closed circuits of Mini-sprinkler irrigation system, the farmer has to keep watch on irrigation timetable, which is different for different crops. Using this system, one can save manpower, water to improve production and ultimately profit. The data could be summarized in following: Irrigation methods under study when using lateral length 60 mcould be ranked in the following ascending order according the values of the predicted and measured head losses CM1M-SIS CM2M-SIS.The correlation (Corr.) coefficients were used to compare the predicted and measured head losses along the lateral lines of all the closed circuits designs. Generally, the values of correlation analysis were (>0.90) were obtained with 0% field slope60 mlength (experimental conditions) for all closed circuits.The interaction between irrigation methods: at the start there are significant differences between CM2M-SIS and CM1M-SIS.

Stability of Nonlinear Systems Using Optimal Fuzzy Controllers and Its Simulation by Java Programming

In this paper, at first, the single input rule modules(SIRMs) dynamically connected fuzzy inference model is used to stabilize a double inverted pendulum system. Then, a multiobjective particle swarm optimization(MOPSO) is implemented to optimize the fuzzy controller parameters in order to decrease the distance error of the cart and summation of the angle errors of the pendulums, simultaneously. The feasibility and efficiency of the proposed Pareto front is assessed in comparison with results reported in literature and obtained from other algorithms.Finally, the Java programming with applets is utilized to simulate the stability of the nonlinear system and explain the internetbased control.

Evaluation of a Voluntary Control Program for the Detection of Bovine Leukemia Virus Antibodies Based on Agar Gel Immunodiffusion Test in Dairy Farms in Costa Rica

Cattle from 20 dairy farms were serologically tested over a five-year period using agar gel immunodiffusion test (AGIDT) as part of a voluntary Bovine Leukemia Virus (BLV) control program. After five years of removing infected animals from the herds based on BLV-AGIDT serological status, blood samples from 332 cattle in these farms were collected and analyzed side by side by AGIDT and enzyme-linked immunosorbent assay (ELISA) to detect antibodies against BLV. AGIDT detected 29.2% (97) and 16.0% (53) of the animals as positive and weak positive respectively, whereas ELISA detected 58.2% (193) cattle as positive. The prevalence of BLV-antibodies determined with AGIDT in the dairy farms oscillated between 0% and 86%, whereas prevalence determined by ELISA ranged between 28% and 100% in the same farms. Although both techniques showed similarly results in farms with high BLV-prevalence, ELISA detected a larger proportion of BLV-positive, especially in farms with low or no BLV-prevalence based on AGIDT, leading to wrong assumptions in terms of farm level control efforts. Our results strongly suggest that AGIDT alone is inadequate to implement BLV control programs and ELISA is a more adequate test for BLV surveillance and control programs.

An Enhanced Genetic Programming Algorithm for Optimal Controller Design

This paper proposes a Genetic Programming based algorithm that can be used to design optimal controllers. The proposed algorithm will be named a Multiple Basis Function Genetic Programming (MBFGP). Herein, the main ideas concerning the initial population, the tree structure, genetic operations, and other proposed non-genetic operations are discussed in details. An optimization algorithm called numeric constant mutation is embedded to strengthen the search for the optimal solutions. The results of solving the optimal control for linear as well as nonlinear systems show the feasibility and effectiveness of the proposed MBFGP as compared to the optimal solutions which are based on numerical methods. Furthermore, this algorithm enriches the set of suboptimal state feedback controllers to include controllers that have product time-state terms.

Developing the Participatory Education Program for Dengue Prevention and Control in the Primary School, Southern Region, Thailand

Dengue disease had been the significant health problem of the primary school in southern Thailand. The objective was to develop the participatory program for dengue prevention and control in five primary schools. Participatory action research (PAR) was applied in five steps: 1) preparation, 2) assessment, 3) education program development, 4) implementation and 5) evaluation. Data collection used quantitative and qualitative methods in five primary schools in Southern, Thailand. Descriptive statistics and Chi-square (χ2) test were used to compare between pre- and post-intervention. Larval Indices were obtained from ratio analysis. The results showed the participatory program consisted of nine important activities for all stakeholders involving dengue problem. Health teacher’s activities and student’s activities were eight activities consisted of knowledge training, dengue manual, Computer Assisted Instructor (CAI), test, dengue data, larval indices survey, fish bank, and herbal garden. The seven activities of health provider were knowledge training, dengue manual, CAI, testing, dengue data, larval indices survey, and larval indices program. Three activities for students’ parents included dengue manual, dengue data, and larval indices survey. The 290 students were participating activities in education program and increasing basic knowledge of dengue prevention and control. Comparing the number of correct answers, >80% of students between pre- and post-intervention were found to increase basic knowledge from five correct answers to ten, and of these six items were significantly different (P < 0.001). The two primary schools were continuing non-positive containers (Container Index: CI = 0), but the total larval indices (Breteau Index: BI, House Index: HI, and Container Index: CI) of five primary schools showed high levels both pre- and post-intervention in primary schools;whereas, the students’ households showed high level of BI, HI and CI both pre- and post-intervention (754, 77, and 35 to 616, 81, and 32). Conclusion: The program was needed to continue in primary school and participate from health teacher, health provider, and students’ parents in order to be of great benefit for students.

Call for papers Journal of Control Theory and Applications Special issue on Approximate dynamic programming and reinforcement learning

Approximate dynamic programming (ADP) is a general and effective approach for solving optimal control and estimation problems by adapting to uncertain and nonconvex environments over time.

A Feasibility Study of an Individualized Voiding Program in Japan to Improve the Sense of Control in Older People with Functional Urinary Incontinence

Purpose: This study intended to assess the feasibility of an individualized voiding program in Japan aimed at improving the sense of micturition control in older people with functional urinary incontinence. Method: Following the interview guide, FGIs were conducted in two groups (4 - 6 participants) consisting of nurses and care workers with more than 5 years of experience as practitioners of urination care. Data were analyzed using a qualitative descriptive approach. Results: We determined that the program purpose is to “enable caregivers to work as a well-coordinated team to humanely facilitate excretion independence in older people, which is essential for living with dignity”, as this confirmed the importance of maintaining the sense of micturition control in older people for their well-being. In the program outline, we extracted the following five categories: 1) setting selection criteria for recipients considering the status of micturition induction, 2) careful collection of information and assessment of lower urinary tract symptoms in older people in case of environmental changes, 3) examination of methods used for assessing lower urinary tract symptoms according to the facility environment, 4) confirmation of the recipient’s micturition habits and request for assistance, and 5) conducting necessary examination for setting the intervention period and evaluation period according to the target condition. The feedback on the program guide was summarized in the statement—specific successful cases help frame and implement the micturition induction plan. Conclusion: We confirmed the feasibility of the micturition induction plan for improving the sense of control in older people with functional urinary incontinence. Upon evaluating the program guide, we deemed that referring to specific successful cases helps frame and implement the micturition induction plan. It is extremely important to verify the effectiveness of the program going forward.

Digital close loop control system for current-programmed mode arc welding inverter

A small-signal model of current programmed mode pulse width modulation converter including the equivalent sampling effect is introduced and analyzed. In this model, an addition pole is brought out by the sampling effect in the current loop gain, and it affects dynamic bandwidth and stability of the inner current loop. By selecting the appropriate stability parameter which determines the additional pole and describes the degree of peaking in closed loop transfer function, a control model of current programmed full bridge arc welding inverter with maximum frequency bandwidth and stability can be obtained. Small and large amplitude pulse current outputs are employed in simulations and experiments and results validate the design method.

Development, Delivery and Evaluation of a Safety Training Program on Demolition for Blight Reduction

The main objective of the work presented in this paper was to develop a customized safety training program that can be incorporated into the demolition projects undertaken as part of blight reduction efforts in urban centers. A subsidiary objective was to devise and implement a safety program evaluation methodology, and gain insights on the relationships between knowledge acquisition through training and trainee demographics. Salient aspects of blight elimination efforts, as well as the main facets of building demolition practices and requirements, were reviewed. Information on various related safety and health hazards was studied in depth with a focus on demolition operations dealing with blighted properties. A unique safety hazard awareness training program was created for demolition workers, contractors and inspectors based on this research. In addition to devising a curriculum of relevant training topics along with traditional and online delivery systems to be employed, effectiveness evaluation instruments were formulated. Based on the limited data collected from the trainees it was concluded that the program was well-received by them and provided effective learning. It was also found that no statistically significant associations existed between the knowledge gain of the trainees, and either their experience level or union status, after taking this training.

SEQUENTIAL QUADRATIC PROGRAMMING METHODS FOR OPTIMAL CONTROL PROBLEMS WITH STATE CONSTRAINTS

A kind of direct methods is presented for the solution of optimal control problems with state constraints. These methods are sequential quadratic programming methods. At every iteration a quadratic programming which is obtained by quadratic approximation to Lagrangian function and linear approximations to constraints is solved to get a search direction for a merit function. The merit function is formulated by augmenting the Lagrangian function with a penalty term. A line search is carried out along the search direction to determine a step length such that the merit function is decreased. The methods presented in this paper include continuous sequential quadratic programming methods and discreate sequential quadratic programming methods.

基于Return-Oriented Programming的程序攻击与防护

随着W⊕X等技术的引入,传统的代码注入攻击几乎被消除,return-to-lib攻击受到很大程度的抑制。在此背景下,Hovav Shacham提出了Return-Oriented Programming(ROP)的思想,该思想基于栈溢出的原理,通过使用程序库中有效的以ret指令结尾的短指令序列构建gadget集合,使之具有图灵完备特性,来完成计算和攻击。讲述ROP思想自提出以来的一些研究成果和其实际的攻击能力,阐述ROP自动化的当前成果与未来可能的发展方向,进而分析和预测ROP自动化的下一步的研究方向。同时,也将从ROP的几个特征分析消除这种攻击的策略和方法,并介绍目前已有的防护思想和成果,论述这些方法的优缺点和改进方向。综合阐述ROP攻击与ROP防护这一矛与盾的问题,力争使读者理解ROP的思想,知悉当前的发展状态,并在此基础上能够进一步推进ROP攻击及其防范的研究。