Combining reinforcement learning with mathematical programming:An approach for optimal design of heat exchanger networks

Heat integration is important for energy-saving in the process industry.It is linked to the persistently challenging task of optimal design of heat exchanger networks(HEN).Due to the inherent highly nonconvex nonlinear and combinatorial nature of the HEN problem,it is not easy to find solutions of high quality for large-scale problems.The reinforcement learning(RL)method,which learns strategies through ongoing exploration and exploitation,reveals advantages in such area.However,due to the complexity of the HEN design problem,the RL method for HEN should be dedicated and designed.A hybrid strategy combining RL with mathematical programming is proposed to take better advantage of both methods.An insightful state representation of the HEN structure as well as a customized reward function is introduced.A Q-learning algorithm is applied to update the HEN structure using theε-greedy strategy.Better results are obtained from three literature cases of different scales.

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

Decomposition of Mathematical Programming Models for Aircraft Wing Design Facilitating the Use of Dynamic Programming Approach

Aircraft designers strive to achieve optimal weight-reliability tradeoffs while designing an aircraft. Since aircraft wing skins account for more than fifty percent of their structural weight, aircraft wings must be designed with utmost care and attention in terms of material types and thickness configurations. In particular, the selection of thickness at each location of the aircraft wing skin is the most consequential task for aircraft designers. To accomplish this, we present discrete mathematical programming models to obtain optimal thicknesses either to minimize weight or to maximize reliability. We present theoretical results for the decomposition of these discrete mathematical programming models to reduce computer memory requirements and facilitate the use of dynamic programming for design purposes. In particular, a decomposed version of the weight minimization problem is solved for an aircraft wing with thirty locations (or panels) and fourteen thickness choices for each location to yield an optimal minimum weight design.

Accelerating Factor Xa inhibitor discovery with a de novo drug design pipeline

Small-molecule drugs are essential for maintaining human health. The objective of this study is to identify a molecule that can inhibit the Factor Xa protein and be easily procured. An optimization-based de novo drug design framework, Drug CAMD, that integrates a deep learning model with a mixed-integer nonlinear programming model is used for designing drug candidates. Within this framework, a virtual chemical library is specifically tailored to inhibit Factor Xa. To further filter and narrow down the lead compounds from the designed compounds, comprehensive approaches involving molecular docking,binding pose metadynamics(BPMD), binding free energy calculations, and enzyme activity inhibition analysis are utilized. To maximize efficiency in terms of time and resources, molecules for in vitro activity testing are initially selected from commercially available portions of customized virtual chemical libraries. In vitro studies assessing inhibitor activities have confirmed that the compound EN300-331859shows potential Factor Xa inhibition, with an IC_(50)value of 34.57 μmol·L^(-1). Through in silico molecular docking and BPMD, the most plausible binding pose for the EN300-331859-Factor Xa complex are identified. The estimated binding free energy values correlate well with the results obtained from biological assays. Consequently, EN300-331859 is identified as a novel and effective sub-micromolar inhibitor of Factor Xa.

Joint Beamforming Design for Dual-Functional Radar-Communication Systems Under Beampattern Gain Constraints

The joint beamforming design challenge for dual-functional radar-communication systems is addressed in this paper.The base station in these systems is tasked with simultaneously sending shared signals for both multi-user communication and target sensing.The primary objective is to maximize the sum rate of multi-user communication,while also ensuring sufficient beampattern gain at particular angles that are of interest for sensing,all within the constraints of the transmit power budget.To tackle this complex non-convex problem,an effective algorithm that iteratively optimizes the joint beamformers is developed.This algorithm leverages the techniques of fractional programming and semidefinite relaxation to achieve its goals.The numerical results confirm the effectiveness of the proposed algorithm.

Suggestions on Improving China’s Breakthrough Therapy Designation System

Objective To analyze the characteristics of breakthrough therapy designation(BTD)and its implementation in China,and to provide reference for the optimization of BTD system.Methods A comparative research method was used to study the content and implementation effect of BTD system in China and the relevant policies and implementation of the same procedures of drug regulatory authorities in the United States,Japan and the European Union.Then,the differences in policies and implementation results among these countries were analyzed to provide suggestions for the implementation and optimization of this system in China.Results and Conclusion China’s BTD system is implemented late and a small number of drugs has been approved.At the same time,there are problems such as insufficient guidance and communication from the agency to applicants,a broad application condition,single review mode,and lack of full-time personnel.Both the agencies and the applicants have limited experience due to the short implementation time of BTD system in China.There are still some problems despite we have learned a lot from the experience of other drug regulatory agencies.Therefore,based on our national conditions,we should strengthen the guidance of evaluation agency to applicants,optimize the eligibility criteria of BTD system,introduce the rolling review,and increase the number of professional liaisons,which can accelerate the development and marketing process of drugs with obvious clinical value,and finally to address unmet medical need.

Design of Aided Decision-Making Program for Prioritizing Construction Projects in Urban Road Network Planning

The importance and complexity of prioritizing construction projects (PCP) in urban road network planning lead to the necessity to develop an aided decision making program (ADMP). Cost benefit ratio model and stage rolled method are chosen as the theoretical foundations of the program, and then benefit model is improved to accord with the actuality of urban traffic in China. Consequently, program flows, module functions and data structures are designed, and particularly an original data structure of road ...

基于TouchDesigner视觉编程技术的粤剧数字化设计创新

目的探究TouchDesigner视觉化编程技术于粤剧当代发展中的数字化设计创新路径。方法分析粤剧的数字化发展现状,探讨TouchDesigner视觉化编程技术与粤剧的数字化转换关系,从而研究粤剧的可数字化元素及TouchDesigner技术的数据转换方法。分析当下数字技术介入粤剧的研究现状,并总结特点与不足,从中发现TouchDesigner编程技术之于粤剧的数字化创新突破口。最后通过TouchDesigner介入粤剧的数字化设计实践与案例剖析,探索多元交互与沉浸式表现技术中的粤剧多重感官体验形式,探究粤剧数字化设计的多维表达方式。结论为粤剧的当代发展提供一种融媒体、跨感官的交互式数字化设计创新方法,实现粤剧数字化创新表达,同时,也为传统文化的数字化设计注入中国式血液,进而引发对未来智能场景下粤剧数字化设计创新的新思考。

Improved design of reconfigurable frequency response masking filters based on second-order cone programming

In order to improve the design results for the reconfigurable frequency response masking FRM filters an improved design method based on second-order cone programming SOCP is proposed.Unlike traditional methods that separately design the proposed method takes all the desired designing modes into consideration when designing all the subfilters. First an initial solution is obtained by separately designing the subfilters and then the initial solution is updated by iteratively solving a SOCP problem. The proposed method is evaluated on a design example and simulation results demonstrate that jointly designing all the subfilters can obtain significantly lower minimax approximation errors compared to the conventional design method.

Detecting Design Patterns in Object-Oriented Program Source Code by Using Metrics and Machine Learning

Detecting well-known design patterns in object-oriented program source code can help maintainers understand the design of a program. Through the detection, the understandability, maintainability, and reusability of object-oriented programs can be improved. There are automated detection techniques;however, many existing techniques are based on static analysis and use strict conditions composed on class structure data. Hence, it is difficult for them to detect and distinguish design patterns in which the class structures are similar. Moreover, it is difficult for them to deal with diversity in design pattern applications. To solve these problems in existing techniques, we propose a design pattern detection technique using source code metrics and machine learning. Our technique judges candidates for the roles that compose design patterns by using machine learning and measurements of several metrics, and it detects design patterns by analyzing the relations between candidates. It suppresses false negatives and distinguishes patterns in which the class structures are similar. As a result of experimental evaluations with a set of programs, we confirmed that our technique is more accurate than two conventional techniques.

Multi-gene genetic programming extension of AASHTO M-E for design oflow-volume concrete pavements

The American Association of State Highway and Transportation Officials Mechanistic-Empirical Pavement DesignGuide (AASHTO M-E) offers an opportunity to design more economical and sustainable high-volume rigid pavementscompared to conventional design guidelines. It is achieved through optimizing pavement structural andthickness design under specified climate and traffic conditions using advanced M-E principles, thereby minimizingeconomic costs and environmental impact. However, the implementation of AASHTO M-E design for low-volumeconcrete pavements using AASHTOWare Pavement ME Design (Pavement ME) software is often overly conservative.This is because Pavement ME specifies the minimum design thickness of concrete slab as 152.4 mm (6 in.). Thispaper introduces a novel extension of the AASHTO M-E framework for the design of low-volume joint plain concretepavements (JPCPs) without modification of Pavement ME. It utilizes multi-gene genetic programming (MGGP)-based computational models to obtain rapid solutions for JPCP damage accumulation and long-term performanceanalyses. The developed MGGP models simulate the fatigue damage and differential energy accumulations. Thispermits the prediction of transverse cracking and joint faulting for a wide range of design input parameters and axlespectrum. The developed MGGP-based models match Pavement ME-predicted cracking and faulting for rigidpavements with conventional concrete slab thicknesses and enable rational extrapolation of performance predictionfor thinner JPCPs. This paper demonstrates how the developed computational model enables sustainable lowvolumepavement design using optimized ME solutions for Pittsburgh, PA, conditions.

A knowledge-to-action approach to food fortification: Guiding principles for the design of fortification programs as a means of effectively addressing micronutrient malnutrition

The gap that exists between research and the dissemination and implementation of research findings has been well established. Food fortification, one of the most cost-effective means of addressing micronutrient malnutrition, is no exception. With decades of implementation experience, there is need to strengthen mechanisms that effectively broadcast proven strategies to promote the successful implementation of fortification programs in changing, challenging, and dynamic environments. This requires clear channels of communication, well-defined in-country leadership, and a streamlined and focused approach that can be adapted to country-specific contexts. Based on experience designing and implementing fortification programs throughout Africa and a broad understanding of past successes and failures, a model is proposed that articulates often over-looked program elements critical to design and implementation.

Evolutionary Design of Fault-Tolerant Digital Circuit Based on Cartesian Genetic Programming

In many areas, reliability of the digital circuits has become the key factor to restrict circuit development. Fault-tolerant design is the commonly used method to improve the reliability of digital circuits. The current fault-tolerant design methods are based on triple modular redundancy( TMR) or multiple modular redundancy( MMR). These redundancy designs rely on the experience of the designers,and the designed circuits have poor adaptabilities to a complex environment. However, evolutionary design of digital circuits does not rely on prior knowledge. During the evolution, some novel and optimal circuit topologies can be found, and the evolved circuits can feature strong adaptive capacities. Based on Cartesian genetic programming( CGP), a novel method for designing fault-tolerant digital circuits by evolution is proposed,key steps of the evolution are introduced,influences of function sets on evolution are investigated,and as a preliminary result,an evolved full adder with high fault-tolerance is shown.

Semi-definite programming based pulse waveform design and its further analysis

In order to provide a judicious pulse waveform design required for ultra-wideband(UWB)communication to enable the UWB spectral mask compatible and coexistent with other existing wireless communication systems,a semi-definite programming(SDP)based pulse waveform design method for UWB radios is introduced and a further analysis is given in this paper.By using Sedumi and Yalmip toolboxes of Matlab,the procedure of solving the SDP problem is simplified.Simulation results show that this SDP based pulse waveform design method can be used to design pulses that fulfill the Federal Communications Commission(FCC)spectral mask strictly and optimize the power efficiency at the same time.This paper also analyzes the influences of the power efficiency duing to the changes of sampling interval and the number of combined pulses,and then the optimal sampling interval that maximizes the transmission power can be found.

A Trace-state Based Approach to Specification and Design of Parallel Programs

In this paper they deal with the issue of specification and design of parallel communicatingprocesses. A trace-state based model is introduced to describe the behaviour of concurrent programs. They presenta formal system based on that model to achieve hierarchical and modular development and verification methods. Anumber of refinement rules are used to decompose the specification into smaller ones and calculate program fromthe

Design of the Hydrological Emergency Supervising Program Based on Hydrometry

According to practical hydrological emergency supervising program design,we have discovered and held a design principle with a method to get information promptly and accurately,monitor safely and conveniently,and collect information systematically,expounded the emergency hydrological monitoring program towards hydrometry,which shall be taken full analysis on the special geological environment around the site,aimed at damming body monitoring,and also the construction of hydrological emergency supervising networks in the area,the live video acquisition towards special point of the dammed barrier,then carried out monitoring measures which were suitable to contemporary economy and technology to get complete hydrological information we require. Finally,we put forward a concrete designing method for precluding disaster and reducing the loss of disaster based on the information above.

Automatic Generation of UML Class Diagrams for Object-oriented Design and Programing Course

UML Class diagram generation from textual requirements is an important task in object-oriented design and programing course.This study proposes a method for automatically generating class diagrams from Chinese textual requirements on the basis of Natural Language Processing(NLP)and mapping rules for sentence pattern matching.First,classes are identified through entity recognition rules and candidate class pruning rules using NLP from requirements.Second,class attributes and relationships between classes are extracted using mapping rules for sentence pattern matching on the basis of NLP.Third,we developed an assistant tool integrated into a precision micro classroom system for automatic generation of class diagram,to effectively assist the teaching of object-oriented design and programing course.Results are evaluated with precision,accuracy and recall from eight requirements of object-oriented design and programing course using truth values created by teachers.Our research should benefit beginners of object-oriented design and programing course,who may be students or software developers.It helps them to create correct domain models represented in the UML class diagram.

A Dynamic Programming Approach to the Design of Composite Aircraft Wings

A light and reliable aircraft has been the major goal of aircraft designers. It is imperative to design the aircraft wing skins as efficiently as possible since the wing skins comprise more than fifty percent of the structural weight of the aircraft wing. The aircraft wing skin consists of many different types of material and thickness configurations at various locations. Selecting a thickness for each location is perhaps the most significant design task. In this paper, we formulate discrete mathematical programming models to determine the optimal thicknesses for three different criteria: maximize reliability, minimize weight, and achieve a trade-off between maximizing reliability and minimizing weight. These three model formulations are generalized discrete resource-allocation problems, which lend themselves well to the dynamic programming approach. Consequently, we use the dynamic programming method to solve these model formulations. To illustrate our approach, an example is solved in which dynamic programming yields a minimum weight design as well as a trade-off curve for weight versus reliability for an aircraft wing with thirty locations (or panels) and fourteen thickness choices for each location.

Nonlinear Programming Based Preamble Design for OFDM Systems

A new preamble structure and design method for orthogonal frequency division multiplexing（OFDM）systems is described,which results a two-symbol long training preamble.The preamble contains four parts,the first part is the same as the third,and the four parts are calculated by using nonlinear programming（NLP）model such that the moving correlation of the preamble results a steep rectangular-like pulse of certain width,whose step-down indicates the timing offset.Simulation results in AWGN channel are given to evaluate the perf o rmance of the proposed preamble design.

Teaching Reformation and Practice of “.NET Program Design” Course Oriented CDIO Model

“.NET Program Design” is a very important professional elective course in the Department of Computer Science and Technology. It is a practical, comprehensive curriculum with highly specialized applications. This paper analyses the disadvantages of traditional teaching model in the .NET Program Design, and discusses the methods and practices for teaching reform such as introducing CDIO engineering education model to classroom teaching with project cases, arranging teaching content properly, choosing modern teaching methods and reform on the curriculum assessment system. The practice has proved that this model with highly effective in teaching process can promote the training of students abilities in all aspects.