Combining reinforcement learning with mathematical programming:An approach for optimal design of heat exchanger networks

Heat integration is important for energy-saving in the process industry.It is linked to the persistently challenging task of optimal design of heat exchanger networks(HEN).Due to the inherent highly nonconvex nonlinear and combinatorial nature of the HEN problem,it is not easy to find solutions of high quality for large-scale problems.The reinforcement learning(RL)method,which learns strategies through ongoing exploration and exploitation,reveals advantages in such area.However,due to the complexity of the HEN design problem,the RL method for HEN should be dedicated and designed.A hybrid strategy combining RL with mathematical programming is proposed to take better advantage of both methods.An insightful state representation of the HEN structure as well as a customized reward function is introduced.A Q-learning algorithm is applied to update the HEN structure using theε-greedy strategy.Better results are obtained from three literature cases of different scales.

Accelerating Factor Xa inhibitor discovery with a de novo drug design pipeline

Small-molecule drugs are essential for maintaining human health. The objective of this study is to identify a molecule that can inhibit the Factor Xa protein and be easily procured. An optimization-based de novo drug design framework, Drug CAMD, that integrates a deep learning model with a mixed-integer nonlinear programming model is used for designing drug candidates. Within this framework, a virtual chemical library is specifically tailored to inhibit Factor Xa. To further filter and narrow down the lead compounds from the designed compounds, comprehensive approaches involving molecular docking,binding pose metadynamics(BPMD), binding free energy calculations, and enzyme activity inhibition analysis are utilized. To maximize efficiency in terms of time and resources, molecules for in vitro activity testing are initially selected from commercially available portions of customized virtual chemical libraries. In vitro studies assessing inhibitor activities have confirmed that the compound EN300-331859shows potential Factor Xa inhibition, with an IC_(50)value of 34.57 μmol·L^(-1). Through in silico molecular docking and BPMD, the most plausible binding pose for the EN300-331859-Factor Xa complex are identified. The estimated binding free energy values correlate well with the results obtained from biological assays. Consequently, EN300-331859 is identified as a novel and effective sub-micromolar inhibitor of Factor Xa.

Consistent and Accurate TDOA Localization in Dynamic NLOS Environments via Prior Information Independent Estimation

In the time-difference-of-arrival(TDOA)localization,robust least squares(LS)problems solved by mathematical programming were proven to be superior in mitigating the effects of non-line-of-sight(NLOS)propagation.However,the existing algorithms still suffer from two disadvantages:1)The algorithms strongly depend on prior information;2)The approaches do not satisfy the mean square error(MSE)optimal criterion of the measurement noise.To tackle the troubles,we first formulate an MSE minimization model for measurement noise by taking the source and the NLOS biases as variables.To obtain stable solutions,we introduce a penalty function to avoid abnormal estimates.We further tackle the nonconvex locating problem with semidefinite relaxation techniques.Finally,we incorporate mixed constraints and variable information to improve the estimation accuracy.Simulations and experiments show that the proposed method achieves consistent performance and good accuracy in dynamic NLOS environments.

A Partial Parallel Airport Gate Assignment Supported by a Knowledge－based System Combined with Mathematical Programming

The gate assignment at an airport is one of the major activities in airport operations.With the increase of passenger traffic volumes and the number of flights, the complexity of this task and the factors to be considered have increased significantly, and an efficient gate utilizationhas received considerable attention. For overcoming the shortcomings of previous gate assignmentapproaches, this paper presents a partial parallel gate assignment approach, by which more factorsconcerning aircraft and gates can be collsidered at the same time. This paper also presents themethod of using a knowledge-based system combined with a mathematical programming method forgetting an optimized feasible assignment solution. By this way, it is more easily to get the solutionthat satisfies both the static and dynamic situations,and thus it may adapt well to meet the needsof actual use to rea-time operations. An experimental prototype has been implemented, and a casestudy is presented at the end of the paper.

Hierarchical On-line Scheduling of Multiproduct Batch Plants with a Combined Approach of Mathematical Programming and Genetic Algorithm

In this contribution we present an online scheduling algorithm for a real world multiproduct batch plant. The overall mixed integer nonlinear programming (MINLP) problem is hierarchically structured into a mixed integer linear programming (MILP) problem first and then a reduced dimensional MINLP problem, which are optimized by mathematical programming (MP) and genetic algorithm (GA) respectively. The basis idea relies on combining MP with GA to exploit their complementary capacity. The key features of the hierarchical model are explained and illustrated with some real world cases from the multiproduct batch plants.

MATHEMATICAL PROGRAMMING ANALYSIS OF BILINEAR RHEOLOGICAL LUBRICATION MECHANICS

Bilinear theological lubrication mechanics provides an important basis for the designs of re- cently developed electrorheological(ER)'smart'journal bearings and those lubricated by mixed fluid-solid lubri- cants.But there is not yet a reliable and efficient numerical method for such a problem of non-Newtonian flu- id mechanics.In the present paper,a finite element method(FEM)together with mat hematical programming solution is successfully used to solve such a problem.A reliable and generalized numerical method for the designs of electrorheological 'smart' journal bearings and the bearings lubricated by mixed fluid- solid lubri- cant is presented.

Neutrosophic Mathematical Programming for Optimization of Multi-Objective Sustainable Biomass Supply Chain Network Design

In this paper,a multi-objective sustainable biomass supply chain network under uncertainty is designed by neutrosophic programming method.In this method,for each objective function of the problem,three functions of truth membership,non-determination and falsehood are considered.Neutrosophic programming method in this paper simultaneously seeks to optimize the total costs of the supply chain network,the amount of greenhouse gas emissions,the number of potential people hired and the time of product transfer along the supply chain network.To achieve the stated objective functions,strategic decisions such as locating potential facilities and tactical decisions such as optimal product flow allocation and vehicle routing must be made.The results of the implementation of neutrosophic programming method show the high efficiency of this method in achieving the optimal values of each objective function.Also,by examining the rate of uncertainty,it was observed that with increasing this rate,the total costs of supply chain network design,greenhouse gas emissions and product transfer times have increased,and in contrast,the potential employment rate of individuals has decreased.

A Quadratic Programming Model for Blast Scheduling

A quadratic programming model is established to choose the blocks to be blasted in a given period. The length of this period depends on the production planning requirements. During the given period, the blocks' parameters are available from the geological database of the mine. The objective is to minimize the deviation of the average ore grade of blasted blocks from the standard ore grade required by the mill. Transportation ability constraint. production quantity demand constraint. minimum safety bench constraint. block size constraint and block, bench precedence constraints are considered in forming the programming model. This model has more practical objective function and reasonable constraints compared with the existing model for this kind of problems.

OPTIMIZATION OF THE TAKE-OFF MOVEMENT OF SKI JUMPING WITH THE METHOD OF MATHEMATICAL PROGRAMMING

This paper is based on the finite and dispersed data which were obtained from the experiments of the wind tunnel and of the force measurement and from the high-speed photography. It analyses and optimizes the take-off movement of ski jumping with the theory of dynamics of systems of rigid bodies and with the method of mathematical programming. The paper describes the optimal take-off movement of ski jumping. Furthermore, it presents an example and compares the result with those of other papers published at home and abroad. The comparison shows that our computation and optimization are reasonable and well-grounded.

Using mixed integer programming and airborne laser scanning to generate forest management units

Airborne laser scanning(ALS)has been widely applied to estimate tree and forest attributes,but it can also drive the segmentation of forest areas.Clustering algorithms are the dominant technique in segmentation but spatial optimization using exact methods remains untested.This study presents a novel approach to segmentation based on mixed integer programming to create forest management units(FMUs).This investigation focuses on using raster information derived from ALS surveys.Two mainstream clustering algorithms were compared to the new MIP formula that simultaneously accounts for area and adjacency restrictions,FMUs size and homogeneity in terms of vegetation height.The optimal problem solution was found when using less than 150 cells,showing the problem formulation is solvable.The results for MIP were better than for the clustering algorithms;FMUs were more compact based on the intravariation of canopy height and the variability in size was lower.The MIP model allows the user to strictly control the size of FMUs,which is not possible in heuristic optimization and in the clustering algorithms tested.The definition of forest management units based on remote sensing data is an important operation and our study pioneers the use of MIP ALS-based optimal segmentation.

A FINITE ELEMENT—MATHEMATICAL PROGRAMMING METHOD FOR ELASTOPLASTIC PROBLEMS BASED ON THE PRINCIPLE OF VIRTUAL WORK

By expanding the yielding function according toTaylor series and neglecting the high order terms, the elastoplastic constitutive equation is written in a linear complementary form. Based on this linear complementary form and the principle of virtual work, a finite element-complementary method is derived for elastoplastic problem. This method is available for materials which satisfy either associated or nonassociated flow rule. In addition, the existence and uniqueness oj solution for the method are also discussed and some useful conclusions are given.

Bi-matrix Games with Fuzzy Strategies and Fuzzy Payoffs and Their Mathematical Programming Equivalents

A fuzzy bi-matrix game（FBG）,namely a two-person non-zero-sum game with fuzzy strategies and fuzzy payoffs is proposed.We have defined and analyzed the optimal strategies of this FBG,and shown that it can be transformed into a corresponding fuzzy mathematical programming issue,for which a ranking function approach can be applied.In addition,optimal strategies of FBG for both Player I and Player II can be gotten.

A MATHEMATICAL PROGRAMMING ALGORITHM FOR LIMIT ANALYSIS

This paper deals with the limit analyses of perfect rigid-plastic continua.Based on the kinematic theorem of the limit analysis theory,a mathematical programming finite element formula for determining the upper bound load multiplier has been established,and an iteration algorithm proposed accordingly.In this algorithm the plastic and rigid zones are distinguished for every iteration step,and the goal function is modified gradually.The difficulties caused by the nonsmoothness of the goal function are over- come.Some examples solved by this algorithm are presented.

PARAMETRIC QUADRATIC PROGRAMMING METHOD FOR VISCOPLASTICITY

Perzyna model in viscoplasticity has been studied by the parametric variational principle, which could be transformed into solving the parametric quadratic programming problem. The FEM form of this problem and its implementation have also been discussed in the paper.

Mathematical Programming Method as a Means of Calibration of NIR Analyzers

In addition to the conventional methods of the calibration model construction, such as PCR （principal components regression） and PLS （partial least-squares）, a MPM （mathematical programming method） is developed and proposed for practical use in NIR analyses of agricultural and food products. The proposed method involves the mathematical programming techniques to seek the regression coefficients for the calibration model calculation. It is based on the optimization theory used for finding the extremum of the objective function in the given domain of a vector space and employs the method of the complementarity problems solving. The MPM algorithm is described in detail. The MPM was tested on an InfraLUM FT-10 NIR analyzer of Lumex company with samples of dry milk （for fat）, corn （for protein） and rye flour （for moisture）. The obtained results show that the MPM can be used for constructing multivariate calibrations with the qualitative characteristics superior over those of the classical PCR and PLS methods of analysis.

Optimal Solution of Multi-Choice Mathematical Programming Problem Using a New Technique

The study deals with the multi-choice mathematical programming problem, where the right hand side of the constraints is multi-choice in nature. However, the problem of multi-choice linear programming cannot be solved directly by standard linear or nonlinear programming techniques. The aim of this paper is to transform such problems to a standard mathematical linear programming problem. For each constraint, exactly one parameter value is selected out of a multiple number of parameter values. This process of selection can be established in different ways. In this paper, we present a new simple technique enabling us to handle such problem as a mixed integer linear programming problem and consequently solve them by using standard linear programming software. Our main aim depends on inserting a specific number of binary variables and using them to construct a linear combination which gives just one parameter among the multiple choice values for each choice of the values of the binary variables. A numerical example is presented to illustrate our analysis.

A Novel Stackelberg-Game-Based Energy Storage Sharing Scheme Under Demand Charge

Demand response(DR)using shared energy storage systems(ESSs)is an appealing method to save electricity bills for users under demand charge and time-of-use(TOU)price.A novel Stackelberg-game-based ESS sharing scheme is proposed and analyzed in this study.In this scheme,the interactions between selfish users and an operator are characterized as a Stackelberg game.Operator holds a large-scale ESS that is shared among users in the form of energy transactions.It sells energy to users and sets the selling price first.It maximizes its profit through optimal pricing and ESS dispatching.Users purchase some energy from operator for the reduction of their demand charges after operator's selling price is announced.This game-theoretic ESS sharing scheme is characterized and analyzed by formulating and solving a bi-level optimization model.The upper-level optimization maximizes operator's profit and the lower-level optimization minimizes users'costs.The bi-level model is transformed and linearized into a mixed-integer linear programming(MILP)model using the mathematical programming with equilibrium constraints(MPEC)method and model linearizing techniques.Case studies with actual data are carried out to explore the economic performances of the proposed ESS sharing scheme.

Optimal design of culling compensation policy under the African swine fever——Based on simulations of typical pig farms in China

This paper aims to optimize the culling compensation policy from a micro perspective through scenario simulation.Based on an investigation of 273 pig farms in eight regions,four typical pig farms were constructed according to farm size and breeding mode,representing the swine producers in China.Besides,a decision objective function of pig farms facing suspected African swine fever(ASF)outbreaks was constructed.This study used a mathematical programming model to design and simulate scenarios based on compensation standards and local implementation levels,aiming to incentivize pig farms to report epidemics.The results show that the optimal decisions on epidemic reports differed among typical farms and by herd daily age.The results suggest the following adjustments for optimizing culling compensation policies:(1)to set culling compensation standards based on the market value and(2)to maintain a high level of epidemic surveillance capability in the animal husbandry and veterinary sector.

Dimension-down iterative algorithm for the mixed transportation network design problem

An optimal dimension-down iterative algorithm （DDIA） is proposed for solving a mixed （continuous/ discrete） transportation network design problem （MNDP）, which is generally expressed as a mathematical programming with equilibrium constraints （MPEC）. The upper level of the MNDP aims to optimize the network performance via both the expansion of existing links and the addition of new candidate links, whereas the lower level is a traditional Wardrop user equilibrium （UE） model. The idea of the proposed DDIA is to reduce the dimensions of the problem. A group of variables （discrete/continuous） are fixed to altemately optimize another group of variables （continuous/discrete）. Some continuous network design problems （CNDPs） and discrete network design problems （DNDPs） are solved repeatedly until the optimal solution is obtained. A numerical example is given to demonstrate the efficiency of the proposed algorithm.

Fuzzy data envelopment analysis approach based on sample decision making units

The conventional data envelopment analysis （DEA） measures the relative efficiencies of a set of decision making units with exact values of inputs and outputs. In real-world prob- lems, however, inputs and outputs typically have some levels of fuzziness. To analyze a decision making unit （DMU） with fuzzy input/output data, previous studies provided the fuzzy DEA model and proposed an associated evaluating approach. Nonetheless, numerous deficiencies must still be improved, including the α- cut approaches, types of fuzzy numbers, and ranking techniques. Moreover, a fuzzy sample DMU still cannot be evaluated for the Fuzzy DEA model. Therefore, this paper proposes a fuzzy DEA model based on sample decision making unit （FSDEA）. Five eval- uation approaches and the related algorithm and ranking methods are provided to test the fuzzy sample DMU of the FSDEA model. A numerical experiment is used to demonstrate and compare the results with those obtained using alternative approaches.