Combining reinforcement learning with mathematical programming:An approach for optimal design of heat exchanger networks

Heat integration is important for energy-saving in the process industry.It is linked to the persistently challenging task of optimal design of heat exchanger networks(HEN).Due to the inherent highly nonconvex nonlinear and combinatorial nature of the HEN problem,it is not easy to find solutions of high quality for large-scale problems.The reinforcement learning(RL)method,which learns strategies through ongoing exploration and exploitation,reveals advantages in such area.However,due to the complexity of the HEN design problem,the RL method for HEN should be dedicated and designed.A hybrid strategy combining RL with mathematical programming is proposed to take better advantage of both methods.An insightful state representation of the HEN structure as well as a customized reward function is introduced.A Q-learning algorithm is applied to update the HEN structure using theε-greedy strategy.Better results are obtained from three literature cases of different scales.

Synthesis of Large-scale Multistream Heat Exchanger Networks Based on Stream Pseudo Temperature

Effective temperature level of stream, namely stream pseudo temperature, is determined by its actual temperature and heat transfer temperature difference contribution value. Heat transfer temperature difference con-tribution value of a stream depends on its heat transfer film coefficient, cost per unit heat transfer area, actual tem-perature, and so on. In the determination of the suitable heat transfer temperature difference contribution values of the stream, the total annual cost of multistream heat exchanger network (MSHEN) is regarded as an objective func-tion, and genetic/simulated annealing algorithm (GA/SA) is adopted for optimizing the heat transfer temperature difference contribution values of the stream. The stream pseudo temperatures are subsequently obtained. On the ba-sis of stream pseudo temperature, optimized MSHEN can be attained by the temperature-enthalpy (T-H) diagram method. This approach is characterized with fewer decision variables and higher feasibility of solutions. The calcu-lation efficiency of GA/SA can be remarkably enhanced by this approach and more probability is shown in search-ing the global optimum solution. Hence this approach is presented for solving industrial-sized MSHEN which is difficult to deal by traditional algorithm. Moreover, in the optimization of stream heat transfer temperature differ-ence contribution values, the effects of the stream temperature, the heat transfer film coefficient, and the construc-tion material of heat exchangers are considered, therefore this approach can be used to optimize and design heat exchanger network (HEN) with unequal heat transfer film coefficients and different of construction materials. The performance of the proposed approach has been demonstrated with three examples and the obtained solutions are compared with those available in literatures. The results show that the large-scale MSHEN synthesis problems can be solved to obtain good solutions with the modest computational effort.

Study on Multi-stream Heat Exchanger Network Synthesis with Parallel Genetic/Simulated Annealing Algorithm

The multi-stream heat exchanger network synthesis (HENS) problem can be formulated as a mixed integer nonlinear programming model according to Yee et al. Its nonconvexity nature leads to existence of more than one optimum and computational difficulty for traditional algorithms to find the global optimum. Compared with deterministic algorithms, evolutionary computation provides a promising approach to tackle this problem. In this paper, a mathematical model of multi-stream heat exchangers network synthesis problem is setup. Different from the assumption of isothermal mixing of stream splits and thus linearity constraints of Yee et al., non-isothermal mixing is supported. As a consequence, nonlinear constraints are resulted and nonconvexity of the objective function is added. To solve the mathematical model, an algorithm named GA/SA (parallel genetic/simulated annealing algorithm) is detailed for application to the multi-stream heat exchanger network synthesis problem. The performance of the proposed approach is demonstrated with three examples and the obtained solutions indicate the presented approach is effective for multi-stream HENS.

Synthesis of Multi-component Mass-exchange Networks

This paper presents a superstructure-based formulation for the synthesis of mass-exchange networks (MENs) considering multiple components. The superstructure is simplified by directly using the mass separation agents (MSA) from their sources, and therefore the automatic synthesis of the multi-component system involved in the MENs can be achieved without choosing a 'key-component' either for the whole process or the mass exchangers. A mathematical model is proposed to carry out the optimization process. The concentrations, flow rates, matches and unit operation displayed in the obtained network constitute the exact representation of the mass exchange process in terms of all species in the system. An example is used to illustrate and demonstrate the application of the proposed method.

Diagnosabilities of exchanged hypercube networks under the pessimistic one-step diagnosis strategy

The exchanged hypercube EH（s, t） （where s ≥ 1 and t ≥ 1） is obtained by systematically reducing links from a regular hypercube Q,＋t＋l. One-step diagnosis of exchanged hypercubes which involves only one testing phase during which processors test each other is discussed. The diagnosabilities of exchanged hypercubes are studied by using the pessimistic one-step diagno- sis strategy under two kinds of diagnosis models： the PMC model and the MM model. The main results presented here are the two proofs that the degree of diagnosability of the EH（s, t） under pessimistic one-step tl/tl fault diagnosis strategy is 2s where I ≤ s ≤ t （respectively, 2t, where 1 ≤ t ≤ s） based on the PMC model and that it is also 2s where 1 ≤ s ≤ t （respectively, 2t, where 1 ≤ t ≤ s） based on the MM＊ model.

Design of heat exchanger network based on entransy theory

The heat exchanger network(HEN) synthesis problem based on entransy theory is analyzed. According to the characteristics of entransy representation of thermal potential energy, the entransy dissipation represents the irreversibility of the heat transfer process, the temperature difference determines the entransy dissipation, and four HEN design steps based on entransy theory are put forward. The present study shows how it is possible to set energy targets based on entransy and achieve them with a network of heat exchangers by an example of heat exchanger network design for four streams. In order to verify the correctness of the heat exchanger networks design method based on entransy theory, the synthesis of the HEN for the diesel hydrogenation unit is studied. Using the heat exchange networks design method based on entransy theory, the HEN obtained is consistent with energy targets. The entransy transfer efficiency of HEN based on entransy theory is 92.29%, higher than the entransy transfer efficiency of the maximum heat recovery network based on pinch technology.

Method for Incorporation of Controllability in Heat Exchanger Network Synthesis by Integrating Mathematical Programming and Knowledge Engineering

A method for incorporation of controlling the heat exchanger networks with or without splits is proposed by integrating mathemati-cal programming and knowledge engineering. The simultaneous optimal mathematical model is established. This method can be practically used in the integration of large-scale heat exchanger networks, not only to synthesize automatically but also to satisfy the requirement of struc-tural controllability with more objective human intervention.

Strategy for Synthesis of Flexible Heat Exchanger Networks Embedded with System Reliability Analysis

System reliability can produce a strong influence on the performance of the heat exchanger network(HEN).In this paper,an optimization method with system reliability analysis for flexible HEN by genetic/simulated annealing algorithms(GA/SA) is presented.Initial flexible arrangements of HEN is received by pseudo-temperature enthalpy diagram.For determining system reliability of HEN,the connections of heat exchangers(HEXs) and independent subsystems in the HEN are analyzed by the connection sequence matrix(CSM),and the system reliability is measured by the independent subsystem including maximum number of HEXs in the HEN.As for the HEN that did not meet system reliability,HEN decoupling is applied and the independent subsystems in the HEN are changed by removing decoupling HEX,and thus the system reliability is elevated.After that,heat duty redistribution based on the relevant elements of the heat load loops and HEX areas are optimized in GA/SA.Then,the favorable network configuration,which matches both the most economical cost and system reliability criterion,is located.Moreover,particular features belonging to suitable decoupling HEX are extracted from calculations.Corresponding numerical example is presented to verify that the proposed strategy is effective to formulate optimal flexible HEN with system reliability measurement.

Synthesis of Heat Exchanger Network Considering Multipass Exchangers

Many methods have been proposed for synthesis of heat exchanger networks in recent years, most of which consider single pass exchangers. In this study some evolutionary rules have been proposed for synthesis of multipass exchanger networks. The method is based on the heuristic that optimal networks should feature maximum energy recovery and have the minimum number of shells. The effectiveness of the developed evolutionary rules is demonstrated through some literature examples.

A Simultaneous Optimization Method for the Structure and Compo-sition Differences of a Mass Exchange Network

This article presents a new method to calculate the composition differences （e） for tar g.etin.g the minimum total annualized cost （TAC） of a mass exchange network （MEN）,which is based on the combination of composition interval diagram （CID） with mathematical programming.The total cost target consists of the capital cost of the process units and the operating cost for mass separating agents （MS.As）. The value of total cost varies considerablv with the composition differences, so the values of e should be optimized in order to obtain minimum TAC of a MEN. This articleconsiders ε as a set of unequal variables for each equilibrium equation of a rich-lean stream pair, employing them to build the CID and mathematical model, which optimizes the structure and composition differences simultaneously. Two examples are applied to illustrate the proposed method and the results demonstrate that the approach introduced by this article is simpler and more convenient than the methods in previous literatures.

An Explicit Solution for Thermal Calculation and Synthesis of Super-structure Heat Exchanger Networks

For the optimal design of a heat exchanger network,the inlet and outlet stream temperatures of each heat exchanger in the network should be known.An explicit analytical solution of stream temperatures of an arbi-trary connected heat exchanger network was introduced,which is suitable for the thermal calculation of heat ex-changer networks.For the heat exchanger network synthesis,this solution was further developed and coupled with the stage-wise superstructure heat exchanger networks.The new calculation procedure reduced the computer mem-ory requirement dramatically.On the basis of this solution,a mathematical model for synthesis of heat exchanger networks with genetic algorithm was formulated,which is always feasible and no iteration is needed.Two examples were calculated with the proposed approach and better results were obtained.

Synthesis of indirect work exchange networks considering both isothermal and adiabatic process together with exergy analysis

In this paper, an efficient methodology for synthesizing the indirect work exchange networks(WEN) considering isothermal process and adiabatic process respectively based on transshipment model is first proposed. In contrast with superstructure method, the transshipment model is easier to obtain the minimum utility consumption taken as the objective function and more convenient for us to attain the optimal network configuration for further minimizing the number of units. Different from division of temperature intervals in heat exchange networks,different pressure intervals are gained according to the maximum compression/expansion ratio in consideration of operating principles of indirect work exchangers and the characteristics of no pressure constraints for stream matches. The presented approach for WEN synthesis is a linear programming model applied to the isothermal process, but for indirect work exchange networks with adiabatic process, a nonlinear programming model needs establishing. Additionally, temperatures should be regarded as decision variables limited to the range between inlet and outlet temperatures in each sub-network. The constructed transshipment model can be solved first to get the minimum utility consumption and further to determine the minimum number of units by merging the adjacent pressure intervals on the basis of the proposed merging methods, which is proved to be effective through exergy analysis at the level of units structures. Finally, two cases are calculated to confirm it is dramatically feasible and effective that the optimal WEN configuration can be gained by the proposed method.

Bypass Selection for Control of Heat Exchanger Network

Considering the flexibility and controllability of heat exchanger networks (HENs), bypasses are widely used for effective control of process stream target temperatures. However, the optimal location for the bypass is generally difficult to design with the trade-off between controllability and capital investments. In this paper, based on the steady-state model of heat exchanger networks the optimal bypass location was firstly selected by iteratively calculating the non-square Relative Gain Array (ns-RGA). To simplify the calculation process, rules of bypass selection were also proposed. In order to evaluate this method, then, the structural controllability of heat exchanger networks was analyzed. With both the consideration of the controllability and capital investments, the bypasses locations were finally selected. A case study on the HEN in Crude Distillation Unit was presented in which the ns-RGA and structural controllability were used to select bypasses and also to evaluate the results.

Heat Exchanger Network Retrofit for Optimization of Crude Distillation Unit Using Pinch Analysis

Crude distillation unit(CDU)is regarded as the main energy consumer in the entire refinery process.In this paper,the process simulation software and the energy management software are used to simulate the flowsheet and analyze the energy consumption,respectively.Stream data obtained from an existing CDU are applicable in the pinch analysis.To reduce the amount of cross-pinch heat transfer,three approaches of resequencing,repiping,and adding heat exchangers are adopted.Compared with the existing CDU,the results demonstrate that the inlet temperature of the furnace can be increased by 25.4℃,the amount of hot and cold utilities can be reduced by 15.1%and 19.6%,respectively.The economic evaluation indicates that the operating cost is saved by 8×106$/a,and the payback period is about 9 months.

Heat Exchanger Network Retrofit of Diesel Hydrotreating Unit Using Pinch Analysis

Diesel hydrotreating unit(DHT)is an integral part of the refinery,and its energy-saving optimization is of great significance to the enterprise.In this paper,process simulation software and energy management software are used to simulate the flowsheet and analyze the energy consumption,respectively.Stream data obtained from an existing DHT are applied in the pinch analysis for retrofitting the heat exchanger network(HEN)to achieve maximum energy utilization by using pinch analysis.Since DHT is constrained by pressure,the pressure factor is considered in the process of retrofitting.The results show that the amount of cross-pinch heat transfer is reduced,the inlet temperature of the furnace is increased by 55℃,and the amount of hot and cold utilities can be reduced by 70.25%and 50.16%,respectively.The economic evaluation indicates that the operating cost is saved by 4.39×10^(6)$/a,and the payback period is about 2 months.

Flexibility analysis and design of heat exchanger network for syngas-to-methanol process

The heat exchanger network(HEN)in a syngas-to-methanol process was designed and optimized based on pinch technology under stable operating conditions to balance the energy consumption and economic gain.In actual industrial processes,fluctuations in production inevitably affect the stable operation of HENs.A flexibility analysis of the HEN was carried out to minimize such disturbances using the downstream paths method.The results show that two-third of the downstream paths cannot meet flexibility requirements,indicating that the HEN does not have enough flexibility to accommodate the disturbances in actual production.A flexible HEN was then designed with the method of dividing and subsequent merging of streams,which led to 13.89%and 20.82%reductions in energy consumption and total cost,respectively.Owing to the sufficient area margin and additional alternative heat exchangers,the flexible HEN was able to resist interference and maintain production stability and safety,with the total cost increasing by just 4.08%.

Step-wise synthesis of work exchange networks involving heat integration based on the transshipment model

Due to the deterioration of serious energy dilemma,energy-conservation and emission–reduction have been the strategic target in the past decades,thus people have identified the vital importance of higher energy efficiency and the influence of lower carbon development.Since work exchange network is a significant part of energy recovery system,its optima design will have dramatically significant effect on energy consumption reduction in chemical process system.With an extension of the developed transshipment model in isothermal process,a novel step-wise methodology for synthesis of direct work exchange network(WEN)in adiabatic process involving heat integration is first proposed in this paper,where a nonlinear programming(NLP)model is formulated by regarding the minimum utility consumption as objective function and optimizing the initial WEN in accordance with the presented matching rules to get the optimized WEN configuration at first.Furthermore,we focus on the work exchange network synthesis with heat integration to attain the minimal total annual cost(TAC)with the introduction of heat-exchange equipment that is achieved by the following strategies in sequence:introducing heat-exchange equipment directly,adjusting the work quantity of the adjacent utility compressors or expanders,and approximating upper/lower pressure limits consequently to obtain considerable cost savings of expanders or compressors and work utility.Finally,a case taken from the literature is studied to illustrate the feasibility and effectiveness of the proposed method.

State Space Approach to Mass Exchange Network Synthesis

State space approach is an effective method to mass-exchange network (MEN) synthesis. By decomposing the network into two interactive parts, a distribution network and a process operator, the synthesis problem can be formulated into a mixed integer nonlinear programming (MINLP) model. In this article, a generalized state space model based on typical MEN is established and verified in two cases. A new asymmetrical operator and cost index are also adopted to speed up the solution process. The results demonstrate the efficiency of the proposed approach.

A systematic strategy for multi-period heat exchanger network retrofit under multiple practical restrictions

A systematic strategy for retrofit of the multi-period heat exchanger network （HEN） on the basis of the multi- objective optimization is developed. In this three-stage procedure, a simplified multi-objective optimization model of the multi-period lIEN is first established and then solved to target the retrofit, aiming to minimizing the total annual cost and total annual CO2 emissions. The obtained Pareto front represents series of retrofit targets under different emission limitations, from which the most desirable one can be selected. The matching of the existing and the required heat exchangers is further implemented to finalize the retrofit, which will meet the practical retrofit requirements and matching restrictions. The application of the proposed procedure is illustrated through a case study of a HEN in a vacuum gas oil hydro-treating unit.

Modeling and Optimization for Heat Exchanger Networks Synthesis Based on Expert System and Genetic Algorithm

A new superstructure form of heat exchanger networks (HEN) isproposed based on expert system system (ES). The new superstructureform is combined with the practical engineering. The differentinvestment cost formula for Different heat exchanger is alsopresented based on ES. The mathematical model for the simultaneousoptimization Of network configuration is established and solved by agenetic algorithm. This method can deal with larger scale HENsynthesis and the optimal HEN configuration is obtainedautomatically. Finally, a case study is presented to Demonstrate theeffectiveness of the method.