Combining reinforcement learning with mathematical programming:An approach for optimal design of heat exchanger networks

Heat integration is important for energy-saving in the process industry.It is linked to the persistently challenging task of optimal design of heat exchanger networks(HEN).Due to the inherent highly nonconvex nonlinear and combinatorial nature of the HEN problem,it is not easy to find solutions of high quality for large-scale problems.The reinforcement learning(RL)method,which learns strategies through ongoing exploration and exploitation,reveals advantages in such area.However,due to the complexity of the HEN design problem,the RL method for HEN should be dedicated and designed.A hybrid strategy combining RL with mathematical programming is proposed to take better advantage of both methods.An insightful state representation of the HEN structure as well as a customized reward function is introduced.A Q-learning algorithm is applied to update the HEN structure using theε-greedy strategy.Better results are obtained from three literature cases of different scales.

Landscape Architecture Planning and Design Based on Landscape Ecology Theory:A Case Study of Waterfront Landscape Planning and Design of Dapo Town

With the rapid development of urbanization,landscape architecture has become an indispensable component of daily life.In order to achieve better landscape effects and protect the ecological environment,landscape ecology theory can be integrated into landscape planning to carry out disciplinary crossing and integration research between landscape ecology and landscape architecture.In this study,based on the basic theories of landscape ecology,the waterfront landscape of Dapo Town was designed,with the aim to achieve ecological balance in planning,showcase biodiversity,and create a harmonious landscape ecological environment which can benefit both nature and people.This design combined artificial and natural elements while improving the natural environment,which promoted a harmonious relationship between humans and nature,thus enriching the spatial organization of the city,and playing a role in regulating the urban environment and climate.

Architectural Design and Urban Planning in the New Situation

Under the influence of the world economy,China’s economic development is very rapid,the people’s living standards have been greatly improved,and the urbanization process has been accelerated.As a part of urban planning,architecture plays an important role in urban planning and construction,so urban planning must be combined with the future development goals of the city,develop in an all-round way,strengthen architectural design,ensure the consistency of urban planning and architectural design,and create a good environment for urban development.Therefore,this paper analyzes the relationship between architectural design and urban planning under the new situation,clarifies the relationship between architectural design and urban planning,and strengthens urban construction.

Integrating Salt Culture into Rural Revitalization: Planning and Design of a Thematic Creative Agricultural Garden in Jintan, Jiangsu, China

This research establishes a strategic framework for developing a salt culture-themed agricultural garden in Jintan,Jiangsu to boost rural vibrancy and cultural tourism while honoring local salt heritage.It employs the Analytic Hierarchy Process(AHP)for a data-driven and structured approach to evaluate the sustainability and cultural significance of agricultural initiatives.This framework ensures a balanced blend of agriculture,culture,and tourism to foster a sustainable and culturally rich experience.The study highlights the value of structured methodologies in planning culturally impactful agricultural projects.

Design of Aided Decision-Making Program for Prioritizing Construction Projects in Urban Road Network Planning

The importance and complexity of prioritizing construction projects (PCP) in urban road network planning lead to the necessity to develop an aided decision making program (ADMP). Cost benefit ratio model and stage rolled method are chosen as the theoretical foundations of the program, and then benefit model is improved to accord with the actuality of urban traffic in China. Consequently, program flows, module functions and data structures are designed, and particularly an original data structure of road ...

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

Planning and Design of Beautiful Countryside Based on the Concept of Stormwater Resilience: A Case Study of Shanbei Village, Yunfu City, Guangdong Province

Shanbei Village is a village in Yunfu of Guangdong,which has been seriously affected by flood disasters.In the context of the construction of beautiful countryside,utilizing the concept of resilience stormwater,construction ideas of beautiful countryside of combining the prevention and control of village flood disasters with economic and social development and cultural heritage are proposed.The planning methods of adjusting the planting way of crops,demolition of dwellings in submerged areas and development and utilization of ancient dwellings,sorting out drainage systems and planning“large,medium and small sponges”,and improving the drainage capacity of culverts are summarized.

Planning and Design of Geological Landscape Popular Science Exhibition in Urban Geopark:A Case Study of Zhengzhou Yellow River National Geopark

Urban geopark is the backyard garden of urban residents’life.Geological landscape popular science exhibition enables people to receive geological popular science knowledge easily and happily while playing,which will virtually strengthen people’s protection awareness of urban geological landscape.Urban geopark landscape is featured by unique typical geological characteristics.It is a realistic problem that troubles the planning and design of geological landscape popular science exhibition in urban geopark by effectively protecting these geological landscapes and upgrading them into urban popular science leisure tourism resources.Taking Zhengzhou Yellow River National Geopark as an example,this paper systematically studies the planning and design of geological landscape popular science exhibition in urban geopark.

Decomposition of Mathematical Programming Models for Aircraft Wing Design Facilitating the Use of Dynamic Programming Approach

Aircraft designers strive to achieve optimal weight-reliability tradeoffs while designing an aircraft. Since aircraft wing skins account for more than fifty percent of their structural weight, aircraft wings must be designed with utmost care and attention in terms of material types and thickness configurations. In particular, the selection of thickness at each location of the aircraft wing skin is the most consequential task for aircraft designers. To accomplish this, we present discrete mathematical programming models to obtain optimal thicknesses either to minimize weight or to maximize reliability. We present theoretical results for the decomposition of these discrete mathematical programming models to reduce computer memory requirements and facilitate the use of dynamic programming for design purposes. In particular, a decomposed version of the weight minimization problem is solved for an aircraft wing with thirty locations (or panels) and fourteen thickness choices for each location to yield an optimal minimum weight design.

Accelerating Factor Xa inhibitor discovery with a de novo drug design pipeline

Small-molecule drugs are essential for maintaining human health. The objective of this study is to identify a molecule that can inhibit the Factor Xa protein and be easily procured. An optimization-based de novo drug design framework, Drug CAMD, that integrates a deep learning model with a mixed-integer nonlinear programming model is used for designing drug candidates. Within this framework, a virtual chemical library is specifically tailored to inhibit Factor Xa. To further filter and narrow down the lead compounds from the designed compounds, comprehensive approaches involving molecular docking,binding pose metadynamics(BPMD), binding free energy calculations, and enzyme activity inhibition analysis are utilized. To maximize efficiency in terms of time and resources, molecules for in vitro activity testing are initially selected from commercially available portions of customized virtual chemical libraries. In vitro studies assessing inhibitor activities have confirmed that the compound EN300-331859shows potential Factor Xa inhibition, with an IC_(50)value of 34.57 μmol·L^(-1). Through in silico molecular docking and BPMD, the most plausible binding pose for the EN300-331859-Factor Xa complex are identified. The estimated binding free energy values correlate well with the results obtained from biological assays. Consequently, EN300-331859 is identified as a novel and effective sub-micromolar inhibitor of Factor Xa.

Design Strategies for Rural Revitalization under the Background of Rural Revitalization:A Case Study of Baimaozhuang Village,Baodi District,Tianjin

Through the practical design of Baimaozhuang Village in Baodi District of Tianjin City,this paper analyzes the historical,social,and cultural background of the village,sorts out the current construction situation,rural style,and public space usage,and elaborates on the revitalization strategy from the perspectives of planning and architectural design.From the perspective of planning and design,it is mainly reflected in road network optimization,landscape improvement,and node implantation.From the perspective of architectural design,it is mainly reflected in building renewal,space revitalization,and style enhancement,with the expectation of building a charming rural area with regional cultural characteristics.

Exploration of Child-friendly Urban Park Design Strategies Based on Child Behavioral Psychology

By studying the behavioral psychology and needs of children,this paper analyzes the essence of child-friendly parks from the perspective of children,and discusses the design principles and key points of child-friendly parks,so as to provide a practical basis for the construction of child-friendly cities.

Joint Beamforming Design for Dual-Functional Radar-Communication Systems Under Beampattern Gain Constraints

The joint beamforming design challenge for dual-functional radar-communication systems is addressed in this paper.The base station in these systems is tasked with simultaneously sending shared signals for both multi-user communication and target sensing.The primary objective is to maximize the sum rate of multi-user communication,while also ensuring sufficient beampattern gain at particular angles that are of interest for sensing,all within the constraints of the transmit power budget.To tackle this complex non-convex problem,an effective algorithm that iteratively optimizes the joint beamformers is developed.This algorithm leverages the techniques of fractional programming and semidefinite relaxation to achieve its goals.The numerical results confirm the effectiveness of the proposed algorithm.

Analysis of Citizen Participation in Urban Planning of Comala,Colima,Mexico-A Secondary Publication

The objective of this study was to determine the degree of citizen participation in urban planning processes in the municipality of Comala,Colima,Mexico to have a broader vision of the citizens and the environment in which they live.An instrument was designed specifically to perform this study and the instrument was validated by calculating Cronbach’s Alpha.The results showed that citizens were highly involved in issues concerning their urban environment,and the main problems of the public spaces were also identified.

Designing an Elderly-Friendly City in Cardiff: Cultivating Sense of Security for the Aging Population: Transforming Butetown for the Entertainment, Health, and Diversification of the Elderly

As an important part of urban construction,elderly-friendly construction is crucial to the formation of an elderly-friendly society,which has been widely recognized internationally.Especially after the COVID-19 pandemic,various organizations around the world have called for changes in public space and urban building planning,with an emphasis on the accessibility of green spaces.This underscores the complexity and difficulty of integrating vulnerable groups of the elderly into cities and using infrastructure and public space.

Suggestions on Improving China’s Breakthrough Therapy Designation System

Objective To analyze the characteristics of breakthrough therapy designation(BTD)and its implementation in China,and to provide reference for the optimization of BTD system.Methods A comparative research method was used to study the content and implementation effect of BTD system in China and the relevant policies and implementation of the same procedures of drug regulatory authorities in the United States,Japan and the European Union.Then,the differences in policies and implementation results among these countries were analyzed to provide suggestions for the implementation and optimization of this system in China.Results and Conclusion China’s BTD system is implemented late and a small number of drugs has been approved.At the same time,there are problems such as insufficient guidance and communication from the agency to applicants,a broad application condition,single review mode,and lack of full-time personnel.Both the agencies and the applicants have limited experience due to the short implementation time of BTD system in China.There are still some problems despite we have learned a lot from the experience of other drug regulatory agencies.Therefore,based on our national conditions,we should strengthen the guidance of evaluation agency to applicants,optimize the eligibility criteria of BTD system,introduce the rolling review,and increase the number of professional liaisons,which can accelerate the development and marketing process of drugs with obvious clinical value,and finally to address unmet medical need.

Strategies for Introducing Energy Saving Idea into Residential Planning and Design in Urban and Rural Areas of China

Currently,energy saving design has been conducted on single building but not on the whole residential community in urban and rural areas.So,the paper has proposed energy saving measures for residential planning from the perspective of site selection and layout of buildings.Specific measures are as follows.Firstly,buildings should be constructed on the sunny side and leeside;secondly,buildings on the south should be lower than those on the north;the east side of the building should be open while the west side should be closed;thirdly,climate protection unit should be set;fourthly,buildings should be of northsouth direction primarily,and the main room should be set on the east side and the assistant rooms or passage on the west side in the buildings of east-west direction;fifthly,it should select compact and wellarranged households and the units should not be combined in point and dislocation and jointing.

Planning and Design of Mountainous Agricultural Sightseeing Garden——a Case Study of Ruimin Agricultural Sightseeing Eco-garden

Agricultural sightseeing project is expanding with social development, yet most are confined in improvements in original gardens, with similar style or pattern. The research took Uupanshui City as an example and analyzed mountain-based ag- ricultural sightseeing in order to discuss the way to propel agriculture integration with leisure tourism, processing, establish new models for sightseeing eco-garden gardens, and benefit economically, socially and ecologically.

Ecological Restoration and Landscape Construction of Wetland——A Case Study of Planning and Design of Mi River Wetland Park in Linqu of Shandong

Based on geological characteristic of Mi River Wetland Park in Linqu of Shandong,the paper had illustrated historical and cultural spirits of Linqu,and then proposed planning strategies and contents of Mi River Wetland Park.It discussed new approaches for wetland restoration and landscape construction from the perspectives of ecological restoration of wetland system,overall construction of leisure system,and full display of regional characteristic.The construction of wetland system laid stress on water system design,terrain treatment,vegetation construction,and biological diversity creation.Wetland system would be overlaid with leisure system,divided into wetland leisure zone,wetland entertainment zone,humanity landscape zone,wetland science popular zone and wetland experience zone,all of which would be constructed with characteristic respectively.On the basis of site character,the paper had searched an energy balance and substance transformation method between rivers,plants,earth and humans,of certain practicality.

Planning and Design of Sightseeing Agricultural Park Characterized by Mountainous Landscape

After illustration of research and development process of sightseeing agricultural park,the paper had classified sightseeing agricultural park into sightseeing agricultural park,education agricultural park and agricultural garden in terms of development content;into renovation type and newly-built type in accordance with development mode;and into plain type and mountainous type in the light of terrain.From the perspectives of terrain,vegetation,hydrology and ecology,characteristics of landscape resources in mountainous sightseeing agricultural park were analyzed.It proposed principles for planning and design of mountainous sightseeing agricultural park,which were respecting and protecting nature,linking landscape units and coordinating spatial structure,systematicness and protecting inheritance of traditional culture.On this basis,it had illustrated landscape designing theories on architecture and landscape furniture,traffic road,plant greening and water supply and sewerage works.