Policy Gradient Adaptive Dynamic Programming for Model-Free Multi-Objective Optimal Control

Dear Editor,In this letter,the multi-objective optimal control problem of nonlinear discrete-time systems is investigated.A data-driven policy gradient algorithm is proposed in which the action-state value function is used to evaluate the policy.In the policy improvement process,the policy gradient based method is employed.

Nationalist Trends in the Transformation of New Zealand’s Maori Language Policy

Language is an important carrier of human culture and a specific method for communication between humans.It is one of the most important symbols of human identity and flags of dividing group identity.At present,in the modern national state,the government is paying more attention to language policy and being more and more prudent to it.In the process of making and implementing language policy,the government must take into account a range of factors such as the country’s national history,politics,culture,economy,and relations between different social groups.From the mid-nineteenth century,when New Zealand became a British colony,until the mid-twentieth century,the Maori people were inspired to defend their rights and respect for themselves by the rise of Maori nationalist ideology and Maori political radicalism in a struggle that lasted more than 100 years.Until 1994,there were more than 800 kohanga reo,early childhood institutions that established Maori language instruction independent of the school system,and the nationalism drives to revitalize the Maori national language was at its peak.The process of revolution on Maori language policies in New Zealand reflects a trend of nationalist thoughts from Maori becoming more deep.Exploring the process of change in New Zealand’s Maori language policy will help to develop the study of the social history of indigenous peoples during the colonial period and will contribute to the study of the development of colonized countries and regions in the post-colonial period.The change in New Zealand’s Maori language policy has provided an important example of the preservation and revitalization of the indigenous languages of the world’s former colonies,which is of great significance for the preservation of linguistic and cultural diversity.

Research on Policy Diffusion Path and Reproduction of River Chief System

The River Chief System (RCS) has evolved from local innovative practices to a national water governance strategy to address the current challenges in China’s water environmental management. In contrast to existing research that focuses on the strengths, weaknesses, and improvements of RCS, this study uses literature study to reveal the dynamic evolution of RCS through three phases, with RCS spreading from developed coastal areas to central and western inland regions. RCS’s diffusion path involves vertical diffusion between central and local levels and horizontal diffusion among local governments. Moreover, RCS has also achieved conceptual spillover, gradually expanding into other governance domains, such as the Lake Chief System, the Field Chief System, the Forestry Chief System, and the integration of multiple chief roles. However, it is essential to scrutinize the phenomenon of applying similar governance mechanisms to different areas, as it may result in challenges such as overburdening local governments, insufficient public participation, oversimplification of differences in natural resource endowments, and limited applicability. This study also provides suggestions on how to address these challenges. The study contributes theoretical insights and policy implications, providing a foundation for practical policy innovation.

Automatic Generation of Attribute-Based Access Control Policies from Natural Language Documents

In response to the challenges of generating Attribute-Based Access Control(ABAC)policies,this paper proposes a deep learning-based method to automatically generate ABAC policies from natural language documents.This method is aimed at organizations such as companies and schools that are transitioning from traditional access control models to the ABAC model.The manual retrieval and analysis involved in this transition are inefficient,prone to errors,and costly.Most organizations have high-level specifications defined for security policies that include a set of access control policies,which often exist in the form of natural language documents.Utilizing this rich source of information,our method effectively identifies and extracts the necessary attributes and rules for access control from natural language documents,thereby constructing and optimizing access control policies.This work transforms the problem of policy automation generation into two tasks:extraction of access control statements andmining of access control attributes.First,the Chat General Language Model(ChatGLM)isemployed to extract access control-related statements from a wide range of natural language documents by constructing unique prompts and leveraging the model’s In-Context Learning to contextualize the statements.Then,the Iterated Dilated-Convolutions-Conditional Random Field(ID-CNN-CRF)model is used to annotate access control attributes within these extracted statements,including subject attributes,object attributes,and action attributes,thus reassembling new access control policies.Experimental results show that our method,compared to baseline methods,achieved the highest F1 score of 0.961,confirming the model’s effectiveness and accuracy.

Big Data Analysis of Policy Coordination Paths Based on Latent Dirichlet Allocation Model and Fuzzy-Set Qualitative Comparative Analysis Method

The selection and coordinated application of government innovation policies are crucial for guiding the direction of enterprise innovation and unleashing their innovation potential.However,due to the lengthy,voluminous,complex,and unstructured nature of regional innovation policy texts,traditional policy classification methods often overlook the reality that these texts cover multiple policy topics,leading to lack of objectivity.In contrast,topic mining technology can handle large-scale textual data,overcoming challenges such as the abundance of policy content and difficulty in classification.Although topic models can partition numerous policy texts into topics,they cannot analyze the interplay among policy topics and the impact of policy topic coordination on enterprise innovation in detail.Therefore,we propose a big data analysis scheme for policy coordination paths based on the latent Dirichlet allocation(LDA)model and the fuzzyset qualitative comparative analysis(fsQCA)method by combining topic models with qualitative comparative analysis.The LDA model was employed to derive the topic distribution of each document and the word distribution of each topic and enable automatic classi-fication through algorithms,providing reliable and objective textual classification results.Subsequently,the fsQCA method was used to analyze the coordination paths and dynamic characteristics.Finally,experimental analysis was conducted using innovation policy text data from 31 provincial-level administrative regions in China from 2012 to 2021 as research samples.The results suggest that the proposed method effectively partitions innovation policy topics and analyzes the policy configuration,driving enterprise innovation in different regions.

A quantitative study of disruptive technology policy texts:An example of China’s artificial intelligence policy

Purpose:The transformative impact of disruptive technologies on the restructuring of the times has attracted widespread global attention.This study aims to analyze the characteristics and shortcomings of China’s artificial intelligence(AI)disruptive technology policy,and to put forward suggestions for optimizing China’s AI disruptive technology policy.Design/methodology/approach:Develop a three-dimensional analytical framework for“policy tools-policy actors-policy themes”and apply policy tools,social network analysis,and LDA topic model to conduct a comprehensive analysis of the utilization of policy tools,cooperative relationships among policy actors,and the trends in policy theme settings within China’s innovative AI technology policy.Findings:We find that the collaborative relationship among the policy actors of AI disruptive technology in China is insufficiently close.Marginal subjects exhibit low participation in the cooperation network and overly rely on central subjects,forming a“center-periphery”network structure.Policy tool usage is predominantly focused on supply and environmental types,with a severe inadequacy in demand-side policy tool utilization.Policy themes are diverse,encompassing topics such as“Intelligent Services”“Talent Cultivation”“Information Security”and“Technological Innovation”,which will remain focal points.Under the themes of“Intelligent Services”and“Intelligent Governance”,policy tool usage is relatively balanced,with close collaboration among policy entities.However,the theme of“AI Theoretical System”lacks a comprehensive understanding of tool usage and necessitates enhanced cooperation with other policy entities.Research limitations:The data sources and experimental scope are subject to certain limitations,potentially introducing biases and imperfections into the research results,necessitating further validation and refinement.Practical implications:The study introduces a three-dimensional analysis framework for disruptive technology policy texts,which is significant for formulating and enhancing disruptive technology policies.Originality/value:This study utilizes text mining and content analysis techniques to quantitatively analyze disruptive technology policy texts.It systematically evaluates China’s AI policies quantitatively,focusing on policy tools,policy actors,policy themes.The study uncovers the characteristics and deficiencies of current AI policies,offering recommendations for formulating and enhancing disruptive technology policies.

Mapping Climate Services for Disaster Risk Management: A Systematic Review and Research Gaps from a Policy Process Perspective

Climate services (CS) are crucial for mitigating and managing the impacts and risks associated with climate-induced disasters. While evidence over the past decade underscores their effectiveness across various domains, particularly agriculture, to maximize their potential, it is crucial to identify emerging priority areas and existing research gaps for future research agendas. As a contribution to this effort, this paper employs the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to review the state-of-the-art in the field of climate services for disaster risk management. A comprehensive search across five literature databases combined with a snowball search method using ResearchRabbit was conducted and yielded 242 peer-reviewed articles, book sections, and reports over 2013-2023 after the screening process. The analysis revealed flood, drought, and food insecurity as major climate-related disasters addressed in the reviewed literature. Major climate services addressed included early warning systems, (sub)seasonal forecasts and impact-based warnings. Grounded in the policy processes’ theoretical perspective, the main focus identified and discussed three prevailing policy-oriented priority areas: 1) development of climate services, 2) use-adoption-uptake, and 3) evaluation of climate services. In response to the limitations of the prevalent supply-driven and top-down approach to climate services promotion, co-production emerges as a cross-cutting critical aspect of the identified priority areas. Despite the extensive research in the field, more attention is needed, particularly pronounced in the science-policy interface perspective, which in practice bridges scientific knowledge and policy decisions for effective policy processes. This perspective offers a valuable analytical lens as an entry point for further investigation. Hence, future research agendas would generate insightful evidence by scrutinizing this critical aspect given its importance to institutions and climate services capacity, to better understand intricate facets of the development and the integration of climate services into disaster risk management.

Geographical Distribution of Atmospheric Nitrogen Deposition in China and Its Response to Emission Control Policy

Atmospheric nitrogen(N)deposition has experienced significant change because of anthropogenic emissions,thereby exerting a pronounced impact on global ecosystem services.With the rapid development of industry and agriculture and the swift expansion of urban areas in China since the 1980s,reactive nitrogen(Nr)emissions and N deposition have substantially increased.In pursuit of im-proving air quality,China has implemented a series of environmental protection policies and undertaken diverse measures to reduce pol-lutant emissions.This paper is a review of multivariate data sources of atmospheric N deposition based on the results of literature from 1980 to 2023,and the original data from 1980 to 2020 are summarized,counted and calculated.The main findings are as follows:1)the annual average atmospheric N deposition ranged from approximately 20-40 kg/(ha·yr),with the variability primarily linked to different assessment methods;2)regional disparities were evident in the spatial distribution of N deposition,with elevated values concentrated in areas with intense Nr emissions;3)atmospheric N deposition significantly declined after 2010,particularly the deposition of oxidized N,while reduced N deposition remained stable.These results reflect the effects of China's serious control policies on nitrogen oxide(NO.)emissions and strengthen the importance of agricultural NH3 emission mitigation.This study contributes to a comprehensive understanding of the N dynamics in the emission-deposition process,and provides a scientific foundation for the research of environmental protection,climate change,and sustainable development.

The Adjustment of NATO’s Space Policy and Its Implications

Under the US leadership,NATO has been adjusting its space policy and strengthening its space deterrence capabilities to address the so-called“threat”from China and Russia.While the deterrent effect of NATO’s space policy remains to be seen,the various measures taken to implement the policy will have a considerable impact on the global space landscape,accelerating the weaponization of space and making it more difficult to prevent an arms race in space and govern space security.

Perception Enhanced Deep Deterministic Policy Gradient for Autonomous Driving in Complex Scenarios

Autonomous driving has witnessed rapid advancement;however,ensuring safe and efficient driving in intricate scenarios remains a critical challenge.In particular,traffic roundabouts bring a set of challenges to autonomous driving due to the unpredictable entry and exit of vehicles,susceptibility to traffic flow bottlenecks,and imperfect data in perceiving environmental information,rendering them a vital issue in the practical application of autonomous driving.To address the traffic challenges,this work focused on complex roundabouts with multi-lane and proposed a Perception EnhancedDeepDeterministic Policy Gradient(PE-DDPG)for AutonomousDriving in the Roundabouts.Specifically,themodel incorporates an enhanced variational autoencoder featuring an integrated spatial attention mechanism alongside the Deep Deterministic Policy Gradient framework,enhancing the vehicle’s capability to comprehend complex roundabout environments and make decisions.Furthermore,the PE-DDPG model combines a dynamic path optimization strategy for roundabout scenarios,effectively mitigating traffic bottlenecks and augmenting throughput efficiency.Extensive experiments were conducted with the collaborative simulation platform of CARLA and SUMO,and the experimental results show that the proposed PE-DDPG outperforms the baseline methods in terms of the convergence capacity of the training process,the smoothness of driving and the traffic efficiency with diverse traffic flow patterns and penetration rates of autonomous vehicles(AVs).Generally,the proposed PE-DDPGmodel could be employed for autonomous driving in complex scenarios with imperfect data.

Tracking direct and indirect impact on technology and policy of transformative research via ego citation network

Purpose:The disseminating of academic knowledge to nonacademic audiences partly relies on the transition of subsequent citing papers.This study aims to investigate direct and indirect impact on technology and policy originating from transformative research based on ego citation network.Design/methodology/approach:Key Nobel Prize-winning publications(NPs)in fields of gene engineering and astrophysics are regarded as a proxy for transformative research.In this contribution,we introduce a network-structural indicator of citing patents to measure technological impact of a target article and use policy citations as a preliminary tool for policy impact.Findings:The results show that the impact on technology and policy of NPs are higher than that of their subsequent citation generations in gene engineering but not in astrophysics.Research limitations:The selection of Nobel Prizes is not balanced and the database used in this study,Dimensions,suffers from incompleteness and inaccuracy of citation links.Practical implications:Our findings provide useful clues to better understand the characteristics of transformative research in technological and policy impact.Originality/value:This study proposes a new framework to explore the direct and indirect impact on technology and policy originating from transformative research.

CAN INCREMENTAL POLICIES SOLVE EMPLOYMENT PROBLEMS?

On October 8,the Information Office of the State Council of the People’s Republic of China held a press conference to outline the steps of“systematically implementing a package of incremental policies to solidly promote economic growth,structural optimization and sustained momentum of development”in the wake of the Third Plenary Session of the 20th Central Committee of the Communist Party of China.The series of policy measures mentioned at the press conference all demonstrated strong continuity,stability,and sustainability.The package of incremental policies reflects three“more attentions,”namely:more attention on improving the quality of economic development,more attention on supporting the healthy development of the real economy and business entities,and more attention on coordinating high-quality development and high-level security.One central goal is to promote high-quality full employment.

COMRADES FOREVER--To Lam’s visit demonstrates that China remains Vietnam’s top foreign policy priority

On August 20,2024,General Secretary of the Communist Party of Vietnam(CPV)Central Committee and Vietnamese President To Lam concluded his state visit to China.China was the destination for Lam's first overseas visit after taking office as general secretary of the CPV Central Committee,which clearly demonstrates that the heads of both countries attach importance to developing the bilateral relations and that Vietnam regards China as the strategic choice and top priority for its foreign policy.

Policy text quantification of urban waste classification from the perspective of policy tools:Based on the analysis of 6 cities in Northwest China

Based on the theory of policy tools and the application of content analysis method,this paper conducts a quantitative study on 32 samples of municipal waste classification policy texts in 6 cities in Northwest China.It constructs an analysis framework from the perspective of policy tools,policy contents and time series,and then measures and analyzes the policy texts according to the steps of defining analysis units,categories and coding,reliability and validity testing,etc.The results show that:(1)The urban waste classification policy in Northwest China is characterized by increasing attention year by year,a focus on government guidance and investment,and a clear division of responsibilities.These factors help to activate the motivation for policy implementation in cities across Northwest China,foster multi-departmental cooperation,and encourage active participation from various social entities in the process of implementing waste classification policies.(2)At the present stage,the design and application of policy tools are still unreasonable.On the one hand,the structure of policy tools is unbalanced,with excessive environmental policy tools leading to resource waste and insufficient demand policy tools leading to insufficient policy pulling power,which is not conducive to the long-term implementation of garbage classification management.At the same time,the internal structure of the secondary tools of the three types of policy tools is also uneven and unreasonable proportion further aggravates the waste of policy resources;On the other hand,the use of policy tools in each link of the policy content lacks focus and the concept of local policy implementation,which is difficult to meet the current practical needs and difficulties of garbage classification and treatment.According to this,the paper puts forward some policy suggestions,such as increasing the use of demand-oriented policy tools,paying attention to the reasonable matching of policy tools in various links of classification,and paying attention to the coordination of policy goal,process and result under the comprehensive dimension.

Moderating effect of corporate financialization on the impact of climate policy on corporate green innovation:Evidence from China

With intensifying global climate change,humanity is confronted with unparalleled environmental challenges and risks.This study employs the staggered difference-in-difference model to examine the relationship between climate policy and green innovation in the corporate financialization context.Using Chinese-listed company data from 2008 to 2020,our analysis reveals a favorable correlation between China’s carbon emission trading policy(CCTP)and advancements in green innovation.Furthermore,we find that the level of corporate financialization moderates this correlation,diminishing the driving effect of CCTP on green innovation.Additionally,results of heterogeneity analysis show that this moderating consequence is more evident in non-state owned and low-digitization enterprises compared with state-owned and high-digitization ones.Our findings contribute to the existing literature by clarifying the interaction between CCTP,green innovation,and corporate financialization.Our research provides valuable insights for policymakers and stakeholders seeking to strengthen climate policies and encourages green innovation in different types of businesses.

Paired Assistance:Policy Rationale and Economic Performance as Illustrated by Xizang and Xinjiang

This study highlights the changing priorities of China’s paired assistance throughout the past decades,as well as its theoretical implications and economic growth effects for recipient regions.Using panel data from 32 prefecture-level cities from 1990 to 2020,this study uses the multiperiod difference-in-differences approach to examine how paired assistance has contributed to economic growth in Xizang Autonomous Region and Xinjiang Uygur Autonomous Region.The findings indicate that,first,the implementation of the paired assistance policy has boosted economic growth in Xizang and Xinjiang.Second,paired assistance has stimulated economic growth in recipient communities by improving infrastructure.Third,paired assistance has contributed to economic growth in recipient communities by providing improved public services such as education and healthcare.Improvements to public services have a relatively smaller indirect effect in short term than infrastructure development on economic growth.Yet both education and healthcare are crucial to people’s quality of life in recipient communities.This paper has refined and broadened research on the effects of paired assistance,providing preference for future policymaking.

The Impact of the Monetary Policy During the COVID-19 in the Brazilian Banking Sector

The COVID-19 pandemic caused an outbreak on the global productive chains,transforming companies and society in general.Governments adopted anticyclical policies such as basic interest rates reduction as response.Brazil basic interest rate is denominated Selic.The application of these policies requires the protagonist of bank’s financial intermediation.This study aims to verify two events-under the perspective of the efficient markets’theory.The first is the communication of the first death by COVID-19-and the subsequent,Selic rate reduction to 2%p.a.-and its effects on bank’s shares prices.The hypotheses presented are:H1-The announcement of the first death by COVID-19 negatively impacts the banks’shares returns and H2-The announcement of the Selic interest rate-during the COVID-19-positively impacts the return of the banks’shares.We adopt event study methodology in a final sample of nine and 15 banks to Events 1 and 2 respectively.The results confirm H1 as well as the semi-strong informational efficiency market.H2 is not confirmed.Results confirm the non-effectiveness of the anticyclical policy of basic interest rate reduction.This contributes to the discussion about the impacts of COVID-19 and the efficacy of anticyclical policies.

Dynamic evaluation of digital and green development policies based on text mining of the PMC framework

Aiming to identify policy topics and their evolutionary logic that enhance the digital and green development(dual development)of traditional manufacturing enterprises,address weaknesses in current policies,and provide resources for refining dual development policies,a total of 15954 dual development-related policies issued by national and various departmental authorities in China from January 2000 to August 2023 were analyzed.Based on topic modeling techniques and the policy modeling consistency(PMC)framework,the evolution of policy topics was visualized,and a dynamic assessment of the policies was conducted.The results show that the digital and green development policy framework is progressively refined,and the governance philosophy shifts from a“regulatory government”paradigm to a“service-oriented government”.The support pattern evolves from“dispersed matching”to“integrated symbiosis”.However,there are still significant deficiencies in departmental cooperation,balanced measures,coordinated links,and multi-stakeholder participation.Future policy improvements should,therefore,focus on guiding multi-stakeholder participation,enhancing public demand orientation,and addressing the entire value chain.These steps aim to create an open and shared digital industry ecosystem to promote the coordinated dual development of traditional manufacturing enterprises.

Science and Technology Promotion Policies of Strategic Emerging Industries in Anhui Province

In recent years,based on advantages of industry,market,science and technology and other development environment,strategic emerging industries in Anhui Province are developing rapidly,and emerging industries such as new energy,new materials,new generation of information technology occupy an important market share in China and even the world.However,there are still a number of problems in the process of development,and the policy support has a greater impact.In this paper,the development status of strategic emerging industries in Anhui Province was discussed firstly,and then the challenges and problems of the development was discussed.Finally,some science and technology promotion policies of strategic emerging industries in Anhui Province were proposed.

罗汉果苷V调控高糖状态巨噬细胞M1极化促进骨髓间充质干细胞的成骨分化

背景:糖尿病微环境会造成巨噬细胞过度M1极化,这种高糖炎症状态会抑制骨髓间充质干细胞的成骨分化,从而影响糖尿病骨缺损的愈合。研究表明罗汉果苷Ⅴ具有抗炎、抗氧化、降血糖的作用,但其能否调节高糖炎症状态下巨噬细胞M1极化及骨髓间充质干细胞的成骨分化尚不清楚。目的:探讨罗汉果苷Ⅴ在高糖炎症状态下调节巨噬细胞M1型极化对骨髓间充质干细胞成骨分化的影响。方法:构建糖尿病C57BL/6小鼠模型,从正常和糖尿病小鼠分离骨髓来源巨噬细胞,分别培养于低糖和高糖培养基。使用脂多糖和干扰素γ作为炎症刺激诱导骨髓来源巨噬细胞的M1型极化,同时以160,320,640μmol/L罗汉果苷Ⅴ干预,用流式细胞术检测F4/80^(+)CD86^(+)细胞比例,qRT-PCR检测诱导型一氧化氮合酶、白细胞介素1β、白细胞介素6的mRNA表达水平,ELISA检测骨髓来源巨噬细胞上清液中肿瘤坏死因子α水平。分离C57BL/6小鼠骨髓间充质干细胞,分别使用低糖或高糖成骨诱导液诱导成骨分化,添加M1型巨噬细胞条件培养基作为炎症刺激,以及320μmol/L罗汉果苷Ⅴ干预,成骨诱导14 d后采用qRT-PCR检测碱性磷酸酶、Runt相关因子2、骨钙素、骨桥蛋白的mRNA表达水平,成骨诱导21 d后进行茜素红染色及定量分析。结果与结论:①流式细胞术结果显示320,640μmol/L罗汉果苷Ⅴ组的F4/80^(+)CD86^(+)细胞比例明显低于高糖炎症对照组(P<0.05);②qRT-PCR结果显示160,320,640μmol/L罗汉果苷Ⅴ组的诱导型一氧化氮合酶、白细胞介素6的mRNA相对表达量较高糖炎症对照组显著降低(P<0.05),320,640μmol/L罗汉果苷Ⅴ组白细胞介素1β的mRNA相对表达量较高糖炎症对照组显著降低(P<0.05);③ELISA结果显示160,320,640μmol/L罗汉果苷Ⅴ组的肿瘤坏死因子α分泌水平较高糖炎症对照组显著降低(P<0.05);④320μmol/L罗汉果苷Ⅴ干预后,高糖炎症状态下骨髓间充质干细胞的钙盐沉积增加(P<0.05),且碱性磷酸酶、Runt相关因子2和骨桥蛋白的mRNA相对表达量增加(P<0.05)。结果表明,罗汉果苷Ⅴ可通过抑制高糖炎症状态下骨髓来源巨噬细胞的M1型极化及炎症因子表达,促进骨髓间充质干细胞的成骨分化。