Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

A Probe Into the Mixed Teaching Reform of Python Language Programming

This paper first analyzes the significance of applying mixed teaching to the“Python Language Programming”course,briefly describes the current state of teaching in“Python Language Programming,”and discusses strategies for reforming mixed teaching approaches.The goal is to provide a reference for the innovative development of teaching the“Python Language Programming”course.

Shrek:a dynamic object-oriented programming language

From a perspective of theoretical study, there are some faults in the models of the existing object-oriented programming languages. For example, C# does not support metaclasses, the primitive types of Java and C# are not objects, etc. So, this paper designs a programming language, Shrek, which integrates many language features and constructions in a compact and consistent model. The Shrek language is a class-based purely object-oriented language. It has a dynamical strong type system, and adopts a single-inheritance mechanism with Mixin as its complement. It has a consistent class instantiation and inheritance structure, and the ability of intercessive structural computational reflection, which enables it to support safe metaclass programming. It also supports multi-thread programming and automatic garbage collection, and enforces its expressive power by adopting a native method mechanism. The prototype system of the Shrek language is implemented and anticipated design goals are achieved.

Programmed cell death 1 inhibitor sintilimab plus concurrent chemoradiotherapy for locally advanced pancreatic adenocarcinoma

BACKGROUND Pancreatic adenocarcinoma,a malignancy that arises in the cells of the pancreas,is a devastating disease with unclear etiology and often poor prognosis.Locally advanced pancreatic cancer,a stage where the tumor has grown significantly but has not yet spread to distant organs,presents unique challenges in treatment.This article aims to discuss the current strategies,challenges,and future directions in the management of locally advanced pancreatic adenocarcinoma(LAPC).AIM To investigate the feasibility and efficacy of programmed cell death 1(PD-1)inhibitor sintilimab plus concurrent chemoradiotherapy for LAPC.METHODS Eligible patients had LAPC,an Eastern cooperative oncology group performance status of 0 or 1,adequate organ and marrow functions,and no prior anticancer therapy.In the observation group,participants received intravenous sintilimab 200 mg once every 3 wk,and received concurrent chemoradiotherapy(concurrent conventional fractionated radiotherapy with doses planning target volume 50.4 Gy and gross tumor volume 60 Gy in 28 fractions and oral S-140 mg/m2 twice daily on days 1-14 of a 21-d cycle and intravenous gemcitabine 1000 mg/m2 on days 1 and 8 of a 21-d cycle for eight cycles until disease progression,death,or unacceptable toxicity).In the control group,participants only received concurrent chemoradiotherapy.From April 2020 to November 2021,64 participants were finally enrolled with 34 in the observation group and 30 in the control group.RESULTS Thirty-four patients completed the scheduled course of chemoradiotherapy,while 32(94.1%)received sintilimab plus concurrent chemoradiotherapy with 2 patients discontinuing sintilimab in the observation group.Thirty patients completed the scheduled course of chemoradiotherapy in the control group.Based on the Response Evaluation Criteria in Solid Tumors guidelines,the analysis of the observation group revealed that a partial response was observed in 11 patients(32.4%),stable disease was evident in 19 patients(55.9%),and 4 patients(11.8%)experienced progressive disease;a partial response was observed in 6(20.0%)patients,stable disease in 18(60%),and progressive disease in 6(20%)in the control group.The major toxic effects were leukopenia and nausea.The incidence of severe adverse events(AEs)(grade 3 or 4)was 26.5%(9/34)in the observation group and 23.3%(7/30)in the control group.There were no treatment-related deaths.The observation group demonstrated a significantly longer median overall survival(22.1 mo compared to 15.8 mo)(P<0.05)and progression-free survival(12.2 mo vs 10.1 mo)(P<0.05)in comparison to the control group.The occurrence of severe AEs did not exhibit a statistically significant difference between the observation group and the control group(P>0.05).CONCLUSION Sintilimab plus concurrent chemoradiotherapy was effective and safe for LAPC patients,and warrants further investigation.

OFF LINE INTERPRETER OF AGENT ORIENTED PROGRAMMING LANGUAGE AOPLID

AOPLID is a novel agent oriented programming language whose theoretical framework is the existed situation calculus theory and agent model based on intention driven manner. An AOPLID program is represented in set manner. In this paper, an off line AOPLID interpreter in Prolog is implemented, based on the off line AOPLID program semantics. At the same time, the set of rules is given which transforms an AOPLID program represented by sets into Prolog clauses so that it can be interpreted by the off line interpreter. Finally, the sound codes of the off line interpreter are listed.

NewBee: Context-Free Grammar (CFG) of a New Programming Language for Novice Programmers

Learning programming and using programming languages are the essential aspects of computer science education.Students use programming languages to write their programs.These computer programs(students or practitioners written)make computers artificially intelligent and perform the tasks needed by the users.Without these programs,the computer may be visioned as a pointless machine.As the premise of writing programs is situated with specific programming languages,enormous efforts have been made to develop and create programming languages.However,each program-ming language is domain-specific and has its nuances,syntax and seman-tics,with specific pros and cons.These language-specific details,including syntax and semantics,are significant hurdles for novice programmers.Also,the instructors of introductory programming courses find these language specificities as the biggest hurdle in students learning,where more focus is on syntax than logic development and actual implementation of the program.Considering the conceptual difficulty of programming languages and novice students’struggles with the language syntax,this paper describes the design and development of a Context-Free Grammar(CFG)of a programming language for the novice,newcomers and students who do not have computer science as their major.Due to its syntax proximity to daily conversations,this paper hypothesizes that this language will be easy to use and understand by novice programmers.This paper systematically designed the language by identifying themes from various existing programming languages(e.g.,C,Python).Additionally,this paper surveyed computer science experts from industry and academia,where experts self-reported their satisfaction with the newly designed language.The results indicate that 93%of the experts reported satisfaction with the NewBee for novice,newcomer and non-Computer Sci-ence(CS)major students.

A Semiotic Analysis of Programming Languages

The paper presents an analysis of computer programming languages based on the semiotics of Charles S. Peirce. The author describes how such languages could evolve in order to achieve some of the expressive characteristics of natural languages. This description evinces otherwise unnoticed differences between natural languages and programming languages, showing that Peircean semiotics is an efficient analysis tool. This suggests further research on the technical features needed to implement an easier way to program computers.

《Grammars for Programming Languages》简介

加利福尼亚大学J. Craig cleaveland和Robert C. Uzgalis合著的“Grammars forProgramming Languages”(程序设计语言的文法)一书系美国ELSEVIER NORTH-HO-LLAND, INC.1977年出版的一套程序设计语言丛书之一。 自从1956年Noam

Analysis of an event study using the Fama–French five‑factor model:teaching approaches including spreadsheets and the R programming language

The current financial education framework has an increasing need to introduce tools that facilitate the application of theoretical models to real-world data and contexts.However,only a limited number of free tools are available for this purpose.Given this lack of tools,the present study provides two approaches to facilitate the implementa-tion of an event study.The first approach consists of a set of MS Excel files based on the Fama–French five-factor model,which allows the application of the event study methodology in a semi-automatic manner.The second approach is an open-source R-programmed tool through which results can be obtained in the context of an event study without the need for programming knowledge.This tool widens the calculus possibilities provided by the first approach and offers the option to apply not only the Fama–French five-factor model but also other models that are common in the finan-cial literature.It is a user-friendly tool that enables reproducibility of the analysis and ensures that the calculations are free of manipulation errors.Both approaches are freely available and ready-to-use.

Linguistic Economy Applied to Programming Language Identifiers

Though many different readability metrics have been created, there still is no universal agreement defining readability of software source code. The lack of a clear agreement of source code readability has ramifications in many areas of the software development life-cycle, not least of which being software maintainability. We propose a measurement based on Linguistic Economy to bridge the gap between mathematical and behavioral aspects. Linguistic Economy describes efficiencies of speech and is generally applied to natural languages. In our study, we create a large corpus of words that are likely to be found in a programmer’s vocabulary, and a corpus of existing identifiers found in a collection of open-source projects. We perform a usage analysis to create a database from both of these corpora. Linguistic Economy suggests that words requiring less effort to speak are used more often than words requiring more effort. This concept is applied to measure how difficult program identifiers are to understand by extracting them from the program source and comparing their usage to the database. Through this process, we can identify source code that programmers find difficult to review. We validate our work using data from a survey where programmers identified unpleasant to review source files. The results indicate that source files identified as unpleasant to review source code have more linguistically complicated identifiers than pleasant programs.

An Exploratory Practice of Integration of Industry and Education in High-level Programming Language Course in the Background of New Engineering

This paper analyzes some problems of the current teaching situation in the course High-level Programming Language,such as the lagging content of the course compared with technology development,the emphasis on theory rather than on practice,the low enthusiasm of students for learning,and the weak practical ability of students.In response to the needs of enterprises for talents under the background of New Engineering,especially the cultivation of students’adaptability and practical abilities towards future industries to improve students’knowledge and problemsolving abilities to keep up with the modern technology,this paper proposes the ways and methods to reform and explore the teaching content and teaching methods by integrating industry and education,assisting teaching according to industrial demands,and lowering technology barriers of new technology.The practical effect is evaluated through a survey in class and the follow-up questionnaire after class,and the results show that the effect of the practice is effective.

Spatial Data Process Using Python Script and Visual Programming Language in ArcGIS

Data are limitless. But those are usually not formed or created in our needs. Most of data providers deliver their data in Microsoft Excel spreadsheet, which is compatible with ArcGIS, the most widely used GIS （Geographic Information System） software in GIS sector. However, those table data contain much unnecessary information that do not need for a certain project. Using the raw data can increase processing times and reduce performance of geoprocessing tools. This study shows steps of how the raw data are being processed using ArcGIS ModelBuilder and Python script.

Current Trends in Online Programming Languages Learning Tools: A Systematic Literature Review

Students face difficulties in programming languages learning (PLL) which encourages many scholars to investigate the factors behind that. Although there a number of positive and negative factors found to be effective in PLL procedure, utilising online tools in PLL were recognized as a positive recommended means. This motivates many researchers to provide solutions and proposals which result in a number of choices and options. However, categorising those efforts and showing what has been done, would provide a better and clear image for future studies. Therefore, this paper aims to conduct a systematic literature review to show what studies have been done and then categorise them based on the type of online tools and the aims of the research. The study follows Kitchenham and Charters guidelines for writing SLR (Systematic Literature Review). The search result reached 1390 publications between 2013-09/2018. After the filtration which has been done through selected criteria, 160 publications were found to be adequate to answer the review questions. The main results of this systematic review are categorizing the aims of the studies in online PLL tools, classifying the tools and finding the current trends of the online PLL tools.

Research and Reflection on Teaching of C Programming Language Design

C Language is a basic programming language and a compulsory foundation course for majors of science and engineering. Subjected to teaching periods,students have no time to do enough concrete integrated exercises. In teaching of C programming language design, both teachers and students have some problems. On the one hand teachers should change their teaching ideology, on the other hand,students should spontaneously study and improve their study motivation. In this way, students will improve their programming ability and apply what they learn comprehensively.

Curriculum Innovation in Language Teacher Education:Reflections on the PGDELT Program’s Contributions to EFL Teachers’Continuing Professional Development

Initial teacher preparation and teachers’ continuing professional development are two significant pillars of the teacher education enterprise. The former encompasses a wide range of teachereducation initiatives at the levels of diploma, bachelor’s degree, postgraduate diploma, and even master’s degree for teacher licensure purposes. These are widely documented in the literature.What is important is how teacher professional development contributes to bolstering the teachereducator force, which is relatively insufficiently documented due to the very fact that different educational systems have somewhat different expectations of such programs in relation to the ideologies and theories underpinning the teacher professional development program design and curriculum offering. Taking stock of a postgraduate diploma program in English language teaching(PGDELT) for teachers’ continuing professional development with a 31-year history housed at a premier teacher education institution in Singapore, which has successfully graduated over 1, 000 English language teachers for colleges and universities in China, I intend to highlight some of its key features, as a former student and then a lecturer on the program, in order to draw implications for sustainable growth of language teacher education programs, especially those whose main purposes are to prepare teachers of English as a second or foreign language(ESL/EFL) and provide continuing professional development opportunities for such inservice teachers.

Innovation in Adult Language Learning Programs: A Case Study of "Livemocha" Online Language Learning Community

Due to the increasing broadband Internet access, VOIP adoption as well as the Web 2.0 concepts, online language learning communities have gained great popularity among adult language learners. Based upon Malcolm Knowles' adult learning theory, this paper analyzes the innovation that online language learning communities have brought to adult language learning programs. At the same time, the limitations of such programs have been pointed out.

Advanced English教材中的修辞格赏析

高级英语是英语专业高年级阶段所开设的一门训练学生综合英语技能尤其是阅读理解、语法修辞与写作能力的课程。高级英语(上、下册)教材的不同文体中使用了大量的修辞手法,使得一篇文章、一段演说,甚至一部小说就像经过精雕细琢的一件艺术品,供人欣赏,耐人寻味。

Agent Oriented Programming进展

Agent-oriented programming (AOP) is a framework to develop agents, and it aims to link the gap betweentheory and practical in agent research. The core of an AOP framework is its language and semantics. In this paper,we propose the necessary properties which agents should have, and then give a summary and analysis about differentAOP languages based on these properties.

Level of circulating PD-L1 expression in patients with advanced gastric cancer and its clinical implications

Objective：The programmed cell death-1 receptor/programmed cell death-1 ligand （PD-1/PD-L1） pathway plays a crucial role in tumor evasion from host immunity.This study was designed to evaluate the association between circulating PD-L1 expression and prognosis in patients with advanced gastric cancer.Methods：Totally 80 advanced gastric cancer patients and 40 health controls from Beijing Cancer Hospital were enrolled in the present study.Circulating PD-L1 expression was tested by enzymelinked immunosorbent assay （ELISA）.The associations between the expression level of PD-L1 and clinicopathological features and prognosis were analyzed statistically.Results：Expression of PD-L1 in advanced gastric cancer patients was significandy up-regulated compared with health people （P=0.006）.The expression of PD-L1 was significantly correlated with differentiation and lymph node metastasis （P=0.026 and P=0.041,respectively）.Although we didn＇t find significant difference in all advanced gastric cancer patients with different PD-L1 expression,the adenocarcinoma patients with higher up-regulated PD-L1 expression had much better prognosis than low expression patients （65.6％ vs.44.7％,P=0.028）.Conclusions：PD-L1 was elevated in advance gastric cancer patients and may play an important role in tumor immune evasion and patients prognosis.