Choice of discount rate in reinforcement learning with long-delay rewards

In the world, most of the successes are results of longterm efforts. The reward of success is extremely high, but before that, a long-term investment process is required. People who are “myopic” only value short-term rewards and are unwilling to make early-stage investments, so they hardly get the ultimate success and the corresponding high rewards. Similarly, for a reinforcement learning(RL) model with long-delay rewards, the discount rate determines the strength of agent’s “farsightedness”.In order to enable the trained agent to make a chain of correct choices and succeed finally, the feasible region of the discount rate is obtained through mathematical derivation in this paper firstly. It satisfies the “farsightedness” requirement of agent. Afterwards, in order to avoid the complicated problem of solving implicit equations in the process of choosing feasible solutions,a simple method is explored and verified by theoreti cal demonstration and mathematical experiments. Then, a series of RL experiments are designed and implemented to verify the validity of theory. Finally, the model is extended from the finite process to the infinite process. The validity of the extended model is verified by theories and experiments. The whole research not only reveals the significance of the discount rate, but also provides a theoretical basis as well as a practical method for the choice of discount rate in future researches.

Discount Rate of China’s New Energy Power Industry

Under the dual pressures of energy crisis and environmental pollution,China’s new energy power industry has become a focal point for environmental management and requires greater investment.In this context,as a significant input of investment projects,discount rate requires a well-calibrated evaluation because new energy power investment projects are highly capital intensive.The main objective of this paper is to evaluate the discount rate of China’s new energy power industry.First,we use Moving Average to correct the parameters of capital asset pricing model(CAPM)and weighted average cost of capital,which extends the literature on the avoidance of CAPM noise information problem.Second,we study the industry-level annual discount rates of mainly China’s new energy power industries,including hydropower,nuclear power,wind power,and photovoltaic power industries for the period of 2014-2019.The results show that discount rates in China’s new energy power industries evolved differently between the years of 2014-2019 with average annual discount rates being 7.56%,5.83%,5.60%,and 8.64%,for the hydropower,nuclear power,wind power,and photovoltaic power industries,respectively.In 2019,the four annual discount rates were highest for the photovoltaic power industry(8.66%),followed by hydropower(7.17%),wind power(5.72%),and nuclear power industry(5.26%).Forecasting to 2020 from the 2019 evaluation base period,the discount rates are 6.37%,5.00%,6.57%,and 9.05%for the photovoltaic power,hydropower,wind power,and nuclear power industries,respectively.Under the different capital structures,their forecasts for the photovoltaic power,hydropower,wind power,and nuclear power industries in 2020 are,respectively,within[4.35%,9.24%],[3.92%,7.10%],[4.58%,10.40%],[5.46%,14.81%].We also discussed more details on capital structure and forecast period of discount rates for China’s new energy power industries.Our analysis shows that it is necessary to establish a new energy power industry database and steadily promote the implementation of policies.

The Discount Rate in Terms of Evaluating Investments in Rangelands： The Case Study of Greece

This paper aims at analyzing and evaluating investments in rangeland management through the use of the discount rate tool. The most important parameter which is considered when estimating the discount rate is the lifetime of the investment, which varies depending on the kind of the intervention. An undeniable characteristic of rangelands is their rich biodiversity. However, the fact that not all the flora and fauna has been recorded yet, suggests the need for using the lowest possible discount rate （but not zero）, giving thus a high value on the benefits that will arise for future generations always in the light of sustainable development. At the same time, a sensitivity analysis has to be performed in order to determine the upper and lower limit of return on investment, so that the decision-maker in charge can be more flexible on the evaluation Of an investment proposal.

Real option pricing method for R&D investment under changing risk-free rate and discount rate

The polynomial spline model, which belongs to the static term structure model of interest rates, is studied. Every cash flow of the project is discounted relatively accurately by obtaining the discount rate from the static term structure model of interest rates. A simple basic model, which belongs to the dynamic term structure model, is studied, and the option pricing formula under changing risk-free rates is obtained by bringing it into the option pricing formula. Both dynamic and static term structure models are estimated by the use of the data of buy-back rates and the Shanghai Stock Exchange, and an example is given to compare the differences between the traditional method and the method under the changes in the interest rates and the discount rates.

Exchange rate,discount rate,interest rate and depreciation rate

exchange rate:汇率,外汇汇率,指一个国家的货币和另一个国家的货币的比价。中国人民银行每天公布人民币市场汇价。如:market Exchange Rates in RMB yuan set by the People’s Bank ofChina(September 4,1998)Currency Unit RateUS dollar 100 828.00Japanese yen 100 6.0291German mark 100 478.

Estimation of lung cancer burden in Australia,the Philippines,and Singapore:an evaluation of disability adjusted life years

Objective: Lung cancer is one of the leading cancers and major causes of cancer mortality worldwide. The economic burden associated with the high mortality of lung cancer is high, which accounts for nearly $180 billion on a global scale in 2008. This paper aims to understand the economic burden of lung cancer in terms of disability adjusted life years(DALY) in Australia, the Philippines, and Singapore.Methods: The years of life lost(YLL) and years lost due to disability(YLD) were calculated using the formula developed by Murray and Lopez in 1996 as part of a comprehensive assessment of mortality and disability for diseases, injuries and risk factors in 1990 and projected to 2020. The same formula is represented in the Global Burden of Disease template provided by the World Health Organization. Appropriate assumptions were made when data were unavailable and projections were performed using regression analysis to obtain data for 2015.Results: The total DALYs due to lung cancer in Australia, the Philippines, and Singapore were 91,695, 38,584, and 12,435,respectively, and the corresponding DALY rates per a population of 1,000 were 4.0, 0.4, and 2.2, respectively, with a discount rate of 3%. When researchers calculated DALYs without the discount rate, the burden of disease increased substantially; the DALYs were 117,438 in Australia, 50,977 in the Philippines, and 16,379 in Singapore. Overall, YLL or premature death accounted for more than 95% of DALYs in these countries.Conclusions: Strategies for prevention, early diagnosis, and prompt treatment must be devised for diseases where the major burden is due to mortality.

Study of evaluation method for the overseas oil and gas investment based on risk compensation

The overseas oil and gas investment evaluation is one of the core tasks in overseas investment of oil and gas companies,among which risk evaluation and benefit evaluation are the most important.This paper sets forth transmission paths of risk factors to the investment benefit by identifying 14 overseas oil and gas investment risks in four categories.On the basis of the concept of risk compensation,different compensation mechanisms specific to each risk are designed.The risk and benefit are integrated objectively to develop a comprehensive evaluation model by correcting the recoverable reserve,adjusting benefit evaluation parameters such as investments on exploration and development,and compensating for the changes in risk factors with time through dynamic discount rate.Moreover,two cases studies,namely the evaluations of Project A in Sudan and comparison among Blocks A–G,are used to describe usage method and applicable scope of such evaluation model,respectively.According to the results,oil price is a key influencing factor for enterprise internal risk and industrial risk.Risk compensation reduces comprehensive benefit of overseas oil and gas investment and undermines the investment feasibility and priority of blocks.The research findings of this paper are free from the effects of some subject factors and avoid multi-objective decision making,and also avoid the undesired repeated calculation of risk factors.

An assessment of Charter airline benefits for Port Elizabeth and the Eastern Cape

Tourism is becoming a vital component for economic development in South Africa. The income generated by the tourism industry is about 6% of the GDP, which is significant but still falls short of the goal set by the White Paper on Tourism in 2000. In the light of South Africa hosting the 2010 Football World Cup, it is important to identify ways of sustainable tourism development that would continue to increase the benefits to the economy long after the event＇s over. The main objective of the research was to explore an idea for increasing the level of tourist income generated in the Port Elizabeth （Eastern Cape） area. The idea was researched by means of conducting a cost-benefit analysis of two tourist related projects. These projects would introduce Charter airline services between Europe and Port Elizabeth. A second objective was to identify constraints on the project or market failures which would prevent their implementation. The economic theory behind the operation of an airline showed that lease costs and aeroplane operating costs are the two most important factors determine Charter airline＇s profitability. In order to offset these costs, airlines must achieve high passenger load factors. Charter airlines have the advantage over scheduled airlines, in that they will only fly if a minimum level of people has pre-booked seats. Two aeroplanes were chosen for comparison purpose： an Airbus A 340-300 and a Boeing 767-300ER. The private benefits calculated were based on load factors between 80 and 95 percent for ticket prices of USD 667 and USD 773. In addition, to private costs and benefits, social benefits were also estimated in the form of additional secondary revenue generated. With the introduction of net social benefits, both projects become profitable. A 50 percent substitution of revenue generated by the Charter tourists reduces the profits for the both projects drastically. A project based on a Boeing 767-300ER is the most efficient project as it has the highest NPV and BCR values. A reduction in the lease cost of the Airbus 340-300 could make projects based on it more competitive. A few constraints on the establishment of a Charter airline operator based in Port Elizabeth are： the lack of adequate runway for the landing of the long-haul carriers and the need of a larger liberalisation of the aviation policy by eliminating protectionism. The cost benefit analysis undertaken in this research does not take into account social costs and benefits to the economy of establishing a Charter airline based in Port Elizabeth, such as an employment, infrastructure development and poverty alleviation. Nevertheless the analysis does suggest that there are strong private and social benefits warranting the establishment of an airline business between Europe and Port Elizabeth. The economic benefits of the tourism industry and its link to airline travel are outlined in section 3. It is shown that the growth of the airline industry is a major component and contributor to tourism growth.

Research on Sales Strategy Based on Supermarket Pipeline Data

“Low profit and high sales” is a strategy to increase sales volume by reducing the profit of unit goods, so that businesses can gain more profits. For flexible goods, price reduction can increase the total revenue, but when the goods are lack of flexibility, price reduction will reduce the total revenue. In this paper, according to the sales data provided by a supermarket, we preprocess the data, establish appropriate indicators to measure the daily discount strength of the mall, and establish a mathematical model between the discount strength, sales and profit margin. Through these models, we found that meager profits do bring up sales, but too low discounts can also hurt total profits. In addition, when shopping malls implement discount promotions, they will also bring some negative effects, and we give some suggestions for this.

Continuing Value Calculation with Discounted Cash Flows Method： An Application Example for Tekart Tourism Establishment Whose Shares Are Dealt in Istanbul Stock Exchange

Valuation is stated as monetary value belonging to firm assets （Verginis ＆ Taylor, 2004）. According to M. L. Rock, R. H. Rock, and Sikora （1994）, valuation is the answer of the following questions： What is the maximum price that will be paid for the firm？ What are the risk areas？ What are the results of cash flows, profitability, and balance-sheet？ Chambers （2005, p. 5）, on the other hand, estimated a probable price that will be paid for the goods and service at a specific time. For the calculation of continuing value （CV）, Verginis and Taylor （2004） used discounted cash flows （DCF） method and Onal, Karadeniz, and Kandlr （2005） used economic profit method. Klrh （2005） suggested Continuous and Constant Growing Model （Gordon Model）, Value Driver Model, and Economic Profit Model. In this study, DCF which is suggested by Onal et al. （2005） and Verginis and Taylor （2004） is used for the aim of determining CV of the firm at issue. In this study, analyses are made by using the financial statement data of a tourism business whose shares are dealt in Istanbul Stock Exchange. In consequence of the calculations, CV of the examined firm is found to be 7,485,402 TL and firm value is found to be 15,195,366 TL.

Modified Ramsey Rule, Optimal Carbon Tax and Economic Growth

In contrast to the overlapping-generations model, it is allowable to discount the future utility in a dynasty model without the ethical difficulty related to intergenerational conflicts. Much precedent research uses Ramsey-type optimal growth theory in order to estimate the social discount rate. However, one must note that almost all the formulations neglect the existence of negative intertemporal externalities. This problem is vital when one analyzes the global warming problem mainly caused by the excess concentration of carbon dioxide (CO2). This is because an adjoining effect of capital accumulation exists besides the improvement of product capacity, which is reflected in the rate of interest (or equivalently, the marginal productivity of capital). That is, one cannot neglect a negative externality to the future productivity that originates from the excess emissions of CO2. Accordingly, following the optimal growth theory, the effective social discount rate should be heightened by a proportional carbon tax to suppress future excess consumption/ emissions than in the case of the existing analyses, which exclude such an intertemporal external diseconomy.

Modified Ramsey Rule and Optimal Carbon Tax

The Ramsey rule is regarded as a convenient vehicle for estimating the social discount rate in general. Carbon pricing is treated as another theory of environmental economics. This study clarifies the theoretical relationship between the Ramsey rule and optimal carbon price, which has been overlooked in the existing research. It succeeds in deriving the optimal carbon price from the modified Ramsey rule in stationary state. Since the Ramsey rule decides the dynamics of an economy and a stationary state is its destination, by using the optimization condition of individual who are assumed to live infinitesimally short life, we can solve the optimal carbon price at stationary state.

Gender difference in network relationship between inter-temporal decisions and prefrontal activation levels in internet gaming disorder

Background:Impulsivity and decision-making are key factors in addiction.However,little is known about how gender and time sensitivity affect impulsivity in internet gaming disorder(IGD).Objective:To investigate the gender difference of impulsive decision-making and relevant brain responses in IGD.Methods:We conducted a functional magnetic resonance imaging(fMRI)study with 123 participants,including 59 IGD individuals(26 females)and 64 matched recreational game users(RGUs,23 females).Participants performed a delay-discounting task during fMRI scanning.We examined gender-by-group effects on behavioral and neural measures to explore the preference for immediate over delayed rewards and the associated brain activity.We also investigated the network correlations between addiction severity and behavioral and neural measures,and analyzed the mediating role of brain activity in the link between delay discounting parameters and IGD severity.Results:We found significant gender-by-group interactions.The imaging results revealed gender-by-group interactions in the dor-solateral prefrontal cortex,medial frontal gyrus,and inferior frontal gyrus(IFG).Post hoc analysis indicated that,for females,RGUs showed higher activity than IGD individuals in these brain regions,while for males IGD individuals exhibited higher activity than RGUs.The activation in the left IFG mediated the relation between Internet Addiction Test score and discount rate in females.In males,the activation in the right dlPFC mediated the relation between IAT score and time sensitivity.Discussion:Our findings imply that male IGD participants demonstrate impaired intertemporal decisions associated with neural dysfunction.Influencing factors for impulsive decision-making in IGD diverge between males(time sensitivity)and females(discount rate).These findings augment our comprehension of the neural underpinnings of gender differences in IGD and bear significant implications for devising effective intervention strategies for treating people with IGD.