The goal in reinforcement learning is to learn the value of state-action pair in order to maximize the total reward. For continuous states and actions in the real world, the representation of value functions is critic...The goal in reinforcement learning is to learn the value of state-action pair in order to maximize the total reward. For continuous states and actions in the real world, the representation of value functions is critical. Furthermore, the samples in value functions are sequentially obtained. Therefore, an online sup-port vector regression （OSVR） is set up, which is a function approximator to estimate value functions in reinforcement learning. OSVR updates the regression function by analyzing the possible variation of sup-port vector sets after new samples are inserted to the training set. To evaluate the OSVR learning ability, it is applied to the mountain-car task. The simulation results indicate that the OSVR has a preferable con- vergence speed and can solve continuous problems that are infeasible using lookup table.展开更多
Impact of Internet Technologies increases importance of changes in the system of social communication creating a stressful situation for the functioning of traditionally established social institutions. New phenomena ...Impact of Internet Technologies increases importance of changes in the system of social communication creating a stressful situation for the functioning of traditionally established social institutions. New phenomena such as priest＇s and saints＇ online pages, represent significant deviation from historical practice, bring certain dissonance to the activities of the church. On one hand, church has to use modern communication channel, on the other hand, effects of online translation of confessional relations are not predictable. Open global socieW requires certain universalization of education, but professional communications are faced not only with a problem of language barrier, but also with national culture. School of thought, formed in traditions of particular cultural outlook, risks losing its face to the loss of national characteristics of the education system. Institute of Administration is also experiencing certain amount of stress.展开更多
The PHS （Personal Handy phone System） technology developed in Japan realized high quality and low cost mobile communication in a micro cell and abundant valueadded services. Having considered many advantages of PHS,...The PHS （Personal Handy phone System） technology developed in Japan realized high quality and low cost mobile communication in a micro cell and abundant valueadded services. Having considered many advantages of PHS, this paper proposed PHS-ETC online system as a technological evolution to substitute for the traditional DSRC-ETC. After comparing DSRC with PHS, this paper discussed the framework and layer structure of the DSRC and PHS system. Besides the functions concerned as vehicle identification and wireless communication, this paper also designed routing identification and toll apportionment functions to meet the needs of ETC. And the newly-designed functions could not be provided by DSRC system. By appending the Presentation Layer, the system could make full use of the existing function modules of DSRC and PHS, and the reconstruction would be greatly saved. Moreover, the system could extend many value-added services of PHS to the expressway, such as real-time traffic advisories, up-to-date navigation guidance, emergency communication, etc.展开更多
文摘The goal in reinforcement learning is to learn the value of state-action pair in order to maximize the total reward. For continuous states and actions in the real world, the representation of value functions is critical. Furthermore, the samples in value functions are sequentially obtained. Therefore, an online sup-port vector regression （OSVR） is set up, which is a function approximator to estimate value functions in reinforcement learning. OSVR updates the regression function by analyzing the possible variation of sup-port vector sets after new samples are inserted to the training set. To evaluate the OSVR learning ability, it is applied to the mountain-car task. The simulation results indicate that the OSVR has a preferable con- vergence speed and can solve continuous problems that are infeasible using lookup table.
文摘Impact of Internet Technologies increases importance of changes in the system of social communication creating a stressful situation for the functioning of traditionally established social institutions. New phenomena such as priest＇s and saints＇ online pages, represent significant deviation from historical practice, bring certain dissonance to the activities of the church. On one hand, church has to use modern communication channel, on the other hand, effects of online translation of confessional relations are not predictable. Open global socieW requires certain universalization of education, but professional communications are faced not only with a problem of language barrier, but also with national culture. School of thought, formed in traditions of particular cultural outlook, risks losing its face to the loss of national characteristics of the education system. Institute of Administration is also experiencing certain amount of stress.
文摘The PHS （Personal Handy phone System） technology developed in Japan realized high quality and low cost mobile communication in a micro cell and abundant valueadded services. Having considered many advantages of PHS, this paper proposed PHS-ETC online system as a technological evolution to substitute for the traditional DSRC-ETC. After comparing DSRC with PHS, this paper discussed the framework and layer structure of the DSRC and PHS system. Besides the functions concerned as vehicle identification and wireless communication, this paper also designed routing identification and toll apportionment functions to meet the needs of ETC. And the newly-designed functions could not be provided by DSRC system. By appending the Presentation Layer, the system could make full use of the existing function modules of DSRC and PHS, and the reconstruction would be greatly saved. Moreover, the system could extend many value-added services of PHS to the expressway, such as real-time traffic advisories, up-to-date navigation guidance, emergency communication, etc.
