针对深度增强学习算法中探索开发策略的平衡问题,提出一种基于VDBE(Value-Difference Based Exploration)扩展的自适应探索改进算法.该算法依赖于值函数差异提出一种基于状态的探索控制策略,以达到在初始学习阶段不熟悉周围环境时agent...针对深度增强学习算法中探索开发策略的平衡问题,提出一种基于VDBE(Value-Difference Based Exploration)扩展的自适应探索改进算法.该算法依赖于值函数差异提出一种基于状态的探索控制策略,以达到在初始学习阶段不熟悉周围环境时agent采取积极探索策略,而随着深入学习和周边环境的熟悉,agent逐渐降低探索率的自适应探索/开发平衡的理想行为状态.展开更多
Rotating machines are very sensitive to mass unbalance which has a harmful effect on its running accuracy and service life. Therefore,a variety of dynamic balancing methods and devices are studied to reduce the vibrat...Rotating machines are very sensitive to mass unbalance which has a harmful effect on its running accuracy and service life. Therefore,a variety of dynamic balancing methods and devices are studied to reduce the vibration caused by mass unbalance. On-line active balancing is a new balancing procedure which is more convenient and precise than the previous methods. In this paper,an electromagnetic balancer based on ring coils and permanent magnets is presented. The balancer has a simple structure and the self-locking function without clutch,and transfers power by the non-contact electromagnetic field. In order to justify the rationality of its design,a two-dimension(2D) electromagnetic finite element model is conducted to verify that this magnetic circuit has no flux leakage and saturation. A three-dimension (3D) 1/10 model of the balancer is built to obtain the self-locking torque and driving torque. Based on the research work above,an electromagnetic balancer is developed. By testing the balancer using COCO80,it is verified effective to reduce the rotor unbalance at the speed of 1300 r/min.展开更多
Rate transient method is a recently-developed performance analysis tool specially designed for low-permeability or tight gas reservoirs. This method, theoretically based on pressure transient analysis, integrates mate...Rate transient method is a recently-developed performance analysis tool specially designed for low-permeability or tight gas reservoirs. This method, theoretically based on pressure transient analysis, integrates material balance principle and the concept of material balance pseudo-time proposed by Blansingame. With daily production data of gas well, it could be used to calculate OGIP, current formation pressure, permeability, skin factor, to identify complex geologic boundaries, to determine whether drainage boundary has been reached, to calculate drainage area and drainage radius for single well and to predict performance. It has been extensively employed in more than ten low-permeability gas fields. It proves that most problems in performance analysis for low permeability gas reservoirs could be solved by this method. Field practices show great economical benefits could be achieved by employing this method in gas field development.展开更多
This paper presents an innovative switched-mode auto gain control （AGC） circuit with internally created reset module for DC-10Mb/s burst-mode unbalanced （BMU） optical data transmission. Conventional AGC circuit is...This paper presents an innovative switched-mode auto gain control （AGC） circuit with internally created reset module for DC-10Mb/s burst-mode unbalanced （BMU） optical data transmission. Conventional AGC circuit is inappropriate for BMU data transmission because it is based on average level detection and requires considerable time to settle on a predefined gain. Therefore, we adopt a fast switched-mode AGC based on peak level detection. After the gain is adjusted, the peak level detectors need to re-detect the peak level of the input signal. Thus, we develop an internally created reset module. This AGC with reset module exhibits a fast operation and achieves an adjusted stable gain within one-bit, avoiding any bit loss up to 10Mb/s data rate. During power-up, the peak level detectors possibly hold an uncertain level resulting in the bit-errors. We propose a power-up reset circuit to solve this problem. Designed in a 0.5μm CMOS technology, the circuit achieves an optical sensitivity of better than -30dBm and a wide dynamic range of over 30dB with a power dissipation of only 30 mW from a 5V supply.展开更多
Bacteria need a high degree of genetic stability to maintain their species identities over long evolutionary times while retaining some mutability to adapt to the changing environment.It is a long unanswered question ...Bacteria need a high degree of genetic stability to maintain their species identities over long evolutionary times while retaining some mutability to adapt to the changing environment.It is a long unanswered question that how bacteria reconcile these seemingly contradictory biological properties.We hypothesized that certain mechanisms must maintain a dynamic balance between genetic stability and mutability for the survival and evolution of bacterial species.To identify such mechanisms,we analyzed bacterial genomes,focusing on the Salmonella mismatch repair(MMR)system.We found that the MMR gene mutL functions as a genetic switch through a slipped-strand mispairing mechanism,modulating and maintaining a dynamic balance between genetic stability and mutability during bacterial evolution.This mechanism allows bacteria to maintain their phylogenetic status,while also adapting to changing environments by acquiring novel traits.In this review,we outline the history of research into this genetic switch,from its discovery to the latest findings,and discuss its potential roles in the genomic evolution of bacteria.展开更多
文摘针对深度增强学习算法中探索开发策略的平衡问题,提出一种基于VDBE(Value-Difference Based Exploration)扩展的自适应探索改进算法.该算法依赖于值函数差异提出一种基于状态的探索控制策略,以达到在初始学习阶段不熟悉周围环境时agent采取积极探索策略,而随着深入学习和周边环境的熟悉,agent逐渐降低探索率的自适应探索/开发平衡的理想行为状态.
基金The National Science and Technology Major Project of China(No.2010ZX04012-014)
文摘Rotating machines are very sensitive to mass unbalance which has a harmful effect on its running accuracy and service life. Therefore,a variety of dynamic balancing methods and devices are studied to reduce the vibration caused by mass unbalance. On-line active balancing is a new balancing procedure which is more convenient and precise than the previous methods. In this paper,an electromagnetic balancer based on ring coils and permanent magnets is presented. The balancer has a simple structure and the self-locking function without clutch,and transfers power by the non-contact electromagnetic field. In order to justify the rationality of its design,a two-dimension(2D) electromagnetic finite element model is conducted to verify that this magnetic circuit has no flux leakage and saturation. A three-dimension (3D) 1/10 model of the balancer is built to obtain the self-locking torque and driving torque. Based on the research work above,an electromagnetic balancer is developed. By testing the balancer using COCO80,it is verified effective to reduce the rotor unbalance at the speed of 1300 r/min.
文摘Rate transient method is a recently-developed performance analysis tool specially designed for low-permeability or tight gas reservoirs. This method, theoretically based on pressure transient analysis, integrates material balance principle and the concept of material balance pseudo-time proposed by Blansingame. With daily production data of gas well, it could be used to calculate OGIP, current formation pressure, permeability, skin factor, to identify complex geologic boundaries, to determine whether drainage boundary has been reached, to calculate drainage area and drainage radius for single well and to predict performance. It has been extensively employed in more than ten low-permeability gas fields. It proves that most problems in performance analysis for low permeability gas reservoirs could be solved by this method. Field practices show great economical benefits could be achieved by employing this method in gas field development.
基金Supported by the Natural Science Foundation of Jiangsu Province （ BK2010411 ） and the National International Cooperation Project of China-Korea （2011DFA11310）.
文摘This paper presents an innovative switched-mode auto gain control （AGC） circuit with internally created reset module for DC-10Mb/s burst-mode unbalanced （BMU） optical data transmission. Conventional AGC circuit is inappropriate for BMU data transmission because it is based on average level detection and requires considerable time to settle on a predefined gain. Therefore, we adopt a fast switched-mode AGC based on peak level detection. After the gain is adjusted, the peak level detectors need to re-detect the peak level of the input signal. Thus, we develop an internally created reset module. This AGC with reset module exhibits a fast operation and achieves an adjusted stable gain within one-bit, avoiding any bit loss up to 10Mb/s data rate. During power-up, the peak level detectors possibly hold an uncertain level resulting in the bit-errors. We propose a power-up reset circuit to solve this problem. Designed in a 0.5μm CMOS technology, the circuit achieves an optical sensitivity of better than -30dBm and a wide dynamic range of over 30dB with a power dissipation of only 30 mW from a 5V supply.
基金supported by a Heilongjiang Innovation Endowment Award for graduate studies(YJSCX2012-197HLJ)to Tang Lea grant from the National Natural Science Foundation of China(NSFC30970078)+1 种基金the Natural Science Foundation of Heilongjiang Province to Liu GuiRongthe National Natural Science Foundation of China(NSFC30970119,81030029,81271786,NSFC-NIH 81161120416)to Liu ShuLin
文摘Bacteria need a high degree of genetic stability to maintain their species identities over long evolutionary times while retaining some mutability to adapt to the changing environment.It is a long unanswered question that how bacteria reconcile these seemingly contradictory biological properties.We hypothesized that certain mechanisms must maintain a dynamic balance between genetic stability and mutability for the survival and evolution of bacterial species.To identify such mechanisms,we analyzed bacterial genomes,focusing on the Salmonella mismatch repair(MMR)system.We found that the MMR gene mutL functions as a genetic switch through a slipped-strand mispairing mechanism,modulating and maintaining a dynamic balance between genetic stability and mutability during bacterial evolution.This mechanism allows bacteria to maintain their phylogenetic status,while also adapting to changing environments by acquiring novel traits.In this review,we outline the history of research into this genetic switch,from its discovery to the latest findings,and discuss its potential roles in the genomic evolution of bacteria.
