In this paper, we consider constrained denumerable state non-stationary Markov decision processes (MDPs, for short) with expected total reward criterion. By the mechanics of intro- ducing Lagrange multiplier and using...In this paper, we consider constrained denumerable state non-stationary Markov decision processes (MDPs, for short) with expected total reward criterion. By the mechanics of intro- ducing Lagrange multiplier and using the methods of probability and analytics, we prove the existence of constrained optimal policies. Moreover, we prove that a constrained optimal policy may be a Markov policy, or be a randomized Markov policy that randomizes between two Markov policies, that differ in only one state.展开更多
The objective of this study was to determine the role of SLC15A4 in the muramyl dipeptide(MDP)-mediated inflammatory response of bovine rumen epithelial cells(BRECs).First,changes in the m RNA expression of proinflamm...The objective of this study was to determine the role of SLC15A4 in the muramyl dipeptide(MDP)-mediated inflammatory response of bovine rumen epithelial cells(BRECs).First,changes in the m RNA expression of proinflammatory factor genes in BRECs following 10μg m L^(–1)MDP treatments were examined.RT-q PCR results showed that the expression of pro-inflammatory factor(IL-1β,IL-6,and TNF-α)m RNAs were significantly increased under MDP stimulation(P<0.001).Moreover,SLC15A4-Knockout(SLC15A4-KO)cells were obtained through lentivirus packaging,transfection,screening,and cell monoclonal culture.In order to gain further insight into the potential function of SLC15A4,we utilized transcriptome data,which revealed a change in the genes between WT-BRECs and SLC15A4-KO.Five down-regulated pro-inflammatory genes and 13 down-regulated chemokine genes related to the inflammatory response were identified.Meanwhile,the down-regulated genes were mostly enriched in the nuclear factorκB(NF-κB)and mitogen-activated protein kinase(MAPK)signaling pathways.The results of RT-q PCR also verified these detected changes.To further determine the mechanism of how WT and SLC15A4-KO BRECs are involved in inflammatory responses,we investigated the inflammatory responses of cells exposed to MDP.WT-BRECs and SLC15A4-KO were treated with a culture medium containing 10μg m L^(–1)MDP,in comparison to a control without MDP.Our results show that SLC15A4-KO BRECs had reduced the expression of genes(IL-6,TNF-α,CXCL2,CXCL3,CXCL9,and CCL2)and proteins(p-p65 and p-p44/42)from the MDP-mediated inflammatory response compared to WT-BRECs(P<0.05).In this experiment,CRISPR-Cas9 was used to KO the di/tripeptide transporter SLC15A4,and its role was confirmed via the MDP-induced inflammatory response in BRECs.This work will provide a theoretical basis for studying the pro-inflammatory mechanism of MDP and its application in the prevention and treatment of subacute rumen acidosis in dairy cows.展开更多
Data analytics of an information system is conducted based on a Markov decision process(MDP)and a partially observable Markov decision process(POMDP)in this paper.Data analytics over a finite planning horizon and an i...Data analytics of an information system is conducted based on a Markov decision process(MDP)and a partially observable Markov decision process(POMDP)in this paper.Data analytics over a finite planning horizon and an infinite planning horizon for a discounted MDP is performed,respectively.Value iteration(VI),policy iteration(PI),and Q-learning are utilized in the data analytics for a discounted MDP over an infinite planning horizon to evaluate the validity of the MDP model.The optimal policy to minimize the total expected cost of states of the information system is obtained based on the MDP.In the analytics for a discounted POMDP over an infinite planning horizon of the information system,the effects of various parameters on the total expected cost of the information system are studied.展开更多
基金the National Natural Science Foundation of China !19901038by Natural Science Foundation of Guangdong Province and by Found
文摘In this paper, we consider constrained denumerable state non-stationary Markov decision processes (MDPs, for short) with expected total reward criterion. By the mechanics of intro- ducing Lagrange multiplier and using the methods of probability and analytics, we prove the existence of constrained optimal policies. Moreover, we prove that a constrained optimal policy may be a Markov policy, or be a randomized Markov policy that randomizes between two Markov policies, that differ in only one state.
基金the National Natural Science Foundation of China(31972589)the earmarked fund for China Agriculture Research System(CARS-36)the Postgraduate Research&Practice Innovation Program of Jiangsu Province,China(KYCX21-3283)。
文摘The objective of this study was to determine the role of SLC15A4 in the muramyl dipeptide(MDP)-mediated inflammatory response of bovine rumen epithelial cells(BRECs).First,changes in the m RNA expression of proinflammatory factor genes in BRECs following 10μg m L^(–1)MDP treatments were examined.RT-q PCR results showed that the expression of pro-inflammatory factor(IL-1β,IL-6,and TNF-α)m RNAs were significantly increased under MDP stimulation(P<0.001).Moreover,SLC15A4-Knockout(SLC15A4-KO)cells were obtained through lentivirus packaging,transfection,screening,and cell monoclonal culture.In order to gain further insight into the potential function of SLC15A4,we utilized transcriptome data,which revealed a change in the genes between WT-BRECs and SLC15A4-KO.Five down-regulated pro-inflammatory genes and 13 down-regulated chemokine genes related to the inflammatory response were identified.Meanwhile,the down-regulated genes were mostly enriched in the nuclear factorκB(NF-κB)and mitogen-activated protein kinase(MAPK)signaling pathways.The results of RT-q PCR also verified these detected changes.To further determine the mechanism of how WT and SLC15A4-KO BRECs are involved in inflammatory responses,we investigated the inflammatory responses of cells exposed to MDP.WT-BRECs and SLC15A4-KO were treated with a culture medium containing 10μg m L^(–1)MDP,in comparison to a control without MDP.Our results show that SLC15A4-KO BRECs had reduced the expression of genes(IL-6,TNF-α,CXCL2,CXCL3,CXCL9,and CCL2)and proteins(p-p65 and p-p44/42)from the MDP-mediated inflammatory response compared to WT-BRECs(P<0.05).In this experiment,CRISPR-Cas9 was used to KO the di/tripeptide transporter SLC15A4,and its role was confirmed via the MDP-induced inflammatory response in BRECs.This work will provide a theoretical basis for studying the pro-inflammatory mechanism of MDP and its application in the prevention and treatment of subacute rumen acidosis in dairy cows.
文摘Data analytics of an information system is conducted based on a Markov decision process(MDP)and a partially observable Markov decision process(POMDP)in this paper.Data analytics over a finite planning horizon and an infinite planning horizon for a discounted MDP is performed,respectively.Value iteration(VI),policy iteration(PI),and Q-learning are utilized in the data analytics for a discounted MDP over an infinite planning horizon to evaluate the validity of the MDP model.The optimal policy to minimize the total expected cost of states of the information system is obtained based on the MDP.In the analytics for a discounted POMDP over an infinite planning horizon of the information system,the effects of various parameters on the total expected cost of the information system are studied.
