摘要
We provide an overview of the recently developed general infinitesimal perturbation analysis(IPA)framework for stochastic hybrid systems(SHSs),and establish some conditions under which this framework can be used to obtain unbiased performance gradient estimates in a particularly simple and efficient manner.We also propose a general scheme for systematically deriving an abstraction of a discrete event system(DES)in the form of an SHS.Then,as an application of the general IPA framework,we study a class of stochastic non-cooperative games termed“resource contention games”modeled through stochastic flow models(SFMs),where two or more players(users)compete for the use of a sharable resource.Simulation results are provided for a simple version of such games to illustrate and contrast system-centric and user-centric optimization.
基金
This work was supported in part by the National Science Foundation under Grant EFRI-0735794
by AFOSR under Grants FA9550-07-1-0361 and FA9550-09-1-0095
by DOE under Grant DE-FG52-06NA27490
by ONR under Grant N00014-09-1-1051.
