• Media type: E-Article
  • Title: Denumerable-state continuous-time Markov decision processes with unbounded transition and reward rates under the discounted criterion
  • Contributor: Guo, Xianping; Zhu, Weiping
  • Published: Cambridge University Press (CUP), 2002
  • Published in: Journal of Applied Probability, 39 (2002) 2, Seite 233-250
  • Language: English
  • DOI: 10.1239/jap/1025131422
  • ISSN: 0021-9002; 1475-6072
  • Keywords: Statistics, Probability and Uncertainty ; General Mathematics ; Statistics and Probability
  • Origination:
  • Footnote:
  • Description: <jats:p>In this paper, we consider denumerable-state continuous-time Markov decision processes with (possibly unbounded) transition and reward rates and general action space under the discounted criterion. We provide a set of conditions weaker than those previously known and then prove the existence of optimal stationary policies within the class of all possibly randomized Markov policies. Moreover, the results in this paper are illustrated by considering the birth-and-death processes with controlled immigration in which the conditions in this paper are satisfied, whereas the earlier conditions fail to hold.</jats:p>