Approximations for constrained Markov decision problems
dc.contributor.author | Saldı, Naci | |
dc.contributor.author | Linder, T. | |
dc.contributor.author | Yüksel, S. | |
dc.date.accessioned | 2019-01-15T13:02:08Z | |
dc.date.available | 2019-01-15T13:02:08Z | |
dc.date.issued | 2018 | |
dc.identifier.isbn | 978-3-319-79032-9 | |
dc.identifier.issn | 2324-9749 | |
dc.identifier.uri | http://hdl.handle.net/10679/6104 | |
dc.identifier.uri | https://link.springer.com/chapter/10.1007/978-3-319-79033-6_6 | |
dc.description.abstract | This chapter studies the finite-state approximation of a discrete-time constrained Markov decision process with compact state space, under the discounted and average cost criteria. Using the linear programming formulation of the constrained discounted problem, we prove the convergence of the optimal value function of the finite-state model to the optimal value function of the original model. Under further continuity conditions on the transition probability of the original discounted model, we also establish a method to compute approximately optimal policies. For the average cost criterion, instead of using the finite-state linear programming approximation method, we use a direct method to establish analogous results under drift and minorization conditions which guarantee the geometric ergodicity of Markov chains induced by stationary policies. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | Springer | en_US |
dc.relation.ispartof | Finite Approximations in Discrete-Time Stochastic Control, Part of the Systems & Control: Foundations & Applications book series (SCFA) | |
dc.rights | restrictedAccess | |
dc.title | Approximations for constrained Markov decision problems | en_US |
dc.type | Book chapter | en_US |
dc.publicationstatus | Published | en_US |
dc.contributor.department | Özyeğin University | |
dc.contributor.authorID | (ORCID 0000-0002-2677-7366 & YÖK ID 283091) Saldı, Naci | |
dc.contributor.ozuauthor | Saldı, Naci | |
dc.identifier.startpage | 125 | en_US |
dc.identifier.endpage | 149 | en_US |
dc.identifier.wos | WOS:000444697500006 | |
dc.identifier.doi | 10.1007/978-3-319-79033-6_6 | en_US |
dc.identifier.scopus | SCOPUS:2-s2.0-85046999539 | |
dc.contributor.authorMale | 1 | |
dc.relation.publicationcategory | Book Chapter - International - Institutional Academic Staff |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
Share this page