Finite-action approximation of Markov decision processes
dc.contributor.author | Saldı, Naci | |
dc.contributor.author | Linder, T. | |
dc.contributor.author | Yüksel, S. | |
dc.date.accessioned | 2019-01-21T07:17:46Z | |
dc.date.available | 2019-01-21T07:17:46Z | |
dc.date.issued | 2018 | |
dc.identifier.isbn | 978-3-319-79032-9 | en_US |
dc.identifier.issn | 2324-9749 | |
dc.identifier.uri | http://hdl.handle.net/10679/6114 | |
dc.identifier.uri | https://www.springerprofessional.de/en/finite-action-approximation-of-markov-decision-processes/15757284 | |
dc.description.abstract | In this chapter, we study the finite-action approximation of optimal control policies for discrete-time Markov decision processes (MDPs) with Borel state and action spaces, under discounted and average cost criteria. One main motivation for considering this problem stems from the optimal information transmission problem in networked control systems. In many applications of networked control, perfect transmission of the control actions to an actuator is infeasible when there is a communication channel of finite capacity between a controller and an actuator. Hence, the actions of the controller must be discretized (quantized) to facilitate reliable transmission. Although the problem of optimal information transmission from a plant/sensor to a controller has been studied extensively (see, e.g., [148] and references therein), much less is known about the problem of transmitting actions from a controller to an actuator. Such transmission schemes usually require a simple encoding/decoding rule since the actuator does not have the computational capability of the controller to use complex algorithms. For this reason, time-invariant scalar quantization is a practically useful encoding method for controller-actuator communication. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | Birkhäuser Basel | en_US |
dc.relation.ispartof | Finite Approximations in Discrete-Time Stochastic Control Quantized Models and Asymptotic Optimality, Part of the Systems & Control: Foundations & Applications book series (SCFA) | |
dc.rights | restrictedAccess | |
dc.title | Finite-action approximation of Markov decision processes | en_US |
dc.type | Book chapter | en_US |
dc.publicationstatus | Published | en_US |
dc.contributor.department | Özyeğin University | |
dc.contributor.authorID | (ORCID 0000-0002-2677-7366 & YÖK ID 283091) Saldı, Naci | |
dc.contributor.ozuauthor | Saldı, Naci | |
dc.identifier.startpage | 23 | en_US |
dc.identifier.endpage | 48 | en_US |
dc.identifier.wos | WOS:000444697500003 | |
dc.identifier.doi | 10.1007/978-3-319-79033-6_3 | en_US |
dc.identifier.scopus | SCOPUS:2-s2.0-85046998914 | |
dc.contributor.authorMale | 1 | |
dc.relation.publicationcategory | Book Chapter - International - Institutional Academic Staff |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
Share this page