Show simple item record

dc.contributor.authorSaldı, Naci
dc.contributor.authorLinder, T.
dc.contributor.authorYüksel, S.
dc.date.accessioned2019-01-21T07:17:46Z
dc.date.available2019-01-21T07:17:46Z
dc.date.issued2018
dc.identifier.isbn978-3-319-79032-9en_US
dc.identifier.issn2324-9749
dc.identifier.urihttp://hdl.handle.net/10679/6114
dc.identifier.urihttps://www.springerprofessional.de/en/finite-action-approximation-of-markov-decision-processes/15757284
dc.description.abstractIn this chapter, we study the finite-action approximation of optimal control policies for discrete-time Markov decision processes (MDPs) with Borel state and action spaces, under discounted and average cost criteria. One main motivation for considering this problem stems from the optimal information transmission problem in networked control systems. In many applications of networked control, perfect transmission of the control actions to an actuator is infeasible when there is a communication channel of finite capacity between a controller and an actuator. Hence, the actions of the controller must be discretized (quantized) to facilitate reliable transmission. Although the problem of optimal information transmission from a plant/sensor to a controller has been studied extensively (see, e.g., [148] and references therein), much less is known about the problem of transmitting actions from a controller to an actuator. Such transmission schemes usually require a simple encoding/decoding rule since the actuator does not have the computational capability of the controller to use complex algorithms. For this reason, time-invariant scalar quantization is a practically useful encoding method for controller-actuator communication.en_US
dc.language.isoengen_US
dc.publisherBirkhäuser Baselen_US
dc.relation.ispartofFinite Approximations in Discrete-Time Stochastic Control Quantized Models and Asymptotic Optimality, Part of the Systems & Control: Foundations & Applications book series (SCFA)
dc.rightsrestrictedAccess
dc.titleFinite-action approximation of Markov decision processesen_US
dc.typeBook chapteren_US
dc.publicationstatusPublisheden_US
dc.contributor.departmentÖzyeğin University
dc.contributor.authorID(ORCID 0000-0002-2677-7366 & YÖK ID 283091) Saldı, Naci
dc.contributor.ozuauthorSaldı, Naci
dc.identifier.startpage23en_US
dc.identifier.endpage48en_US
dc.identifier.wosWOS:000444697500003
dc.identifier.doi10.1007/978-3-319-79033-6_3en_US
dc.identifier.scopusSCOPUS:2-s2.0-85046998914
dc.contributor.authorMale1
dc.relation.publicationcategoryBook Chapter - International - Institutional Academic Staff


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record


Share this page