Asymptotic optimality of finite models for witsenhausen’s counterexample and beyond
Type :
Book chapter
Publication Status :
Published
Access :
restrictedAccess
Abstract
In this chapter, we study the approximation of Witsenhausen’s counterexample and the Gaussian relay channel problem by using the results of the previous chapter. In particular, our goal is to establish that finite models obtained through the uniform quantization of the observation and action spaces result in a sequence of policies whose costs converge to the value function. We note that the operation of quantization has typically been the method to show that a non-linear policy can perform better than an optimal linear policy, both for Witsenhausen’s counterexample [10, 86] and the Gaussian relay channel problem [88, 152]. Our findings show that for a large class of problems, quantized policies not only may perform better than linear policies, but that they are actually almost optimal.
Source :
Finite Approximations in Discrete-Time Stochastic Control, Part of the Systems & Control: Foundations & Applications book series (SCFA)
Date :
2018
Publisher :
Birkhäuser Basel
Collections
Share this page