Numerical method for optimal stopping of piecewise deterministic Markov processes
DE SAPORTA, Benoîte
Groupe de Recherche en Economie Théorique et Appliquée [GREThA]
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
Groupe de Recherche en Economie Théorique et Appliquée [GREThA]
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
DUFOUR, François
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
GONZALEZ, Karen
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
DE SAPORTA, Benoîte
Groupe de Recherche en Economie Théorique et Appliquée [GREThA]
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
Groupe de Recherche en Economie Théorique et Appliquée [GREThA]
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
DUFOUR, François
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
GONZALEZ, Karen
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
< Reduce
Institut de Mathématiques de Bordeaux [IMB]
Quality control and dynamic reliability [CQFD]
Language
en
Communication dans un congrès
This item was published in
OPTIMAL STOPPING WITH APPLICATIONS, 2009-06, Turku.
English Abstract
The aim of this paper is to propose a computational method for optimal stopping of a piecewise deterministic Markov process by using a quantization technique for an underlying discrete-time Markov chain related to the ...Read more >
The aim of this paper is to propose a computational method for optimal stopping of a piecewise deterministic Markov process by using a quantization technique for an underlying discrete-time Markov chain related to the continuous-time process and path-adapted time discretization grids. Piecewise-deterministic Markov processes (PDMP's) have been introduced in the literature by M.H.A. Davis \cite{davis93} as a general class of stochastic models covering a great number of problems of operations research. PDMP's are a family of Markov processes involving deterministic motion punctuated by random jumps. It was shown in \cite{gugerli86} that the value function of the optimal stopping problem can be calculated by iterating a functional operator which involves a continuous-time maximization and a discrete-time dynamic programming formula. To approximate the value function of the optimal stopping problem of a PDMP, a natural approach would have been to follow the same lines as in \cite{bally03} for diffusion processes, unfortunately their method cannot be directly applied here. However, by using the special structure of PDMP's, we are able to propose an approximation scheme for the value function and derive a rate of convergence. In addition and more importantly, this numerical approximation scheme enables us to propose, without any additional calculations, a computable stopping rule which also is an $\epsilon$-optimal stopping time of the original problem, and we can characterize how far it is from optimal in terms of the value function.Read less <
Origin
Hal imported