Constrained and Unconstrained Optimal Discounted Control of Piecewise Deterministic Markov Processes
| hal.structure.identifier | Universidade de São Paulo = University of São Paulo [USP] | |
| dc.contributor.author | COSTA, Oswaldo | |
| hal.structure.identifier | Institut Polytechnique de Bordeaux [Bordeaux INP] | |
| hal.structure.identifier | Institut de Mathématiques de Bordeaux [IMB] | |
| hal.structure.identifier | Quality control and dynamic reliability [CQFD] | |
| dc.contributor.author | DUFOUR, François | |
| hal.structure.identifier | Department of Mathematical Sciences [Liverpool] | |
| dc.contributor.author | PIUNOVSKIY, A. B. | |
| dc.date.accessioned | 2024-04-04T03:12:23Z | |
| dc.date.available | 2024-04-04T03:12:23Z | |
| dc.date.issued | 2016 | |
| dc.identifier.issn | 0363-0129 | |
| dc.identifier.uri | https://oskar-bordeaux.fr/handle/20.500.12278/193867 | |
| dc.description.abstractEn | The main goal of this paper is to study the infinite-horizon expected discounted continuous-time optimal control problem of piecewise deterministic Markov processes with the control acting continuously on the jump intensity $\lambda$ and on the transition measure $Q$ of the process but not on the deterministic flow $\phi$. The contributions of the paper are for the unconstrained as well as the constrained cases. The set of admissible control strategies is assumed to be formed by policies, possibly randomized and depending on the history of the process, taking values in a set valued action space. For the unconstrained case we provide sufficient conditions based on the three local characteristics of the process $\phi$, $\lambda$, $Q$ and the semicontinuity properties of the set valued action space, to guarantee the existence and uniqueness of the integro-differential optimality equation (the so-called Bellman--Hamilton--Jacobi equation) as well as the existence of an optimal (and $\delta$-optimal, as well) deterministic stationary control strategy for the problem. For the constrained case we show that the values of the constrained control problem and an associated infinite dimensional linear programming (LP) problem are the same, and moreover we provide sufficient conditions for the solvability of the LP problem as well as for the existence of an optimal feasible randomized stationary control strategy for the constrained problem. | |
| dc.language.iso | en | |
| dc.publisher | Society for Industrial and Applied Mathematics | |
| dc.title.en | Constrained and Unconstrained Optimal Discounted Control of Piecewise Deterministic Markov Processes | |
| dc.type | Article de revue | |
| dc.identifier.doi | 10.1137/140996380 | |
| dc.subject.hal | Mathématiques [math]/Optimisation et contrôle [math.OC] | |
| bordeaux.journal | SIAM Journal on Control and Optimization | |
| bordeaux.page | 1444 - 1474 | |
| bordeaux.volume | 54 | |
| bordeaux.hal.laboratories | Institut de Mathématiques de Bordeaux (IMB) - UMR 5251 | * |
| bordeaux.issue | 3 | |
| bordeaux.institution | Université de Bordeaux | |
| bordeaux.institution | Bordeaux INP | |
| bordeaux.institution | CNRS | |
| bordeaux.peerReviewed | oui | |
| hal.identifier | hal-01412604 | |
| hal.version | 1 | |
| hal.popular | non | |
| hal.audience | Internationale | |
| hal.origin.link | https://hal.archives-ouvertes.fr//hal-01412604v1 | |
| bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=SIAM%20Journal%20on%20Control%20and%20Optimization&rft.date=2016&rft.volume=54&rft.issue=3&rft.spage=1444%20-%201474&rft.epage=1444%20-%201474&rft.eissn=0363-0129&rft.issn=0363-0129&rft.au=COSTA,%20Oswaldo&DUFOUR,%20Fran%C3%A7ois&PIUNOVSKIY,%20A.%20B.&rft.genre=article |
Files in this item
| Files | Size | Format | View |
|---|---|---|---|
|
There are no files associated with this item. |
|||