A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes
| hal.structure.identifier | Departamento de Engenharia de Telecomunicações e Controle [São Paulo] | |
| dc.contributor.author | COSTA, Oswaldo | |
| hal.structure.identifier | Institut de Mathématiques de Bordeaux [IMB] | |
| hal.structure.identifier | Quality control and dynamic reliability [CQFD] | |
| dc.contributor.author | DUFOUR, François | |
| dc.date.accessioned | 2024-04-04T03:16:41Z | |
| dc.date.available | 2024-04-04T03:16:41Z | |
| dc.date.issued | 2015-04 | |
| dc.identifier.issn | 0022-247X | |
| dc.identifier.uri | https://oskar-bordeaux.fr/handle/20.500.12278/194239 | |
| dc.description.abstractEn | This paper deals with the constrained discounted control of piecewise deterministic Markov process (PDMPs) in general Borel spaces. The control variable acts on the jump rate and transition measure, and the goal is to minimize the total expected discounted cost, composed of positive running and boundary costs, while satisfying some constraints also in this form. The basic idea is, by using the special features of the PDMPs, to re-write the problem via an embedded discrete-time Markov chain associated to the PDMP and re-formulate the problem as an infinite dimensional linear programming (LP) problem, via the occupation measures associated to the discrete-time process. It is important to stress however that our new discrete-time problem is not in the same framework of a general constrained discrete-time Markov Decision Process and, due to that, some conditions are required to get the equivalence between the continuous-time problem and the LP formulation. We provide in the sequel sufficient conditions for the solvability of the associated LP problem, based on a generalization of Theorem 4.1 in [8]. In Appendix A we present the proof of this generalization which, we believe, is of interest on its own. The paper is concluded with some examples to illustrate the obtained results. | |
| dc.language.iso | en | |
| dc.publisher | Elsevier | |
| dc.title.en | A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes | |
| dc.type | Article de revue | |
| dc.identifier.doi | 10.1016/j.jmaa.2014.11.036 | |
| dc.subject.hal | Mathématiques [math]/Optimisation et contrôle [math.OC] | |
| bordeaux.journal | Journal of Mathematical Analysis and Applications | |
| bordeaux.page | 892–914 | |
| bordeaux.volume | 424 | |
| bordeaux.hal.laboratories | Institut de Mathématiques de Bordeaux (IMB) - UMR 5251 | * |
| bordeaux.issue | 2 | |
| bordeaux.institution | Université de Bordeaux | |
| bordeaux.institution | Bordeaux INP | |
| bordeaux.institution | CNRS | |
| bordeaux.peerReviewed | oui | |
| hal.identifier | hal-01246215 | |
| hal.version | 1 | |
| hal.popular | non | |
| hal.audience | Internationale | |
| hal.origin.link | https://hal.archives-ouvertes.fr//hal-01246215v1 | |
| bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=Journal%20of%20Mathematical%20Analysis%20and%20Applications&rft.date=2015-04&rft.volume=424&rft.issue=2&rft.spage=892%E2%80%93914&rft.epage=892%E2%80%93914&rft.eissn=0022-247X&rft.issn=0022-247X&rft.au=COSTA,%20Oswaldo&DUFOUR,%20Fran%C3%A7ois&rft.genre=article |
Fichier(s) constituant ce document
| Fichiers | Taille | Format | Vue |
|---|---|---|---|
|
Il n'y a pas de fichiers associés à ce document. |
|||