21828 articles – 15613 references  [version française]
HAL: hal-00447075, version 1

Detailed view  Export this paper
Lecture notes in control and information sciences 341 (2006) 153-160
Positive invariance of polyhedrons and comparison of Markov reward models with different state spaces
Mourad Ahmane 1, James Ledoux 2, Laurent Truffet 3
(2006)

In this paper, we discuss the comparison of expected rewards for discrete-time reward Markov chains with different state spaces. Necessary and sufficient conditions for such a comparison are derived. Due to the special nature of the introduced binary relation, a criterion may be formulated in terms of an inclusion of polyhedral sets. Then, algebraic and geometric forms are easily obtained from Haar's Lemma. Our results allow us to discuss some earlier results on the stochastic comparison of functions of Markov chains.
1:  Institut de Recherche en Communications et en Cybernétique de Nantes (IRCCyN)
CNRS : UMR6597 – PRES Université Nantes Angers Le Mans [UNAM] – École Centrale de Nantes – École Nationale Supérieure des Mines - Nantes – Ecole Polytechnique de l'Université de Nantes
2:  Institut de Recherche Mathématique de Rennes (IRMAR)
CNRS : UMR6625 – Université de Rennes 1 – École normale supérieure de Cachan - ENS Cachan – Institut National des Sciences Appliquées (INSA) : - RENNES – Université de Rennes II - Haute Bretagne
3:  École nationale supérieure des Mines de Nantes
École Nationale Supérieure des Mines - Nantes – Groupe des Écoles des Mines (GEM)
Mathematics/Probability