2007-10: Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes
28 Aug
2007
28 Aug
'07
4:27 p.m.
Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes Martin Neuhäußer, Joost-Pieter Katoen AIB 2007-10 This paper introduces strong bisimulation for continuous-time Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL - a stochastic variant of CTL for continuous-time Markov chains - on CTMDPs and show its measure-theoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.
6325
Age (days ago)
6325
Last active (days ago)
0 comments
1 participants
participants (1)
-
Peter Schneider-Kamp