Nothing Special   »   [go: up one dir, main page]

skip to main content
article

Bisimulation and cocongruence for probabilistic systems

Published: 01 April 2006 Publication History

Abstract

We introduce a new notion of bisimulation, called event bisimulation on labelled Markov processes (LMPs) and compare it with the, now standard, notion of probabilistic bisimulation, originally due to Larsen and Skou. Event bisimulation uses a sub @s-algebra as the basic carrier of information rather than an equivalence relation. The resulting notion is thus based on measurable subsets rather than on points: hence the name. Event bisimulation applies smoothly for general measure spaces; bisimulation, on the other hand, is known only to work satisfactorily for analytic spaces. We prove the logical characterization theorem for event bisimulation without having to invoke any of the subtle aspects of analytic spaces that feature prominently in the corresponding proof for ordinary bisimulation. These complexities only arise when we show that on analytic spaces the two concepts coincide. We show that the concept of event bisimulation arises naturally from taking the co-congruence point of view for probabilistic systems. We show that the theory can be given a pleasing categorical treatment in line with general coalgebraic principles. As an easy application of these ideas we develop a notion of ''almost sure'' bisimulation; the theory comes almost ''for free'' once we modify Giry's monad appropriately.

References

[1]
Bartels, F., Sokolova, A. and de Vink, E.P., A hierarchy of probabilistic system types. Theoret. Comput. Sci. v327. 3-22.
[2]
R. Blute, J. Desharnais, A. Edalat, P. Panangaden, Bisimulation for labelled Markov processes, in: Proceedings of the Twelfth IEEE Symposium on Logic in Computer Science, Warsaw, Poland, 1997.
[3]
V. Danos, J. Desharnais, Labeled Markov processes: stronger and faster approximations, in: Proceedings of the 18th Symposium on Logic in Computer Science, Ottawa, IEEE, 2003.
[4]
E. de Vink, J.J.M.M. Rutten, Bisimulation for probabilistic transition systems: a coalgebraic approach, in: Proceedings of the 24th International Colloquium on Automata Languages and Programming, 1997.
[5]
de Vink, E. and Rutten, J.J.M.M., Bisimulation for probabilistic transition systems: a coalgebraic approach. Theoret. Comput. Sci. v221 i1/2. 271-293.
[6]
Desharnais, J., Edalat, A. and Panangaden, P., A logical characterization of bisimulation for labelled Markov processes. In: Proceedings of the 13th IEEE Symposium on Logic in Computer Science, IEEE Press, Indianapolis. pp. 478-489.
[7]
Desharnais, J., Edalat, A. and Panangaden, P., Bisimulation for labeled Markov processes. Inform. Comput. v179 i2. 163-193.
[8]
Desharnais, J., Gupta, V., Jagadeesan, R. and Panangaden, P., Metrics for labeled Markov systems. In: Lecture Notes in Computer Science, vol. 1664. Springer-Verlag, Berlin.
[9]
Desharnais, J., Gupta, V., Jagadeesan, R. and Panangaden, P., Approximation of labeled Markov processes. In: Proceedings of the Fifteenth Annual IEEE Symposium on Logic in Computer Science, IEEE Computer Society Press, Silver Spring, MD. pp. 95-106.
[10]
J. Desharnais, V. Gupta, R. Jagadeesan, P. Panangaden, The metric analogue of weak bisimulation for labelled Markov processes, in: Proceedings of the Seventeenth Annual IEEE Symposium on Logic in Computer Science, 2002, pp. 413-422.
[11]
Desharnais, J., Gupta, V., Jagadeesan, R. and Panangaden, P., Approximating labeled Markov processes. Inform. Comput. v184 i1. 160-200.
[12]
Desharnais, J., Gupta, V., Jagadeesan, R. and Panangaden, P., A metric for labelled Markov processes. Theoret. Comput. Sci. v318 i3. 323-354.
[13]
Desharnais, J. and Panangaden, P., Continuous stochastic logic characterizes bisimulation for continuous-time Markov processes. J. Logic Algebraic Programming. v56. 99-115.
[14]
Doberkat, E.-E., Semi-pullbacks and bisimulations in categories of stochastic relations. In: Baeten, J.C.M., Lenstra, J.K., Parrow, J., Woeinger, G.J. (Eds.), Lecture Notes in Computer Science, vol. 2719. Springer-Verlag, Berlin. pp. 996-1007.
[15]
Edalat, A., Semi-pullbacks and bisimulation in categories of Markov processes. Math. Struct. Comput. Sci. v9 i5. 523-543.
[16]
Giry, M., A categorical approach to probability theory. In: Banaschewski, B. (Ed.), Lecture Notes in Mathematics, vol. 915. Springer-Verlag, Berlin. pp. 68-85.
[17]
Kemeny, J.G. and Snell, J.L., Finite Markov Chains. 1960. Van Nostrand, New York.
[18]
Larsen, K.G. and Skou, A., Bisimulation through probabilistic testing. Inform. Comput. v94. 1-28.
[19]
P. Panangaden, The category of Markov processes, ENTCS 22 (1999) 17. <http://www.elsevier.nl/locate/entcs/volume22.html/>.
[20]
Puterman, Martin L., Markov Decision Processes: Discrete Stochastic Dynamic Programming. 1994. Wiley, New York.
[21]
van Breugel, Franck and Worrell, James, An algorithm for quantitative verification of probabilistic systems. In: Larsen, K.G., Nielsen, M. (Eds.), Lecture Notes In Computer Science, vol. 2514. Springer-Verlag, Berlin. pp. 336-350.
[22]
van Breugel, Franck and Worrell, James, Towards quantitative verification of probabilistic systems. In: Proceedings of the Twenty-eighth International Colloquium on Automata, Languages and Programming, Springer-Verlag, Berlin.
[23]
Williams, David, Probability with Martingales. 1991. CUP, Cambridge.

Cited By

View all
  • (2017)Unrestricted stone duality for Markov processesProceedings of the 32nd Annual ACM/IEEE Symposium on Logic in Computer Science10.5555/3329995.3330087(1-9)Online publication date: 20-Jun-2017
  • (2016)Symbolic computation of differential equivalencesACM SIGPLAN Notices10.1145/2914770.283764951:1(137-150)Online publication date: 11-Jan-2016
  • (2016)Symbolic computation of differential equivalencesProceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages10.1145/2837614.2837649(137-150)Online publication date: 11-Jan-2016
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Information and Computation
Information and Computation  Volume 204, Issue 4
Special issue: Seventh workshop on coalgebraic methods in computer science 2004
April 2006
246 pages

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 April 2006

Author Tags

  1. Coalgebras
  2. Cocongruence
  3. Labelled Markov processes
  4. Probabilistic bisimulation
  5. Probabilistic processes

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2017)Unrestricted stone duality for Markov processesProceedings of the 32nd Annual ACM/IEEE Symposium on Logic in Computer Science10.5555/3329995.3330087(1-9)Online publication date: 20-Jun-2017
  • (2016)Symbolic computation of differential equivalencesACM SIGPLAN Notices10.1145/2914770.283764951:1(137-150)Online publication date: 11-Jan-2016
  • (2016)Symbolic computation of differential equivalencesProceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages10.1145/2837614.2837649(137-150)Online publication date: 11-Jan-2016
  • (2016)Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming LanguagesundefinedOnline publication date: 11-Jan-2016
  • (2015)Probabilistic bisimulationACM SIGLOG News10.1145/2815493.28155012:3(72-84)Online publication date: 17-Aug-2015
  • (2015)Structural operational semantics for continuous state stochastic transition systemsJournal of Computer and System Sciences10.1016/j.jcss.2014.12.00381:5(834-858)Online publication date: 1-Aug-2015
  • (2015)Open Maps in Concrete Categories and Branching Bisimulation for Prefix OrdersElectronic Notes in Theoretical Computer Science (ENTCS)10.1016/j.entcs.2015.12.005319:C(51-66)Online publication date: 21-Dec-2015
  • (2014)The Measurable Space of Stochastic ProcessesFundamenta Informaticae10.5555/2608491.2608497131:3-4(351-371)Online publication date: 1-Jul-2014
  • (2014)Approximating Markov Processes by AveragingJournal of the ACM10.1145/253794861:1(1-45)Online publication date: 1-Jan-2014
  • (2013)Stone Duality for Markov ProcessesProceedings of the 2013 28th Annual ACM/IEEE Symposium on Logic in Computer Science10.1109/LICS.2013.38(321-330)Online publication date: 25-Jun-2013
  • Show More Cited By

View Options

View options

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media