Testing probabilistic equivalence through reinforcement learning

Josée Desharnais, François Laviolette, Sami Zhioua

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We propose a new approach to verification of probabilistic processes for which the model may not be available. We use a technique from Reinforcement Learning to approximate how far apart two processes are by solving a Markov Decision Process. If two processes are equivalent, the algorithm will return zero, otherwise it will provide a number and a test that witness the non equivalence. We suggest a new family of equivalences, called K-moment, for which it is possible to do so. The weakest, 1-moment equivalence, is trace-equivalence. The others are weaker than bisimulation but stronger than trace-equivalence.

Original languageEnglish
Title of host publicationFSTTCS 2006
Subtitle of host publicationFoundations of Software Technology and Theoretical Computer Science - 26th International Conference, Proceedings
Editors[initials] N. Arun-Kumar
PublisherSpringer Verlag
Pages236-247
Number of pages12
ISBN (Print)9783540499947
DOIs
Publication statusPublished - 1 Jan 2006
Externally publishedYes
Event26th International Conference on Foundations of Software Technology and Theoretical Computer Science, FSTTCS 2006 - Kolkata, India
Duration: 13 Dec 200615 Dec 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4337 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference26th International Conference on Foundations of Software Technology and Theoretical Computer Science, FSTTCS 2006
Country/TerritoryIndia
CityKolkata
Period13/12/0615/12/06

Fingerprint

Dive into the research topics of 'Testing probabilistic equivalence through reinforcement learning'. Together they form a unique fingerprint.

Cite this