Como category seminar: Open Markov chains
A markov chain is a system whose dynamics is encoded in a square matrix of non-negative reals whose row sums are all 1. The rows (and columns) may be thought of as states of a system and the i,j th element of the matrix as the probability of a transition from state i to state j. The k th power of the matrix gives the probabilities of paths of length k.
A markov chain is easily represented also as a labelled graph or automaton:
is that one needs to consider open systems.
Read more »
Labels: Como Category Seminar