For an overview of the Markov chain analysis tools, see Markov Chain Modeling.
Markov chains are discrete-state Markov processes described by a right-stochastic transition matrix and represented by a directed graph.
dtmc class provides basic tools for modeling and analysis
of discrete-time Markov chains. The class supports chains with a finite number
of states that evolve in discrete time with a time-homogeneous transition
Create a Markov chain model object from a state transition matrix of probabilities or observed counts, and create a random Markov chain with a specified structure.
Visualize the structure and evolution of a Markov chain model by using
dtmc plotting functions.
Compute the stationary distribution of a Markov chain, estimate its mixing time, and determine whether the chain is ergodic and reducible.
Compare the estimated mixing times of several Markov chains with different structures.
Programmatically and visually identify classes in a Markov chain.
Generate and visualize random walks through a Markov chain.
Compute and visualize state redistributions, which show the evolution of the deterministic state distributions over time from an initial distribution.