Example image of eyePlorer eyePlorer map for 'Markov chain': Andrey Markov Mathematics Stochastic process Markov property Number line Random walk Random variable Countable set Directed graph Continuous-time Markov process Additive Markov chain Finite-state machine Independent and identically-distributed random variables Chapman–Kolmogorov equation Marginal distribution Exponentiation Index Greatest common divisor Periodic function If and only if Expected value Ergodic theory Invariant measure Element (mathematics) Finite set Matrix (mathematics) Stochastic matrix Homogeneous function Perron–Frobenius theorem Identity matrix Zero matrix Detailed balance Bayes' theorem Bernoulli scheme Bernoulli process Harris chain Statistical mechanics Thermodynamics Queueing theory Statistics A Mathematical Theory of Communication Claude Shannon Entropy (information theory) Information theory Arithmetic coding Data compression Entropy encoding Pattern recognition State observer Bioinformatics