<:> Markov sequence models

• Sample sequence: a b b b c a d d a b
• 0th order Markov model.

  p(a) = 0.3
  p(b) = 0.4
  p(c) = 0.1
  p(d) = 0.2

• 1st order Markov model

  p(a|a) = 0.0           p(c|a) = 0.0
  p(a|b) = 0.0           p(c|b) = 1.0
  p(a|c) = 1.0           p(c|c) = 0.0
  p(a|d) = 0.5           p(c|d) = 0.0
  p(b|a) = 0.5           p(d|a) = 0.3
  p(b|b) = 0.5           p(d|b) = 0.0
  p(b|c) = 0.0           p(d|c) = 0.0
  p(b|d) = 0.0           p(d|d) = 0.5