The hidden states are and the observed variables are . The transition probabilities are that of a Markov chain, and the observation probabilities are