MEMM change the probability function of the transition, so the current state is related to its previous state, and the context information is represented.
Conditional Random Fields (CRF) is arbitrary undirected graphical model that bring together the best of generative models and Maximum Entropy Markov models (MEMM).