A brief intro to Markov theory
Since all students have not studied Markov theory, and some need a quick reminder, we will spend a little time on introducing basic concepts and review some of the mathematical theory needed later in the course.
Here is a link to the slides used in the first lecture on Markov Chains:
LectureMC.pdf Download LectureMC.pdf
Here is a link to the matlab script Download script I used to demonstrate what happens with the states after a long time.
Here is a link to one of the examples explained in exercise 1: problem_ovn1.pdf Download problem_ovn1.pdf
The first home assignment is an application of Markov theory to reliability theory.