Name: 
 

Ch18 Markov Processes



Multiple Choice
Identify the choice that best completes the statement or answers the question.
 

 1. 

In Markov analysis, we are concerned with the probability that the
a.
state is part of a system.
b.
system is in a particular state at a given time.
c.
time has reached a steady state.
d.
transition will occur.
 

 2. 

For a situation with weekly dining at either an Italian or Mexican restaurant,
a.
the weekly visit is the trial and the restaurant is the state.
b.
the weekly visit is the state and the restaurant is the trial.
c.
the weekly visit is the trend and the restaurant is the transition.
d.
the weekly visit is the transition and the restaurant is the trend.
 

 3. 

A transition probability describes
a.
the probability of a success in repeated, independent trials.
b.
the probability a system in a particular state now will be in a specific state next period.
c.
the probability of reaching an absorbing state.
d.
None of the alternatives is correct.
 

 4. 

The probability of going from state 1 in period 2 to state 4 in period 3 is
a.
p12
b.
p23
c.
p14
d.
p43
 

 5. 

The probability that a system is in a particular state after a large number of periods is
a.
independent of the beginning state of the system.
b.
dependent on the beginning state of the system.
c.
equal to one half.
d.
the same for every ending system.
 

 6. 

At steady state
a.
p1(n+1) > p1(n)
b.
p1 = p2
c.
p1 + p2 ³ 1
d.
p1(n+1) = p1
 

 7. 

Analysis of a Markov process
a.
describes future behavior of the system.
b.
optimizes the system.
c.
leads to higher order decision making.
d.
All of the alternatives are true.
 

 8. 

If the probability of making a transition from a state is 0, then that state is called a(n)
a.
steady state.
b.
final state.
c.
origin state.
d.
absorbing state.
 

 9. 

Absorbing state probabilities are the same as
a.
steady state probabilities.
b.
transition probabilities.
c.
fundamental probabilities.
d.
None of the alternatives is true.
 

 10. 

The probability of reaching an absorbing state is given by the
a.
R matrix.
b.
NR matrix.
c.
Q matrix.
d.
(I - Q)-1 matrix
 



 
Check Your Work     Start Over