OK, let's start this module with quiz, so the quiz is about the same kind of environment, but here 1
we are assuming that the environment is deterministic, which means the probabilities of entering in 2
a particular state stays fixed. 3
So all the probabilities, they stay fixed. 4
Actually, actually, let's make the problem for their simple, the probability that you will end up, 5
for example, in state two one if you are currently in state S1 one and you take an action up, that 6
probability is is actually one. 7
So which means if you are here in this state and you execute an action up, then probability that you 8
will end up in this state, that probability is one. 9
So that means whatever action you want, you take and your expectations, whatever your expectations 10
are, you are actually going there with probability one. 11
So there is no there is no different probability that you will go there or get there. 12
I mean, there is no uncertainty in there. 13
So we will actually land up there based on these kind of actions. 14
So the the environment is deterministic and further the rewards are distributed like I have. 15
I have mentioned here, if you're in this state, you have reward minus one, minus one minus six, 16
minus one, minus one, minus three, minus one minus zero point five 17
And in this stage you have reward minus 10. 18
And in this state you have reward. 19
ten further, if you reach this particular state, which is highlighted as green, the game ends. 20
If you enter in this particular state, the game ends. 21
So the question really is if the agent or you are in state if agent. 22
Is in state 23
S one three, which is this particular state. 24
What 25
Action. 26
The agent. 27
Should take. 28
So your answer will be the agent may take an action left or right or up or down if the agent takes an 29
action left. 30
It definitely goes to the state S one two if the agent takes action, right. 31
It will go to the state S one four if it takes the action up, it will go to state S two three. 32
And if it takes the action down, it will stay in the same state after bumping into the wall. 33
So that's a quiz. 34
Let's see, will you be able to figure out what's the correct or the best action the agent should take? 35
And by the way, these are the rewards for each states, I guess I have already mentioned. 36
Let's see in your next. 37
Let's see you in the next video.