OK, welcome back to another quiz here we have stochastic environment and again, the same kind of problem 1
set up the probabilities that if you move up, if the agent decides to move up, there is 80 percent 2
chance that it actually moves up and so takes. 3
Requires that required action. 4
Take the required action. 5
Or land in the quiet state and 20 percent chance that it actually takes. 6
Action. 7
At right angle. 8
And in these 20 percent, there is equal probability of going into either either direction of the right 9
angle. 10
So, for example, if the agent is sitting here, if the agent decides to go up, if agent execute 11
an action up 80 percent, chances are point eight probability is that it goes there and 20 percent chance 12
is that it goes either here or here. 13
So in these 20 percent, 10 percent chance that it goes here, 10 percent chance that it goes here. 14
But once it goes here, it bumps into the wall and go back here. 15
The rewards are everywhere. 16
The rewards are plus two. 17
And in this particular state, the reward is minus one. 18
And in this state, the reward is plus one. 19
Everywhere else, the reward is two so and again, the rules are the same. 20
If you enter into this state, let me know if you enter into this particular state, the game is over. 21
If you enter into this particular state, the game is over. 22
Otherwise, you can keep on moving. 23
Now, my question is. 24
What is? 25
The policy. 26
That the agent. 27
Should follow. 28
To maximize. 29
Delayed reward or the future reward? 30
Or the total reward in future or whatever total reward that it can collect or stuff like so. 31
What's your answer, by the way, you can write your policies like the arrows, you can write your policies 32
like these arrows, for example. 33
For example, you can write this arrow there, for example, you're moving, right, you can write an 34
arrow here if you're moving up and so on. 35
So what's your answer? 36
Let's see you in the next video.