[Artificial Intelligence] {ud954} Lesson 10: 10. Planning under Uncertainty

Robot Tour Guide Examples less

 MDP Grid Worldide

Problems With Conventional Planning ui

For this problem (and only this problem) assume actions are stochastic in a way that is different than described in 4. MDP Gridworld.this

Instead of an action north possibly going east or west, an action north will possibly go northeast or northwest (i.e. to the diagonal squares).ssr

Likewise for the other directions e.g. an action west will possibly go west, northwest or southwest (i.e. to the diagonals).3d

Stochastic actions are as in 4. MDP Grid World.blog

An action North moves North with 80% chance otherwise East with 10% chance or West with 10% chance. Likewise for the other directions.ci

 MDP And Costsget

Value Iterationit

Value Iterations And Policy 

MDP Conclusion 

POMDP 

go south first to read the sign

Readings on Planning under Uncertainty

AIMA: Chapter 17

Further Study

Charles Isbell and Michael Littmann’s ML course:

• Markov Decision Processes
• Reinforcement Learning

Peter Norvig and Sebastian Thrun’s AI course:

• Reinforcement Learning

 http://aima.cs.berkeley.edu/