Model Based Reinforcement Learning

11 ビュー (過去 30 日間)
Rafael Basso
Rafael Basso 2019 年 9 月 10 日
編集済み: Jillian Eunice Oliveros 2021 年 10 月 26 日
I'm trying to implement model based reinforcement learning with matlab. I have a directed graph and i want to travel from origin to destination. Using the function createMDP would be possible to create a very simple graph. The main problem is because the actions are generic. What i would like to do is to allow only a subset of actions depending on the current state. A solution is to implement a good reward function to penalize undesired/invalid actions, but that means a lot more training. So i'd like to speed up the learning by only allowing specific actions depending on the current state. Is it possible to do that?

回答 (1 件)

Neuropragmatist 2019 年 9 月 10 日
Your agent shouldn't be able to make 'invalid' actions at all. For undesired actions, as you say the correct reward function with time should lead to the correct learning and this unconstrained approach would certianly be the most convincing.
You can of course restrict the actions of the agent in specific circumstances, but I think you would have to have good reason to implement those and be able to show that you are not just initialising your model with the parameters you expect at the end.
Hope this helps,
  1 件のコメント
Jillian Eunice Oliveros
Jillian Eunice Oliveros 2021 年 10 月 25 日
@Neuropragmatist Using createMDP, Is it possible to add certain conditions (if else) as to what state the agent will have to transition into? For example, when the pixel intensity is more than 10, the transition will be to state 2. And if not, it will transition to state 3.


Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by