Training Quadrotor using PPO agent

7 ビュー (過去 30 日間)
Mahmoud Chick Zaouali
Mahmoud Chick Zaouali 2022 年 4 月 27 日
So I am trying to control a quadrotor model using Reinforcement learning. My agent will control my quadrotor and make it navigating to a desired position or following a path. Right now I am trying to train my PPO agent to hover the quadrotor. I built a dynamical model of the quadrotor with 6DOF block. After that I built the observation and reward function of my agent.
I coded the actor critic network and set my parameters.The problem is my reward function is always equals to 0 and my agent is not learning and I am suspuscious that I didn't build the environment correctly. I have been working on my model for long period and couldn't make my agent learn a little. I will really be glad if someone can support me on this issue.
I attached my quadrotor Reinforcement learning model with actor and critic codes.

回答 (1 件)

Emmanouil Tzorakoleftherakis
Emmanouil Tzorakoleftherakis 2022 年 4 月 28 日
編集済み: Emmanouil Tzorakoleftherakis 2022 年 4 月 28 日
Hello,
There are multiple things not set up properly, including:
1) The isdone flag seems to be 1 all the time leading to episodes terminating early, after a single step
2) The reward signal is often not a scalar real number. One reason is that you are trying to calculate the sq root of a negative number
3) Your Simulink model has a lot of algebraic loops - I would get rid of those to make sure they don't interfere with training.
Hope that helps
  1 件のコメント
Unmanned Aerial and Space Systems
Unmanned Aerial and Space Systems 2022 年 5 月 2 日
Hi, like this problem, I shared my model:
https://www.mathworks.com/matlabcentral/answers/1708930-reinforcement-learning-based-quadrotor-control-using-soft-actor-critic-the-reward-is-not-converging?s_tid=prof_contriblnk

サインインしてコメントする。

製品


リリース

R2021a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by