How do I visualize the environment simultaneously with the training of the ddpg agent?

I followed the matlab custom rl template and example . I get the agent running , however I get a blank figure . I have attached the environment file for reference. Can Someone please help me with this?

[Jan de Priester]

Hi,

Consider the following approach: inside the plot function, create a figure and attach it to "this"

function plot(this)

% Initiate the visualization

this.h = figure;

% Update the visualization

envUpdatedCallback(this)

end

Then in the functino envUpdateCallback (at the bottom of your script), define how you want your plot to update with the change in environment. I worked with this toolbox to solve the mountain car problem. Here is the code I created to visualize the environment:

function envUpdatedCallback(this)

% Set the visualization figure as the current figure

figure(this.h);

clf

% Extract the cart position

X = this.State(1);

% Plot the cart

cartpoly = polyshape([0 0 0.0125*3 0.0125*3],[0 0.0125*2 0.0125*2 0]);

cartpoly = translate(cartpoly,[X 1/3*sin(3*X)]);

cartpoly = rotate(cartpoly,rad2deg(cos(3*X)),[X,1/3*sin(3*X)]);

plot(cartpoly,'FaceColor',[0.8500 0.3250 0.0980])

hold on

Z = -1.2:0.001:0.6;

plot(Z,1/3*sin(3*Z))

hold off

xlim([-1.2 0.6])

ylim([-0.4 0.4])

end

Hope this helps

[Emmanouil Tzorakoleftherakis]

+1 on the above

[Prashanth Chivkula]

I tried this, but I am not sure if I am calling the en update function at the wrong stage. I am getting a new figure for each step.