Using DrivingScenarioDesigner for 3D view with visualizations of different categories (Pedestrians, Bicyclists, Barriers, etc.)

Hi,

I am using Driving Scenario Designer App to create Automated Driving Scenarios. There are options in the App, to include multiple object Actor classes (Pedestrians, Bicyclists, Barriers, in addition to the Trucks and Cars), to configure the 3D visualization settings (to select whether the vehicle to be Sedan/Hatchback.., to select Pedestrian to be male/female etc.)

Attached is a sample scene created using the App. When I try to visualize the same using the provided option for 3D Display, this opens the AutoVrtlEnv application to show the 3D view of the respective objects. (Even the road and lane markings as per the settings).

But, when I try to use the scene data using the ScenarioReader block under AutomatedDrivingToolbox, the Scenario Reader provides only the options to access the Actors and Lane markings.

There is no option to include the scene as is, as the Simulation 3D Scene Configuration block uses a predefined set of scenes only.

Because of this, the actors which were created for the DrivingScenarioDesigner App scene are getting misplaced in the default scenes (Since scene loading is not happening).

Also, the visualization for the Actors are limited only to vehicles though we are able to develop multiple other classes (Pedestrians, Bicylcists, Barriers) in the Driving Scenario App.

Becasue of this, even my Pedestrian or Bicyclists are getting visualized as Vehicles.

Since the option to visualize proper classes are already available (similar to the 2nd picture above), is it possible to use a script to call the AutoVrtlEnv application and load the respective 3D classes dynamically instead of using the standard blockset.?

Thanks.

[xingxing tu]

Hi Manoj Kumar Subramanian,

Do you have any solution abut this problem now?

Best regards

[Xiaolan Guo]

Hi Manoj Kumar Subramanian,

Have you solved this proplem?

Thanks.

[Manoj Kumar Subramanian]

There is an indirect method, to use the Unreal executable to create a number of objects(pedestrians, cyclists, etc.), tag their names in unreal, build and use the executable in the simulink. Use the tag names defined in unreal, to dynamically update from simulink based on the objects created from scenario designer.

However, I cannot find a way to use the road profiles created on the designer to be used in the scenario. I was able to use only the predefined scenes with already existing roads.

[Xiaolan Guo]

Thanks for your answer. I'm still confused about how to dynamiclly update pedestrain from simulink. Still use the "Simulation 3D vehicle with Ground Following" block?

[Xiaolan Guo]

Hi, Manoj Kumar Subramanian,

I've been confused by this question for a long time, how to update those objects which are defined in unreal engine?

By the way, can you simulate collision in matlab 3D block? cuz I found those vehicles just overlaps and cross each others.

Thank you.

Answer 1

[Bharath Bandari]

Hi @Manoj Kumar Subramanian, The 3D Display option is only to visualize the cuboid simulations in 3D view.

Follow below steps to cosimulate a scene created in DrivingScenearioDesigner in Unreal Engine

1. export the scenario to OpenDRIVE format https://www.mathworks.com/help/driving/ug/export-driving-scenario-to-opendrive-file.html
2. import the OpenDRIVE file into RoadRunner, https://www.mathworks.com/videos/importing-and-exporting-scenes-with-roadrunner-1597837006663.html
3. Build and export the scene into .fbx file to import into Unreal Engine - you can watch it from 5:00 min https://www.mathworks.com/videos/integrating-roadrunner-with-matlab-simulink-1608193412399.html

[Desirae]

I am using the video you posted in your step 3 to import a RoadRunner scene I made into Unreal Engine using Simulink. The video was made using Unreal Engine 4.27, but the current version of Unreal is 5.3. When I try to follow the instructions in your step 3 video, I get errors when I try to open the Unreal project from MATLAB (video time is 3:50 min). Instead of getting a pop up asking to rebuild the missing modules, I get a series of errors that always results in Unreal crashing and never loading properly (see below).

I tried to find the missing "PhysXVehicles" plugin, but it is no longer available in Unreal Engine, so I cannot figure out how to import my RoadRunner scene into Unreal Engine v5.3 using Simulink. Do you have any suggestions please? I would greatly appreciate the help.