Unreal Engine Scenario Simulation
Simulate UAVs in pregenerated and customized 3D scenes, and generate simulated high-fidelity sensor readings (requires Simulink® 3D Animation™) using the Unreal Engine® from Epic Games®. This environment is available in Simulink and runs on Windows® and Linux® only. To learn more, see Unreal Engine Simulation for Unmanned Aerial Vehicles.
As an alternative, UAV Toolbox also provides a cuboid environment that enables you to rapidly author scenarios and generate low-fidelity sensor data. For more information, visit Cuboid Scenario Simulation.
Objects
sim3d.Editor | Interface to the Unreal Engine project |
sim3d.maps.Map | Access additional scenes from the server (Since R2022b) |
sim3d.environment.GeospatialConfiguration | Create 3D environment in Unreal Engine (Since R2024b) |
Functions
copyExampleSim3dProject | Copy support package files and plugins to specified folders (Since R2022b) |
Blocks
| Simulation 3D UAV Vehicle | Place UAV vehicle in 3D visualization |
| Simulation 3D Custom UAV Pack | Translation and rotation input for custom UAV (Since R2026a) |
| Simulation 3D Scene Configuration | Scene configuration for 3D simulation environment |
| Simulation 3D Camera | Camera sensor model with lens in 3D simulation environment |
| Simulation 3D Fisheye Camera | Fisheye camera sensor model in 3D simulation environment |
| Simulation 3D Lidar | Lidar sensor model in 3D simulation environment |
| Simulation 3D Ultrasonic Sensor | Ultrasonic sensor model in 3D simulation environment (Since R2023a) |
| Video Send | Send video stream to remote hardware (Since R2021b) |
Scenes
| Suburban scene | Suburban Unreal Engine environment |
| US City Block | US city block Unreal Engine environment |
| Blank Scene | Blank scene |
| Empty Scene | Empty world |
Vehicles
Topics
Simulation Basics
- Unreal Engine Simulation for Unmanned Aerial Vehicles
Learn how to use unmanned aerial vehicle algorithms in Simulink, and visualize their performance in a virtual environment using the Unreal Engine from Epic Games. - Unreal Engine Simulation Environment Requirements and Limitations
When simulating in the Unreal Engine environment, keep these software requirements, minimum hardware requirements, and limitations in mind. - How Unreal Engine Simulation for UAVs Works
Learn about the cosimulation framework between Simulink and the Unreal Engine and how block execution order affects simulation. - 3D Scenes for Simulation in Unreal Engine Environment
Install 3D scenes for simulation in Unreal Engine environment. - Coordinate Systems for Unreal Engine Simulation in UAV Toolbox
World and vehicle coordinate systems used when simulating in the Unreal Engine environment. - Interact with 3D Simulation Environment
Interact with the 3D simulation environment and actors using the Simulation 3D Viewer interface. - Navigate in Unreal Engine Environment
Control the view of the 3D environment in the Simulation 3D Viewer using keyboard shortcuts and pointer controls. - Visualize with Cesium
Stream 3D map and terrain data of a location.
Simulation with Sensors
- Choose a Sensor for Unreal Engine Simulation
Decide which camera or lidar sensors to use during 3D simulation with the Unreal Engine. - Stream Camera, Depth and Semantic Segmentation Data from Unreal Engine to NVIDIA Jetson
Stream simulated camera, depth, and semantic segmentation label data from an Unreal Engine scene to NVIDIA® Jetson™ hardware using the Video Send block in Simulink.
Scene Customization
- Customize Unreal Engine Scenes for UAVs
Customize Unreal Engine scenes for UAV flight applications.
- Apply Semantic Segmentation Labels to Custom Scenes
Apply labels to objects in a scene so that you can obtain semantic segmentation data from a camera sensor. - Prepare Custom UAV Vehicle Mesh for Unreal Engine Scenario Simulation
Configure custom UAV vehicle mesh for Unreal Engine scenario simulation.
Semantic Segmentation
- Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation
This example shows how to visualize depth and semantic segmentation data captured from a camera sensor in a simulation environment. - Map and Classify Urban Environment Using UAV Camera and Deep Learning
Use a UAV with a camera to survey and develop an orthomosaic of an urban environment.
Featured Examples
UAV Package Delivery
Simulate a small multicopter simulation taking off, flying, and landing in a city environment.
Simulate Safe Landing of UAV in Unexplored Environment Using Unreal Engine
Simulate the safe landing operation of a UAV in an unexplored environment.
Simulate Simple Flight Scenario and Sensor in Unreal Engine Environment
Visualize sensors in a simulation environment that uses Unreal Engine from Epic Games.
Map Environment for Motion Planning Using UAV Lidar
Use a UAV with lidar sensor to create a 3D occupancy map for motion planning.
Stereo Visual SLAM for UAV Navigation in 3D Simulation
Generate a map for a city block scene in an Unreal Engine environment using stereo visual simultaneous localization and mapping.
