Unreal Engine Scenario Simulation
Automated Driving Toolbox™ provides a co-simulation framework for modeling and visualizing driving algorithms in Simulink® in a rich simulation environment. This simulation environment uses the Unreal Engine by Epic Games.
With this simulation environment, you can configure prebuilt scenes, place and move vehicles within the scene, and set up and simulate camera, radar, or lidar sensors on the vehicles. Use this environment to develop, test, and verify the performance of perception, path planning, and control algorithms, including closed-loop algorithms. To learn more, see Unreal Engine Simulation for Automated Driving.
Scene and Vehicle Configuration
|Simulation 3D Camera||Camera sensor model with lens in 3D simulation environment|
|Simulation 3D Fisheye Camera||Fisheye camera sensor model in 3D simulation environment|
|Simulation 3D Lidar||Lidar sensor model in 3D simulation environment|
|Simulation 3D Probabilistic Radar||Probabilistic radar sensor model in 3D simulation environment|
|Simulation 3D Probabilistic Radar Configuration||Configure probabilistic radar signatures in 3D simulation environment|
|Simulation 3D Vision Detection Generator||Detect objects and lanes from measurements in 3D simulation environment|
Scenes and Vehicle Dimensions
|Straight Road||Straight road 3D environment|
|Curved Road||Curved road 3D environment|
|Parking Lot||Parking lot 3D environment|
|Large Parking Lot||Large parking lot 3D environment|
|Open Surface||Open surface 3D environment|
|Double Lane Change||Double lane change 3D environment|
|US City Block||US city block 3D environment|
|US Highway||US highway 3D environment|
|Virtual Mcity||Virtual Mcity 3D environment|
|Bird's-Eye Scope||Visualize sensor coverages, detections, and tracks|
Learn how to model driving algorithms in Simulink and visualize their performance in a virtual environment using the Unreal Engine from Epic Games.
When simulating in the Unreal Engine environment, keep these software requirements, minimum hardware requirements, and limitations in mind.
Learn about the co-simulation framework between Simulink and the Unreal Engine and how block execution order affects simulation.
Understand the world and vehicle coordinate systems when simulating in the Unreal Engine environment.
Simulation with Sensors
Decide which camera, lidar, or radar sensors to use during simulation with the Unreal Engine.
Learn the basics of configuring and simulating scenes, vehicles, and sensors in a virtual environment rendered using the Unreal Engine from Epic Games.
Visualize depth and semantic segmentation data captured from a camera sensor in the Unreal Engine simulation environment.
Visualize sensor coverage areas and detections obtained from high-fidelity radar and lidar sensors in the Unreal Engine simulation environment.
Customize Unreal Engine scenes for automated driving applications.
- STEP 1: Install Support Package for Customizing Scenes
- STEP 2: Migrate Projects Developed Using Prior Support Packages
- STEP 3: Customize Scenes Using Simulink and Unreal Editor
- STEP 4: Package Custom Scenes into Executable
Apply labels to scene objects to obtain semantic segmentation data from camera sensors or detect custom objects from probabilistic sensors.
Create a 2-D, top-down map of a 3-D scene developed using the Unreal Engine from Epic Games. Use these maps to explore your scene and specify trajectory waypoints.
Place the Simulation 3D Camera GetSimulation 3D Camera block on static and custom actors.
Create custom vehicle mesh for the Simulation 3D Vehicle and Simulation 3D Vehicle with Ground Following blocks.