Main Content

Choose a Sensor for Unreal Engine Simulation

In Automated Driving Toolbox™, you can obtain high-fidelity sensor data from a virtual environment. This environment is rendered using the Unreal Engine® from Epic Games®.

The table summarizes the sensor blocks that you can simulate in this environment.

Sensor BlockDescriptionVisualizationExample

Simulation 3D Camera

  • Camera with lens that is based on the ideal pinhole camera. See What Is Camera Calibration? (Computer Vision Toolbox)

  • Includes parameters for image size, focal length, distortion, and skew

  • Includes options to output ground truth for depth estimation and semantic segmentation

Display camera images by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Design Lane Marker Detector Using Unreal Engine Simulation Environment

Display depth maps by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Display semantic segmentation maps by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Simulation 3D Fisheye Camera

  • Fisheye camera that can be described using the Scaramuzza camera model. See Fisheye Calibration Basics (Computer Vision Toolbox)

  • Includes parameters for distortion center, image size, and mapping coefficients

Display camera images by using a Video Viewer (Computer Vision Toolbox) or To Video Display (Computer Vision Toolbox) block. Sample visualization:

Simulate Simple Driving Scenario and Sensor in Unreal Engine Environment

Simulation 3D Lidar

  • Scanning lidar sensor model

  • Includes parameters for detection range, resolution, and fields of view

Display point cloud data by using pcplayer (Computer Vision Toolbox) within a MATLAB Function block. Sample visualization:

Design Lidar SLAM Algorithm Using Unreal Engine Simulation Environment

Display lidar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Visualize Sensor Data from Unreal Engine Simulation Environment

Simulation 3D Probabilistic Radar

  • Probabilistic radar model that returns a list of detections

  • Includes parameters for radar accuracy, radar bias, detection probability, and detection reporting

Display radar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Simulate Vision and Radar Sensors in Unreal Engine Environment

Visualize Sensor Data from Unreal Engine Simulation Environment

Simulation 3D Vision Detection Generator
  • Camera model that returns a list of object and lane boundary detections

  • Includes parameters for detection accuracy, measurement noise, and camera intrinsics

Display vision coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Simulate Vision and Radar Sensors in Unreal Engine Environment

See Also

Blocks

Related Topics