3D Gaussians Plugin

Import and render training results of 3D Gaussian Splatting.

Use real-world captures as photo-realistic 3D environments

3D Gaussian Splatting is a technique for reconstructing scenes from multiple photos, whose accuracy is equivalent or better than NeRF, and whose rendering load is lower than NeRF.

Anyone can create 3D Gaussian Splatting data by using the official implementation.

This plugin is a importer and a renderer of the training results of 3D Gaussian Splatting.

• Just a few clicks on the UE editor to import.
• Real-time rendering at about 30-100 FPS with RTX3070, depending on the data
• Fully implemented in Niagara and Material, without relying on Python, CUDA, or custom HLSL node
• Demo project is available for free.

System Requirement

GPU which supports DirectX 12 is required.

Limitations

• This plugin renders 3D Gaussian Splatting data using Niagara particles. Because there is a limit to the number of particles in a Niagara system, this plugin imports 3D Gaussian Splatting data into multiple blocks. The seams between the blocks can be seen if one looks carefully.
• Lighting support is EXPERIMENTAL. You can use Lit/Translucent material for rendering of 3D Gaussian Splatting data, but problems occurs under certain conditions. See the details.
• Lumen is not supported. You can receive the light from Lumen Global Illumination, but the brightness may be unstable over time. Also, it cannot emit GI light.
• Shadow is not supported.
• Ray Traced Translucency is not supported.
• 3D Gaussian Splatting data are rendered by translucent material. When used with other transparent objects, problems can occur when deciding which objects to render in front of or behind other transparent objects; if multiple 3D Gaussian Splatting actors are placed, they will not intersect with each other correctly.

Currrent Version 1.5

Technical Details

Features:

• Import training results of the official implementation of 3D Gaussian Splatting
• Render the imported results in Unreal Engine

Code Modules:

•  ThreeDGaussians (Runtime)
•  ThreeDGaussiansImporter (Editor)

Number of Blueprints: 1

Number of C++ Classes: 1+

Number of Materials: 1+

Network Replicated: No

Supported Development Platforms: Windows 64bit

Supported Target Build Platforms: Windows 64bit

Important/Additional Notes: GPU which supports DirectX 12 is required