- Keywords: Unity - Tango - Android - Compute shader - Point cloud - synchronization - Parallel computation - Ray-casting - RGB - Unity Job
Overview
|
I made an app on Tango platform to capture, visualize and store RGB point-clouds in real-time. The challenges were to find a way to match RGB camera and depth sensor with reasonable frame rate along with detecting and removing error points(noises). Rendering millions of points where they are updating constantly was another big challenge. Compute shader was the answer to all of the problems. I made an Android app to capture the points with their matched RGB values and remove the noises without any post processing. And then I made another app running on a PC to load Millions of points in seconds using Unity's Job system. Moving 3d objects on the points was another challenge that doing a raycast using compute shader solved that problem too.
|
Point cloud Capture app using Tango 2017-2018
|
PC App to visualize and load millions of points and place 3D objects 2017-2018
|