Abstract

At HITT Contracting, our team is working to bring robots to job sites to improve safety and reliability. Some of many hurdles we face are that real-world construction sites are dynamic, full of unique perception problems, and far more complex than captured in any currently-available large-scale datasets. This makes verification of robotics algorithms challenging at best.

To address this, we’re working on building a library of simulated jobsite environments in Nvidia Isaac Sim, using advances in 3D Gaussian Splats to generate photorealistic assets from hand-carried and aerial-captured photos and videos. We then model the sensors used by our robot and run SITL simulations to verify performance across these environments.

Technologies Used

• Python
• Isaac Sim / Omniverse
• 3D Gaussian Splats

Media

Check out our media release to see more!