NEC's AI Breakthrough: Rapid 3D Model Generation with Automatic Object Removal

NEC's AI Breakthrough: Rapid 3D Model Generation with Automatic Object Removal

Introduction

NEC Corporation has unveiled a pioneering AI technology capable of rapidly generating highly detailed 3D models from footage captured by general-purpose cameras, such as those on smartphones. Remarkably, this system can produce accurate 3D representations in as little as one minute, while automatically removing unnecessary objects from the scene. This advancement holds significant promise for industries like infrastructure maintenance and construction, where efficient and precise site assessments are crucial.

The Technology Behind the Innovation

The core of NEC's new technology lies in its integration of proprietary AI with Gaussian Splatting—a technique that represents spaces as clusters of scattered points with spatial extent. This combination allows for the creation of lightweight yet highly detailed 3D models that accurately replicate colors and shapes. The process involves:

• Efficient Point Placement: The AI analyzes the visual complexity of the footage, placing points densely in intricate areas and more sparsely in uniform regions. This optimization reduces the number of points required, cutting generation time by 90% compared to traditional methods.

• Automatic Object Removal: During model generation, the system detects and removes temporary or unnecessary objects from the footage. It then infers and fills in the background based on surrounding visuals, ensuring the final 3D model accurately reflects the true environment without obstructions.

Implications for Industry

This technology offers several advantages for sectors reliant on accurate site assessments:

• Remote Inspections: High-fidelity 3D models can be viewed on standard computers or tablets, enabling remote facility inspections and reducing the need for on-site visits.

• Operational Efficiency: Rapid model generation without specialized equipment or operational disruptions allows for quicker decision-making and resource allocation.

• Enhanced Safety: Accurate, up-to-date 3D representations of sites can improve safety assessments and planning, particularly in dynamic environments like construction sites.

Comparison with Existing Technologies

While other AI-driven 3D modeling tools exist, NEC's approach stands out due to its speed, accuracy, and automatic object removal capabilities. For instance, NVIDIA's AI Blueprint for 3D object generation focuses on creating 3D assets from text prompts but doesn't emphasize rapid scene reconstruction from real-world footage. Similarly, VOID AI specializes in removing objects from videos with interaction awareness but doesn't integrate this with 3D model generation.

Exploring Similar Technologies with PixelDojo

For those interested in experimenting with AI-driven 3D model generation and object removal, PixelDojo offers tools that complement NEC's innovations:

• Rodin: This tool enables users to generate production-quality 3D models quickly, facilitating the creation of detailed digital twins for various applications.

• Hunyuan 3D: Allows for the generation of 3D models from text or image inputs, providing a versatile platform for 3D content creation.

• Inpainting: PixelDojo's inpainting tool lets users edit specific areas of an image, effectively removing unwanted objects and filling in the background seamlessly.

By leveraging these tools, users can explore the capabilities of AI in 3D modeling and image editing, gaining insights into how such technologies can be applied in real-world scenarios.

Future Prospects

NEC plans to commercialize this technology within fiscal year 2027, aiming to promote the adoption of digital twin technology among infrastructure operators and the construction industry. This initiative is expected to alleviate labor shortages, enhance facility safety, and drive operational transformation.

Conclusion

NEC's development marks a significant advancement in AI-driven 3D modeling, offering rapid, accurate, and efficient solutions for industries requiring detailed site assessments. As this technology becomes commercially available, it is poised to revolutionize how organizations approach remote inspections and operational planning.

For more information, refer to NEC's official press release: NEC develops world's first proprietary-AI technology to rapidly generate highly detailed 3D models.