Polaroid of the Future: NVIDIA's New Neural Network Turns 2D Images Into 3D Models
Miscellaneous / / March 25, 2022
With its help, it will be possible to create avatars and scenes for virtual worlds.
NVIDIA Company introduced its new neural network, called Instant NeRF. She instantly glues a series of 2D photos and finishes the picture to a three-dimensional scene. As a result, an object from a flat image becomes three-dimensional.
This neural network has been dubbed the "Polaroid of the Future" because the finished 3D model is obtained in a matter of seconds. As a tribute to the Polaroid brand, NVIDIA Research has recreated Andy Warhol's iconic photograph in 3D.
The developers note: Instant NeRF uses inverse rendering to approximate the behavior of light in the real world, allowing a 3D scene to be reconstructed from multiple 2D images taken under different corners.
It only takes a few seconds for a model to learn from dozens of still photos. Also neural network should take into account the data on the camera angles from which the pictures were taken.
The technology works best with frames where there is a minimum of movement and only one main object. Otherwise, the 3D scene created by artificial intelligence may be blurry.
Instant NeRF can be used to create avatars or scenes for virtual worlds, capture video conference participants and their environment in 3D, and reconstruct scenes for digital 3D maps. While it is impossible to test the technology, but in the future NVIDIA may well open access to it.
Read also🧐
- Neural network ArcaneGAN stylizes photos under Arcane
- TEST: Neural network or artist? Determine the author of the picture
- High-quality photos of Van Gogh and Napoleon: neural networks restored the appearance of historical figures from their portraits
AliExpress Birthday Sale: 7 Items You Should Look Out For
How to replace disposable pads and tampons: 3 alternative feminine hygiene products