The designer created a camera that automatically applies the Stable Diffusion neural network

Snapchat AR designer Kyle Goodrich has created a device called the DreamGenerator. This is a compact camera that transforms every frame using the Stable Diffusion neural network with an extension Control Net.

Pictures: Kyle Goodrich / Twitter

DreamGenerator doesn't just enhance a photo, it transforms it into something new. The user only needs to choose one of the 30 available styles: fairy tale, zombie, retro, Wild West, pirates and so on. Image generation starts immediately after the camera shutter is released.

The neural network relies on the composition or position of the object in the frame, ensuring that key elements are preserved, as well as adding new creative touches, noted developer at Twitter.

So far, DreamGenerator is just a prototype, the embodiment of Kyle's idea. However, on the Web, he is already flooded with requests to do something similar in the format of a mobile application. To make it work in a similar way, I pointed the camera, took a photo and received an already processed frame.