Front-end and UX for novel AI model: Latent Diffusion Model for 3D (LDM3D)
Worked with Intel Labs' Emergent AI research group to showcase their novel generative AI model, LDM3D.
This demo software takes a panoramic image with accompanying depth map (generated by the model running on a server at Intel Labs), and combines the images into a 3D (or 2.5D) environment that users can navigate with a game controller. The software caches past scenes and handles user prompts and new scene generation on the remote server.
Process: Worked closely with AI researchers on image quality and API requirements, architected front-end software in TouchDesigner to connect with their system and interactively visualize model output. Collaborated with an external developer / consultant on the TouchDesigner front-end.
Impact: This demo featured prominently at events around the world, including a POTUS host event, and demoed live in conversation with Intel CEO at a press gathering at Intel Connection in Taipei 2023.