Immersive Fab Tour

Developed software to showcase 360 footage captured for VR on various immersive display configurations at events. The experience is controlled by a tablet interface, allowing a presenter to guide the experience, pause the video to look around or highlight details, etc.

Situation: Planning for an event with policy makers and government officials In Washington DC, we wanted to convey the importance and difficulty of semiconductor manufacturing, and what sets it apart from other manufacturing facilities.

We had an existing "Virtual Fab Tour" video, captured in 360 for VR headsets, and wanted to make the experience of seeing inside the complex manufacturing steps in fab more accessible for groups.

Challenge:  I was part of the initial event planning and group prototyping of display configurations, and saw the need for a software tool to drive the displays in a perspective-correct way, and also build in some clean video controls for the interactions that we knew we wanted.

Process: I brought the 360 video into a sphere in a 3D software environment (TouchDesigner) and set virtual cameras that could render aspect-correct views for each display in several configurations. I built a remote mobile interface so that a presenter could wirelessly control the demo.

Although we initially started with more c-shaped wraparound displays, working with Intel Branding and Event PMs, we converged on a 3-sided cube, referencing the Intel “spark” square branding element from the outside.

Based on testing and feedback from peers and stakeholders, I identified key capabilities that the remote tablet interface needed, such as the ability to change the overall FOV depending on where people were more likely to be standing, along with other controls to allow the presenter to better guide the conversation at key moments.

Impact: The immersive Fab Tour became a centerpiece at leading events, critically at government outreach activities and multiple POTUS host events, where our CTO liked to invite MVP guests inside to talk about the unique steps and machines used in chip production. I adapted the viewer software for display types for different events, and also into a standalone-ruggedized version for long-term installation in the Intel RA campus in Oregon. The mobile interface became a central control point for many of the demos at the World Economic Forum.

To increase engagement and create photo moments between fab tours, I built fluid simulations using the Intel Spark and the geometry of the display. In some versions, an Intel Real Sense camera let visitors appear in outline within the display and virtually "splash" through the sparks.