AR Interaction Exploration

Out of all the projects I've worked on, this is probably one of the ones I've enjoyed the most. Sadly, due to the proprietary nature of it, I can't write about it in detail. But I'll give a high level summary about the project, and what I did...

The purpose of this project was to explore different possible interactions and experiences in an AR environment; to see what worked well, where there were opportunities, where to make changes to the standard approach, and to see what new ideas we could come up with.

Though I cannot write about it in detail, Meta published an article that talked about the groups with whom I was doing work. The article can be viewed here: Inside Facebook Reality Labs: The next era of human-computer interaction.

There were four of us working equally on this project, and together we worked through ideas all the way from ideation and storyboards, to full functioning prototypes. In particular, we:

• Brainstormed scenarios
• Flushed out the "stories" for the most promising scenarios
• Storyboarded the top 10 scenarios
• Down selected 3 scenarios from the possible 10
• Broke down the scenes into beats
• Body-stormed the ideas with a larger group to get feedback
• Created video prototypes of the potential end results
• Evaluated and determined the best hardware and techniques we'd use to achieve each of the steps in the selected scenarios
• Built three fully functioning prototype to test out the scenarios
• Walked people through the scenarios, getting feedback and thoughts
• Tweaked the scenarios to result in better experiences
• Created end videos to show the prototype in action for those who were unable to experience it first-hand

This experience was particularly exciting, due to the challenging nature of it, the creativity and the "thinking outside of the box" that was required to make these scenarios happen. Since our technology isn't quite where it will be in the near future (10 to 20 years), one has to improvise solutions for a prototype that may not be possible with current technology. Further, seeing an idea all the way through the pipeline from ideation to prototype is incredibly rewarding (not to mention the delight people showed when experiencing the end result themselves).

With these experiences, we used everything from repurposing hardware and using it in unintended ways, to parts of the experience being run through a Wizard-of-Oz technique. Two of the 3 experiences were run in AR, with the 3rd being experience in a VR environment.

Feel free to ask me about more detail in person.

Return to Portfolio