November 2020

Built from scratch using ARKit and RealityKit, this iOS app recognizes three different emojis, with potential to expand to many more. It demonstrates the fundamentals of gesture recognition in Augmented Reality, which further developed into a standard for interfaces, interactions, and communications in mixed reality spaces.

the final gesture recognition app translates three hand signals
demo of hand successful hand tracking
demo of unsuccessful hand tracking