A Nice Gesture for XR

What is a Good Hand Gesture in an XR Experience? And how to measure its success? As hand recognition has become more accurate and fairly reliable, Gestures are becoming the primary input in XR headsets. Still, designing a gesture with unclear principles and lacking evaluation methods can be tricky.

Green screen + AR

Green Screen + AR is a solution for simplifying setting up a green screen and compositing 3D content on a smartphone for a social media content creator. In 2017, I was thinking of an affordable and simple solution for such a problem using phone AR.

Adaptive Face Mask

An AR mask solution that keeps skin texture and matches with environment light and noise to increase character representation quality. AR face apps have improved in terms of realistic end results over the past years. However, parameters like skin textures, different light levels in one session, and camera noise are missing in apps like TikTok and Facebook's Spark. I worked on this prototype in 2020 using Unity and ARKit.

Machine learning

Unity's ML Agent was a great way for me to try Machine learning easily. I used ML Agent to gain basic understanding in Reinforcement learning and Imitation learning by training an agent for simple tasks like 2D walking, balancing and catching. It helped to have better view over policies, observation and award system.