Green screen +
Green Screen + is a solution for simplifying setting up green screen and compositing a 3D content on an smart phone for a social media content creator. Setting up a green screen and combining it with 3D world requires ground knowledge in visual effects and some tricks that a social media content creator may not have. In 2017, I was thinking of a cheap and simple solution for such a problem using AR and my green screen algorithm.
|
|
Face paint
Face paint is an AR mask solution that keeps skin texture and matches with environment light to increase character representation quality. AR face apps have improved in terms of realistic end result over the past years. However, parameters like skin textures, different light level in one session and camera noise are missing in those apps such as Tiktok and Facebook's Spark. The deep fake apps for face swapping have those parameters but most of the deep fake apps are not in real-time and they are limited in content. I worked on this prototype in 2020 using Unity and ARKit.
|
|
Machine learning
Unity's ML Agent was a great way for me to try Machine learning easily. I used ML Agent to gain basic understanding in Reinforcement learning and Imitation learning by training an agent for simple tasks like 2D walking, balancing and catching. It helped to have better view over policies, observation and award system.
|
|
