We’ve built custom experiences that react to eyes, hands, and head movement before, but when we partnered with Keurig Dr Pepper to launch their new Snapple Elements line, we saw an opportunity to immerse users in a deliciously tasteful new way… through their tongue.
With the ambitious goal of allowing people to taste a digital experience for the first time, we created the first-ever tongue tracking machine learning model. You don’t want to know how many tongue models we worked with to create an accurate data set and train the software 😉
The resulting best-in-class experience encouraged fans to open wide, stick out their tongue, and let their taste buds guide them through the Flavorverse to discover the perfect Snapple.