Beyond Time
Shiseido

Digital Time Travel Experience with Real-Time Age Simulation
UX/UI  VISUAL
Role — Defined UX/UI and visual direction for interactive installation, prototype a 3D face simulation module, and collaborated with enginners to ensure high visual fidelity
Team — 10 Creative (Design/Copy), 10 Technology/Engineer, 3 Production, Production Camp KAZ
 


1.
The StoryJapan has the world’s fastest-aging population. Yet 9 out of 10 Japanese fear growing old. 
Developed based on Shiseido’s decades of scientific research on how Japanese age, we wanted to harness that data for good - helping people embrace the beauty of aging.

Beyond time is an immersive, interactive, deep-tech installation that allows two seemingly break the boundaries of time. The project leverages Shiseido’s facial data to develop a world-first, scientifically accurate, fully 3D, real-time Age Simulation Engine.

Instead of focusing on how we look at different stages in our lives, the experience was designed to help people reassess their relationship with time through the lens of their closest relationships.





What would happen if you could experience the spectrum of aging with a loved one, in an instant?

What if we bent time so a parent became younger than their child?
Lovers glimpsed each other before they met.
And friends grew old together in the blink of an eye.

What would change? What would stay the same?






2.The Tech &
The Science
Our tech team created a real-time, 3D Facial Age Simulation Engine.

The experience looks at 1,300 data points in your face and compares them to all the average face models in our 3D Face Models database (the second largest 3D Face model in the world). Based on this science of aging, we are able to simulate your face at different ages, in real time.








3.3D Face Data ProcessingWe created an innovative process to deconstruct captured 3D face data into 3D face models and skin UV textures. With the deconstructed data, we used the 3D face mapping techniques to create a pool of average face data we can then utilize in the Age Simulation Engine.

Once we created our pool of UV skin textures, we leveraged Shiseido’s decades of skin knowledge and Hokkaido University’s research on skin textures to crate scientifically accurate aging textures for the Age Simulation Engine.








4.Age Simulation EngineAs participants enter the experience, the system scans their face, builds a 3D model, and overlays it on their real face. It then adjusts the model in real-time using their facial structure, age, gender, and a pre-built dataset, creating accurate age and reverse-age simulations. The 3D model and skin textures respond to a room lighting, facial expressions, and real-time movements, highlighting subtle gestures like smile lines to make the experience more realistic and engaging.







5.Build and Test FeasibilityWe started testing out if the visual solution is feasible. Feedback was exchanged back and forth between designers and technologists to make iterations.





6.Final DesignAfter multiple rounds of exploration and iteration, I partnered with another product designer to finalize the UX and visual design for the interactive screens, covering both the sign-up flow and the in-pod experience. 













View Again
That’s a wrap
©SOOKIE LEENYC,