Project
Role
Tools
Independent Study
Strategy, Product Design, Experiential Design, UX/UI, 3D Modeling,
After Effects, Adobe Aero, Unity, Blender, XCode
The Ask
SAmsung wants to explore new ways to create immersive experiences through their products
Samsung has historically found ways for different mediums to converge and connect to provide their users with experiences they can't find anywhere else (i.e. Samsung's Frame TV). How can we find a way to arrive at a novel experience that is both alluring and assessable?
Introducing
Replacing idle TV Screens
with 3d experiences of 2d Artworks

A New View

All Art

AI depth mapping
technology allows any
piece to be viewed in AX

Wide FOV

With nearly 120° FOV, find new appreciation for art anywhere

Seamless

Hidden beside the light sensor,
don’t let anything obstruct your view

A Perfect Frame

The Background
Let's elevate and renew interest in artwork that has been forgotten.
For the past few years I have been interested in preserving and elevating artwork that has been relatively forgotten in the homes of my family members. In the past I have converted them into animated experiences...
The Problem
How might we elevate 2D experiences and attempt to build an immersive experience.
I'll be experimenting with multiple formats to arrive at an easily achievable and desirable trans-dimensional experience for any traditional two dimensional medium.
My Late GrandFather's Paintings
These paintings are part of my late grandfather's collection. They have been sitting in a closet at my parent's home for as long as I can remember. Let's try and breathe new life into these works.
First Navigation

Let's Convert
These into a
workable
3d file...

This is done by cutting out each individual layer and placing them into a 3D space. Characters are then animated and placed with in each scene. Post processing effects are then done to give a traditional animated look.

... and attempt an immersive experience.
Using Adobe Aero, these 3D files are able to be placed into an Artificial Reality Space. Experience it yourself using the QR codes below!
First Navigation Reflections

(what sucks)

WhAt Are Limiting
Factors of this Experience?

Tied to your phone

Required to have a phone in
your hand to view the actual experience.

Too much set-up

This isn’t readily available, user must download an app then set up 3D tracking space.

Movement breaks immersion

While it’s great there’s a wide angle of viewing, moving too close shows flaws of 3D model.

Second Navigation

WTF is a “Lenticular”

A lenticular photo is a series of interlaced pictures that when aligned with the right lenses are able to give the appearance of movement or parallax. It is a way to mimic 3D viewing without a device.

Second Navigation Reflections

(what blows)

WhAt Are Limiting
Factors of this Experience?

Resolution is limited

Interlacing these pictures tends to reduce the quality of the image, only way to fix that is to make the image bigger

Minimal FOV

Depending on LPI, the max field of view one can get is about 54 degrees

Expensive af

A pack of 10 of 8”x10” 50 LPI sheets was about $55. Imagine a
billboard size...

Multipurpose Minimal Solution

So What are
we looking for?

Seamless Immersion

Easy to use, high fidelity, and limited set up without needing a device in your hands (or head) to experience.

Relatively Inexpensive

Provide an experience without tech that is unavailable to the majority of everyday people.

A Prime Location

Where does this live, how will people interact with it, and how would it be technologically possible?

First some Tools
(including the biggest one of them all, me)

Monodepth and Tensorflow

Able to automatically create a depth map from any 2D image

Converted into 3D

The created image creates values that can be converted into a 3D mesh

Minimal Solution

A.I. Depth mapping

Minimal Solution

3D  Eyetracking

The Parallax View

Code to track eye using depthCamera of iPhones (X and newer)

High Fidelity 3D Viewing

Eye-tracking is used to map a 3D camera to view models without an
additional device

Art Mode

Enjoy a personal art exhibit when not watching TV. Motion sensors turn off display when not in the room.

QLED Display

The QLED displays allows for consistent colors and brightness from nearly all viewing angle.

Matte Display

Anti-Reflection technology limit light distraction on the screen, reducing the effects of glare.

Minimal Solution

The Frame

Working Prototype
The Future

I guess this
is cool, but
What’s Next...

This tech is not limited to Samsung TVs, practically any device with a face/eye tracking camera can do this. Can the AI depth mapping also be used to create the same effect for video?

Final Reflections

(what stinks)

WhAt Are Limiting
Factors of this Experience?

Single viewer

Right now the tracking can only handle one view since there is only one display

Depth AI isn’t perfect

Though the AI does well for landscapes, it can be a bit fuzzy for portraits

Where else?

Where else can this live? Can this be useful for museum spaces?

© 2023 Travis Fairman. All rights reserved