1

Augmented Reality in Industry: Experience and Future Directions

SAULI KIVIRANTAAR Conference 2016

MOSCOW

SAULI KIVIRANTA

2

My road to Industrial AR@sksauli

3

4

5

6

7

8

9

10

BUT WHY EXACTLY…

Why AR exists?Modality 2Modality 1 Modality 3

???

13

▪ Sight (visual) ▪ Hearing (aural) ▪ Touch (somatosensory) ▪ Smell (olfactory) ▪ Taste (gustatory)

For human, visual information is dominant for perceiving and understanding this world...

Do not forget other senses!

5senses

FIRST PRINCIPLES: HUMAN PERCEPTION

500M years of evolution: Concrete Reasoning

Vision starts to developAudition starts to developProto language starts to developVisual acuity of modern eye

Human Evolution

Concrete mental modelsPerception

▪ Visual ▪ Auditory ▪ Touch

▪ Olfactory ▪ Gustatory

Sense of relations, location, motion, distance, proximity, color, taste, smell...

Why AR exists?Modality 2Modality 1 Modality 3

Concrete Reasoning

??

Counting of items inventedNumbers for collections of items Proto writing for storytelling emergedMathematics & written language emerge

Aural language emerges

Vision starts to developAudition starts to developProto language starts to developVisual acuity of modern eye

Human Evolution

100k years of evolution: Abstract Reasoning

Reference ▪ Visual ▪ Auditory ▪ Touch

▪ Olfactory ▪ Gustatory

References, Properties, Syntax, Grammar, Denotation, Abstracting abstractions...

Abstract mental models

Why AR exists?Modality 2Modality 1 Modality 3

Concrete Reasoning

Abstract Reasoning

?

Linear perspective invented by Filippo Brunelleschi

Counting of items inventedNumbers for collections of items Proto writing for storytelling emergedMathematics & written language emerge

Aural language emerges

Vision starts to developAudition starts to developProto language starts to developVisual acuity of modern eye

Human Evolution

Key insight fromProf. Dr. Giuseppe

Di Gironimo

Filippo Brunelleschi

Brunelleschi needed his perspective realism to be proven against Euclidean laws of geometric optics…

Looks familiar?

Augmenting factory under construction in 2010

Augmenting baptistery under construction in 1413

Brunelleschi demonstration was equivalent to modern Augmented Reality

Filippo Brunelleschi

Brunelleschi impact on visual simulation...

Parallax free view of graphics content

Optical principles for contextualized graphics

Linear perspective invented by Filippo Brunelleschi

Counting of items inventedNumbers for collections of items Proto writing for storytelling emergedMathematics & written language emerge

Aural language emerges

Vision starts to developAudition starts to developProto language starts to developVisual acuity of modern eye

Human Evolution

Ivan Sutherland1968

Augmented Reality – Thomas Caudell, Boeing 1990

Abstract and Concrete reasoning combined

Parallax free view of graphics contentLinear perspective invented by Filippo Brunelleschi

Counting of items inventedNumbers for collections of items Proto writing for storytelling emergedMathematics & written language emerge

Aural language emerges

Vision starts to developAudition starts to developProto language starts to developVisual acuity of modern eye

Dr. Thomas P. Caudell

Human Evolution

What did we learn?

Perspective drawing technology invented by Brunelleschi • Spatial reasoning unleashed for art and engineering

What is called Augmented Reality started to take shape • Technology to combine Concrete & Abstract reasoning

Why AR exists?Modality 2Modality 1 Modality 3

Concrete Reasoning

Abstract Reasoning

?

▪ Sight (visual) ▪ Hearing (aural) ▪ Touch (somatosensory)* ▪ Smell (olfactory) ▪ Taste (gustatory)

Human Sensors: Machine Sensors:

Gyroscope, Accelerometer, Magnetometer , Geophone, Hydrophone, Microphone, Seismometer, Hall effect sensor, MAP sensor, Mass flow sensor, Oxygen sensor, Speed sensor, Breathalyzer, Carbon dioxide sensor, Carbon monoxide detector, Electrochemical gas sensor, Fluorescent chloride sensors, Hydrogen sulfide sensor, Olfactometer, Smoke detector, Magnetometer, Geiger counter, Altimeter, Variometer, Capacitive sensing, Free fall sensor, Rotary encoder…

Human-Machine Systems Unity of Human and Machine

Human Augmentation with Transformational Reasoning

Modality 2Modality 1 Modality 3

Concrete Reasoning

Abstract Reasoning

Transformational Reasoning

Why AR exists?

LETS REVIEW THE 5 SENSESAugmented Reality with Concrete & Abstract reasoning

Augmenting Vision

Concrete Abstract

Augmenting Audio

Concrete Abstract

Augmenting Touch

Concrete Abstract

Augmenting Smell

Ethanethiol

Propane

Concrete Abstract

Augmenting Taste

Concrete Abstract

EXAMPLES OF AUGMENTATIONConcrete, Abstract & Transformational reasoning

From sensors to sensations...

Yuta Takeuchi et al.

From sensors to sensations...

Lance Corporal Craig Lundberg

From sensors to sensations...

What did we learn?

• Concrete Reasoning & Abstract Reasoning • Transformational Reasoning for new senses • Brain is very plastic and it will adapt to AR…

We have not even started to properly leverage the human potential...

Augmented Reality will change that!

44

Augmented Reality as a business foundation

HOW WE USE THIS AT DCL

45

4646

Customer:

System is not working, can you support us?

You:

First release the CMP piping next to the DLC pump…

Customer:

Where is the DLC pump located?

You:

It is square looking box and 5cm of it there are 4 bolts…

Customer:

Uhmmmm… Can you come visit us???

You:

OK, we will send someone next week!

Communication is the problem…

Phone support:Old way…

47

Augmented Reality is the solution…

Customer:

System is not working, can you Pointr us?

You:

For safety, do not remove the cables marked with red

Customer:

Ok, understood!

You:

Release CMP piping by opening bolts marked with green

Customer:

Great, that was easy!

You:

Happy to help!

Pointr support:New way…

Pointr is communication beyond voice and video

POINTR APPCOMMUNICATION AT THE NEXT LEVEL

Pointr is the best way to solve technical problems remotely

49

POINTING IS UNIVERSAL

50

LEVERAGE 500M YEARS OF HUMAN EVOLUTION

51

From disillusionment to productivity

Pointr

AUGMENTED REALITY IN INDUSTRY

• Repair & off-nominal maintenance

• Ramp-up & commissioning

• Upgrades & retrofit

• On-the-job training

• Quality assurance

• Warranty period support

PRODUCTIVITY BOOST TODAY…

TOMORROW AUGMENTED REALITY WILL IMPACT ALL OF 7 BILLION PEOPLE…

53

www.deltacygnilabs.com@sksauli

BORISKRASSI, CEO

SAULIKIVIRANTA, CTO

JOHANNAANIA,

MARKUSMYHRBERG

TEEMUKUMPUMÄKI

NIRDHARSHSHETTY

IGORLEVOCHKIN

THANK YOU!

JARILAHTI