Transcript
Page 1: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

Interactive Robots and Our Future Society

HiroshiISHIGURO

Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro LaboratoriesResearch Director of JST ERATO Ishiguro Symbiotic HRI Project

[email protected], www.geminoid.jp.

Interactive Robots and Our Future Society

HiroshiISHIGURO

Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro LaboratoriesResearch Director of JST ERATO Ishiguro Symbiotic HRI Project

[email protected], www.geminoid.jp.

1

Page 2: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

2

Page 3: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

3

RobotSociety

Android

Android

Human

Page 4: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

4

Why do we use humanoids?

Humans have brains that recognize humansThe ideal interface for humans are humans.

Page 5: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

5

Robotics for Understanding Humans

Page 6: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

Robotics for understanding humans6

Develop humanlike robots based on knowledge in cognitive science.Verify hypotheses in cognitive science by using the robots.

Page 7: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

Science

Engineering

Pattern Recognition

Mechanical EngineeringMechanical Engineering

Hypothesis & verification

Integration of Science and Technology

SystemsEngineering

SystemsEngineering

Neuroscience

Psychology

Robotics

Cognitivescience

Cognitivescience

8

Page 8: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

9

Practical Interactive Robots

Page 9: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

10

Page 10: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

11

Page 11: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

12

The future societysupported by humanoids & androids

Elderly care

Public places Learning

Department stores Stations

Humanoids

Page 12: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

13

Androids withHumanlike Emotional

Expressions

Page 13: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

14

Android in the show window

Page 14: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

15

Android as an idol singer

Page 15: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

16

Android theaterwith Oriza Hirata

Page 16: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

17

Movie “Sayonara (Goodbye)”

Page 17: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

18

We feel the humanlike hearts /minds of the android, but it is a simple computer program.

What is heart/mind?What is heart/mind?

Page 18: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

20

Page 19: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

22

Extension of Human Presence with Androids

Page 20: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

Ishiguro’s android Geminoid23

Page 21: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

26Android of a great literary figure

Page 22: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

30

Androids withconversational functions

Page 23: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

31

Geminoid

Inte

rnet

Operator

Page 24: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

32

Autonomous conversational android

Inte

rnet

Operator

Computer

Page 25: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

33

Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson

Story-based approachStories written by writersComplex conversation for limited topics

Page 26: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

34

Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson

Story-based approachStories written by writersComplex conversation for limited topics

Page 27: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

35

Page 28: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

36

Conversational Autonomous Androids

NTT LaboratoriesOsaka University and ATR

Microphone array by NTTVoice recognition by NTTChatbot by NTTAndroid by Osak Univ.Lip and head movements by ATR

Page 29: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

39

Page 30: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

40

Page 31: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

Casual discussion dialogue system with NTT

Page 32: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

Sushi is better than

Ramen.

Sushi is healthy.

Ramen has more varieties.

You can eat fish, which is

good for health

Sushi actually has high calories.

+ ー

[Walton, 2003]

Casual discussion dialogue system with NTT

Page 33: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

44

Deep discussion dialogue system with NTT

Page 34: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

Mechanismof deep discussion

45

(2) Voice Recognition(Words, Positive/Negative)

(2) Voice Recognition(Words, Positive/Negative)

QuestionAnswerBack

ChannelHuman

AnswerNext topic

ClaimGroundWarrant

Page 35: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

46

Toulmin model of argument

ClaimClaim Ground(or Data)

Ground(or Data)

WarrantWarrant

Harry was born in Bermuda.Harry must be a British subject.

A man born in Bermuda will be a British subject.

Page 36: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

48

Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson

Story-based approachStories written by writersComplex conversation for limited topics

Page 37: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

49

JST ERATO ISHIGUROSymbiotic Human Robot Interaction

Project2014-2020

Page 38: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

50

Android that hasintensions and desires

BehaviorBehavior

IntentionIntention

DesireDesire

BehaviorBehaviorBehaviorBehaviorBehaviorBehavior

BehaviorBehavior

BehaviorBehaviorBehaviorBehavior

BehaviorBehavior

BehaviorBehavior

BehaviorBehavior

BehaviorBehaviorBehaviorBehavior

BehaviorBehaviorBehaviorBehaviorBehaviorBehavior

BehaviorBehavior

BehaviorBehaviorBehaviorBehavior

IntentionIntention IntentionIntention

DesireDesire DesireDesire

IntentionIntention IntentionIntention

IntentionIntention

Speech and gesture recognition

Speech and gesture recognition

Utterance and behavior generation

Utterance and behavior generation

Hierarchical models of utterance and behavior generation

BehaviorBehavior

IntentionIntention

DesireDesire

Robot

Page 39: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

51

ISHIKI System

Page 40: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

52

Interaction Composer

Page 41: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

53

Page 42: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

54

Page 43: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

55

Page 44: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

56

Page 45: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro

57