40
AIBO Gun A. Lee 20023535 VR Lab, CSE Dec. 4, 2002 EECE520 A.I. Class Term Project

EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

AIBO

Gun A. Lee20023535

VR Lab, CSE

Dec. 4, 2002

EECE520 A.I. Class Term Project

Page 2: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

ContentsIntroductionSpecificationFunctionsProgramming AIBOImproving with A.I. TechniquesConclusion

Page 3: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Introduction - AIBO?A.I. Robotあい-ぼう[相棒]A robot pet of SONY

Page 4: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Introduction - AIBO?Line-up

ERS-110 ERS-210 ERS-220 ERS-311May 1999 Oct. 2000 Nov.2001 Sept.2001

Page 5: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Introduction - Robot Pet?Virtual Pets

Tamagochi, Pokemon Pikachu,Digimon

Raising Simulation GamesCreature, Princess Maker

Interactive Dolls / Robot PetFurby, Shelby, Tekno, iCYbie, NeCoRo

Page 6: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE
Page 7: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

i-Cybie

NeCoRo SDR-4X

Page 8: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE
Page 9: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Specification - Hardware64-bit MIPS RISC CPU32MB SDRAMMemory Stick Media for AIBOBuilt in ClockPC Card Slot Type 2 (ERS-200 Series)Sensors

CMOS Camera, Stereo Microphone, Temperature, Acceleration, Pressure, Vibration, IR Distance

20 DOF on Legs, Tail, Head, Mouth & Ears

Page 10: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE
Page 11: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE
Page 12: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE
Page 13: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE
Page 14: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Specification - SoftwareAIBO-warePC Applications for AIBODevelopment

R-CODEOPEN-R SDK

Aperios / OPEN-R

Page 15: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

FunctionsInstincts

Love, curiosity, movement, hunger & sleep

Expressing EmotionsHappiness, sadness, anger, surprise, fear and dislikeTonal language, motions, LED

LearningVoice(Tonal language) recognitionMimic, Humming, Sing a songObject tracking & Face recognitionTake pictures

Page 16: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Functions - AIBO-wareAIBO-Life & AIBO-Life2

Raise from toddler to child, teen & adultInteracting with AIBO accelerates the maturing.Teach ActionsGive a name to AIBOTell your name

Page 17: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Functions - AIBO-wareHello AIBO

Fully matured adult AIBO75 Voice Command RecognitionMimickingSocial behaviors

Page 18: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Functions - AIBO-wareParty Mascot

GamesSong & Dances

AIBO Speed BoardSkate with voice commandsRecord and replay routines

Page 19: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Functions - AIBO-wareAIBO Explorer

Fully matured AIBOSurveillance modeHyperactive Boost mode

AIBO RecognitionFully matured AIBOOwner RecognitionSelf Recharging on Energy Station

Page 20: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Functions - PC AppsAIBO Fun Pack

Check AIBO StatusDownload Photos

AIBO MessengerNotice e-mail receivedRead e-mailRead favorite websites

Page 21: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Functions - PC AppsAIBO Navigator

Control and NavigateWireless LANVideo and sound monitoringTake PictureSend commandsForce feedback Joystick support

Page 22: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Functions - PC AppsAIBO Master Studio

Create and edit original sound, motion, LED data and BehaviorVoice recognitionWireless LAN debuggingImport/Export Actions for other AIBO wares

Page 23: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

FunctionsRobot Soccer?

Page 24: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Programming AIBOR-CODE

Easy to learn, simplified PLR-CODE InterpreterAIBO Master Studio

OPEN-R SDKAdvanced programmingOPEN-R APIBased on gcc (C++)

Page 25: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Programming AIBO:R-CODEFeatures

Similar to BASICControl statementsSubroutinesVariables (16-bit integers)

System variables support sensor data

Addition/SubtractionStacks

Page 26: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Programming AIBO:OPEN-RFeatures

OO designed OPEN-R API of system layerFull control of joints & displaysFull access to sensors

Image data, wave formatted sound data

Network supportsHigh level functions are not supported.

Gait, Voice & Object Recognition, MIDI

Page 27: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Improving with A.I.A.I. Techniques

Problem Solving - SearchInference with Knowledge BasePlanningLearning

Page 28: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

Improving with A.I.Newly suggested functions:

‘AIBO, come here!’‘Go, get the newspaper.’

Page 29: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘AIBO, come here!’Scenario

Owner: ‘AIBO, come here!’AIBO: Tries to find where its owner is.

‘Where are you?’Owner: ‘At the kitchen.’AIBO: Finds the way to the kitchen.

Page 30: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘AIBO, come here!’Required Functions

Map ConstructionWay finding (Search)

BFS, DFS, IDS

Recognizing the door

Page 31: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘AIBO, come here!’Map Construction

ManualOwner manually constructs the map of the house and uploads to AIBO’s memory.

AutomaticAIBO wanders around the house and constructs the map by itself.

Semi-automaticOwner takes AIBO to each place of the house and tells where it is.

Page 32: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘AIBO, come here!’Map Construction

Bedroom1

KitchenLivingRoom

BathRoom

Bedroom2

DiningRoom

FrontDoor

Page 33: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘AIBO, come here!’Door recognition

Tagging the doorsCyberCode

Jun Rekimoto(DARE2000)Gives ID and Orientation

Tagging the path (on the floor)

Page 34: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘AIBO, come here!’

PassThrough(x)

InSourceRoomOf(x) ~InTargetRoomOf(x) Opened(x)

InTargetRoomOf(x)

Start

InSourceRoomOf(x) ~InTargetRoomOf(x) ~Opened(x)

Finish

InTargetRoomOf(x)

Open(x)

~Opened(x)

Opened(x)

Page 35: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘Go, get the newspaper.’Scenarios

‘Go, get the newspaper.’‘Take this to the living room.’‘Take the newspaper to daddy.’‘Turn off the lights.’

Page 36: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘Go, get the newspaper.’Required Functions

Way finding (previously described)

PlanningPhysical Requirements

Make AIBO strong enough to carry small objects. : Design an AIBO basket(tray)?Make AIBO to be able to turn switches on & off. : Humanoids?

Page 37: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘Go, get the newspaper.’STRIPS Operators

MoveTo(x)

~In(x) In(y)

In(x) ~In(y)

Get(x)

~Have(x) In(y)

Have(x)

Put(x)

Have(x)

~Have(x)

Page 38: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

‘Go, get the newspaper.’Start

~In(F) In(L) ~Have(N)

Finish

Have(N) In(L)

Get(x)

~Have(N) In(F)

Have(N)

MoveTo(F)

~In(F) In(L)

In(F) ~In(L)

MoveTo(L)

~In(L) In(F)

In(L) ~In(F)

Page 39: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

ConclusionAIBOCurrently Supported Functions

Simple rule-based behaviorsLearningVoice recognitionFace and object(color) recognition

Page 40: EECE520 A.I. Class Term Projectgun-a-lee.appspot.com/pub/aibo-ppt.pdf · Mimic, Humming, Sing a song Object tracking & Face recognition Take pictures. Functions - AIBO-ware ... R-CODE

ConclusionNewly Suggested Functions

‘AIBO, come here!’Map ConstructionWay finding - Search

‘Go, get the newspaper.’Way finding – SearchPlanning