30
Numerical Optimization 2016.12.12 김태원

Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Numerical Optimization2016.12.12

김태원

Page 2: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Feature based method1,0kL

1,1kL

1,2kL

1,3kL

1kQ

0, 1kp

1, 1kp

2, 1kp

3, 1kp

1k wO O

kQ

0,kp

1,kp

2,kp

3,kp

kO

1

k

k kT T

• Real case

2

1 0k

1 expk

k kT

, 1,

, 1,

2

, ,

, |

ˆ |

ˆargmin

k k

k

i k k k i

i k k i

i k i k

p Q L Q K R t

p K R t L

p p

Page 3: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Direct method

2 is pixel coordinates

is intensity

is depth

i

ref i

ref i

I

D

p R

p R

p R

ip

ref

iP

i iT P P

ip

2

, ,ref i i ref i

i

E I I D p p p

2

2

2

,ref i i

i

ref i i

i

ref i i

i

E I I

E I I

E I I

p P

p P

p p

ref iD p

Page 4: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Cost functions

, 1,

, 1,

2

, ,

*

, |

ˆ |

ˆ

argmin

k k

k

i k k k i

i k k i

k i k i k

k k

p Q L Q K R t

p K R t L

E p p

E

• Feature based method • Direct method

Find pairMotion

estimationMotion

estimation

2

, 1 , 1argminN

k

i k k i k

i

L T L

* argmin E

2

, ,ref i i ref i

i

E I I D p p p

Page 5: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

5

Page 6: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Goal of Numerical Optimization

* argmin E

E

*

Page 7: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Search Problem

* argmin E

E

0

0E

Page 8: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Two Approaches to Numerical Minimization

1. Gradient Search

2. Gradient-free search

Page 9: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Gradient• Gradient

E

0

0

E

0

3

2

20

3

3

E

E

E

ex)

1 2 3 4 5 6

1 2 3 4 5 6

T

E E E E E E E

• Jacobian

0

2 2 2 2 2 2

1 2 3 4 5 6

1 2 3 4 5 6

0

2 2 2 2 2 2

1 1 1 1 1 1

2 2 2 2 2 2

T

E

E

E

ex)

1

1

E

Page 10: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

= Steepest Descent

Page 11: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Example

2 25 10 25

2 10

E

E

1 ( )

0.1

k k kJ

0

0 0

10E

1

1

0 0.1( 10)

1

1

1 1

8E

2

2

1 0.1( 8)

1.8

2

2 1.8

6.4E

3

3

1.8 0.1( 6.4)

2.44

0 1 2 3

Page 12: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

12

Multi Dimension Example 1

• Update rule1 ( )k k kJ

Page 13: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

13

Multi dimension example 2

• Update rule1 ( )k k kJ

Page 14: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

14

Multi dimension example 3

• Update rule1 ( )k k kJ

Page 15: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

15

Gradient descent problem

• Update rule

1 ( )k k kJ

Page 16: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

1 2 1( ) ( )kk k kJJ

1 ( )k k kJ

Page 17: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

17

Page 18: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

18

Page 19: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

19

Local Minima Problem

Page 20: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

Two Types Gradient-Free Search

• Find Global Minima

• Just Gradient-Free

Page 21: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019
Page 22: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019
Page 23: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

23

Page 24: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

24

Page 25: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

25

Page 26: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

26

Page 27: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

27

Page 28: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

28

Page 29: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

29

Page 30: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019

30

Paper study

• Feature based method

• Direct method

1. Real-time Depth Enhanced Monocular Odometry

2. Lidar Odometry and Mapping in Real-time

4. Large-Scale Direct SLAM with Stereo Cameras

3. LSD-SLAM

5. Semi-Direct Visual Odometry for a fisheye-stereo camera

Tutorial• Frame to frame motion estimation (16.11.14)• Numerical optimization (16.12.12)• Graph SLAM• Loop closure detection