SEOUL | Oct.7, 2016 IMPLEMENTATION OF DEEP LEARNING … · 2016-10-17 · NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE. 12 5. DEEP LEARNING FOR ALPR (2) C++ based library: good for integrating

SEOUL | Oct.7, 2016

RhD / CEO 강현인, Oct.7, 2016

IMPLEMENTATION OF DEEP LEARNING ALPR IN TK1

10.57 cm

2

AGENDA

1. Jetson TK1 module

2. Expanded Peripherals

3. ALPR requirement I/O

4. ALPR Procedure

5. Deep Learning for ALPR

6. Image Samples in Real Environment

7. Performance in Deep Learning

8. GUI Application

3 NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE.

1. JETSON TK1 MODULE NVIDIA JETSON TK1


2. EXPANDED PERIPHERALS EMBEDDED BOARD


3. ALPR REQUIREMENT I/O (1) CLCU (CAMERA LENS CONTROL UNIT)


3. ALPR REQUIREMENT I/O (2)

주차관제 시스템 구성


4. ALPR PROCEDURE (1)

ALPR Conventional Approach

IMAGE ACQUISITION

RoI based iris control

PREPROCESSING

Contrast Enhancement




LP DETECTION

Find coarse position of LP

LP NORMALIZATION

Find fine-position of LP

Apply affine transform to make LP into rectangle




LP TYPE RECOGNITION

Classify the type of LP

CHARACTER SEGMENTATION

Find coarse position of character

CHARACTER RECOGNITION

Recognize each character

8,4,마,7,4,1,4



LP DETECTION

Find the position of LP

LP RECOGNITION

Recognize whole characters at once

84마7414

IMAGE ACQUISITION

RoI based iris control

ALPR End-to-End Approach of Deep Learning


5. DEEP LEARNING FOR ALPR (1)

“CNN in object detection & recognition

Deep convolutional neural network already exceeds human-level accuracy of

detection. And, still the advance in CNN is ongoing.”

FASTER R-CNN(2015) YOLO(2016) SINGLE SHOT MULTIBOX DETECTOR(SSD, 2016)

What makes the difference

with Convolutional Neural Network and Deep Learning



C++ based library: good for integrating with existing system.

Caffe Model Zoo: You can get lots of pre-trained models for free including some of latest paper’s works which are not officially published yet.

And, Nvidia’s DIGITS supports Caffe!

You can train/test a Caffe model with just few clicks and a little bit of typing using DIGITS’ GUI

Deep learning framework: Caffe / DIGITS



1. Get lots of training data.

2. Design a model for your task.

3. Train the model and evaluate your model with DIGITS.

4. Go back to 3 until you are satisfied with your test result.

5. Write a code for applying the trained model on your product using Caffe’s library (C++ or Python).

6. Watch how it works in real world!

Deep learning development process with Caffe & DIGITS


6. IMAGE SAMPLES IN REAL ENVIRONMENT (1) <인식 영상>


6. IMAGE SAMPLES IN REAL ENVIRONMENT (2) <미인식 영상>


7. PERFORMANCE IN DEEP LEARNING


8. GUI APPLICATION (1)

RECOGNITION



RECOGNITION



SPC CONFIG



CAMERA



LOG



CENTER

SEOUL | Oct.7, 2016

THANK YOU

Documents

SEOUL | Oct.7, 2016 IMPLEMENTATION OF DEEP LEARNING … · 2016-10-17 · NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE. 12 5. DEEP LEARNING FOR ALPR (2) C++ based library: good for integrating