1

Template/Gabarit Document ID: FT-006808 v01 / 3400P-W04-R02

Sep 10th 2020

Flash激光雷达和全环境前融合感知解决方案Flash LiDAR, Environmental Raw Data Fusion Perception Solution

Presented by Horry ChengLeddarTech

2

Flash LiDAR – Technology Roadmap

Environmental Raw Data Fusion Perception

LeddarTech Complete Solution

3

A Leader in Environmental Sensing Solutions

for Autonomous Vehicles and Advanced Driver Assistance Systems

Founded in 2007, LeddarTech® has evolved to become a comprehensive end-to-end

environmental sensing and perception solution provider that enables customers to solve

critical challenges across the entire value chain of the automotive and mobility market.

4

IC Product Family

Module Product family

Perception Product Family

An Open, End-to-End Platform

LeddarTech Product Families

LeddarEngine™

Digital LiDAR signal processing

SoC and software

LeddarVision™Advanced perception software platform Passenger

cars

Robotaxis

Autonomous

delivery vehicles

Commercial

vehicles

Autonomous

shuttles

Mobility LiDAR Modules:

5

The Lowest-Cost, Highest-Performance

Solid-State LiDAR Technology

LeddarTech – Total Solution

• Developing and commercializing the

LeddarEngine™ LiDAR platform

(SoC + software libraries)

• Positioned to be the most widely adopted

LiDAR technology that enables customers to

develop cost-optimized, high-

performance solid-state LiDAR (SSL)

sensor solutions

• Open architecture supported by a

deep, broad IP portfolio:

✓ 80 patents, with 52 granted

✓ 14 Generation of SSL technology in volume

production

• M16, IS16, T16, Vu8, LeddarOne,

D-Tec, Pixell

• Next-generation LCA2 & LCA3-based SSL

with announced customer projects

Leddar signal

processing

library &

LiDAR modules

and tools

3D perception

software stack

dataset

infrastructure

Sensor fusion

LeddarCore

SoC, drivers &

eval kits

The Four Pillars of LeddarEngine™

Passenger

carsRobotaxis

Autonomous

delivery vehicles

Commercial

vehicles

Autonomous

shuttles

Enabling ADAS and Autonomous Driving for

6

14 generations of solid-state LiDAR technology in

volume production

• Leddar modules and sensors

• > 40,000 units sold and 40+ million hours of 24/7 operation in

outdoor environments

• Sold to >2k customers worldwide

Open, scalable platform enabling various LiDAR

solutions optimized for ADAS & AD applications

• LeddarEngine LCA2 & LCA3 SoCs & software

LeddarSense perception platform

• Object classification processing

Strong IP in signal acquisition and processing

technology (80 patents / 52 granted)

LeddarTech - A LiDAR Technology Leader Since 2007

INDUSTRY-LEADING STRATEGIC INVESTORS

7

Flash LiDAR – Near & Long-

Term Opportunities

82D LiDAR Applications – Market Unique Horizonal Full Coverage

9Flash LiDAR vs. Point-Scan LiDAR

Point Scan

Flash

1. Pixell水平全覆盖，垂直覆盖率65%

16线机械Lidar FOV覆盖率仅3.4%

2. 极近物体的检测能力

3. Flash全固态技术，更容易过车规

4. 超长MTBF，减少运营期间维护成本

5. 输出数据量少，降低后端CPU算力要求

1.3° beam divergence

0.09° beam divergence

Geolocalization

LiDAR

Redundant /

collision avoidance

LiDAR

10Flash LiDAR – Near-Term Opportunities

Each Market Vertical Encompasses Distinct Product

Requirements and Deployment Timeframes

ADAS/AD Verticals

Passenger CarsRide Hailing

(Robotaxis)

Commercial

VehiclesAutonomous

Shuttles

Autonomous

Delivery Vehicles

L2+/3 - SOP 2021 L2+/3 – Earliest SOP

2021

L4 - Earliest SOP

2024

L4 – Earliest SOP 2022 L4 – Earliest SOP 2024 L4 – Earliest SOP 2020 L4 – Earliest SOP 2020

L5 - Future L5 - Future L5 - Future L5 - Future L5 - Future

Earliest SOP 2020SOP 2022 & after

11

Overview

LeddarEngine™ – SoC & Software Library

Leddar-Based LIDAR

RECEIVER

OPTICS

BEAM-SHAPING

OPTICS

PHOTO-

SENSITIVE

DEVICE

LIGHT SOURCE

BEAM

STEERING

Microcontroller

TIMING

CONTROL

ACQUISITION

PRE-

PROCESSING

FUNCTIONAL

SAFETY

LeddarSP

FUNCTIONAL

SAFETY &

MONITORING

PROCESSING

DATA

MANAGEMENT

LeddarCore

TargetEmitted

laser pulse

Received

laser pulseAPI

CUSTOMER

LIDAR

APPLICATION

LeddarEngine = LeddarCore SoC + LeddarSP Library

CONTROL

HAL

®

HAL = Hardware abstraction layer

API = Application programming interface

12

Conceived for Object Detection and Classification

More than Meets the Eye

LeddarTM Pixell 3D Flash Cocoon LiDAR

• Robust road-ready technology

translating to higher MTBF and

reduced maintenance

• Dependable object and VRU

detection over 180°

• Best-in-class shock and vibration

resistance

• Full fill-factor via flash technology100% solid-state

Zero dead zone

proximity coverageRoad-ready design for

superior durability

13Addressing the Dead Zones

The robust, solid-state Leddar Pixell compensates for the limitations of

mechanical scanning LiDARs which generate blind areas that can reach

several meters.

14Safety Collision Avoidance System

REDUNDANT COLLISION AVOIDANCE SYSTEM

An integral part of the most recent autonomous shuttle designs, the safety redundant perception requires mid-range collision-

avoidance detection to bring the vehicle to a complete stop when the main navigation system is unable to identify an obstacle

or fails. Redundant sensors increase system performance levels, detection rates, and robustness. Ensure a safe operation,

which is of paramount importance in fully autonomous applications involving multiple passengers.

LEDDAR PIXELL AS A SAFETY COLLISION AVOIDANCE SYSTEM

A certain braking distance is required in order to keep deceleration at a

safe level for shuttle passengers, who often do not wear safety belts

and often stand. For example, considering a 3.5 m/s² deceleration

rate, a shuttle moving at the speed of 40 km/h would take 23 meters to

stop, including a 0.5 second reaction time.

Reaction distance Braking distance

Stopping distance

15LeddarTech Full Solid-State LiDAR Solution

(2D Lidar, 100°)(2D Lidar, 100°)

Existing solution 2-year operation

16-line X 3 16-line X 6

New solution 2-year operationLeddar Pixell X 1

M16 X 2

Leddar Pixell X 1

M16 X 2

LeddarTech benefits

No moving parts, MTBF > 148,000 hrs

Collision avoidance (full coverage vs. points coverage)

Lower data amount

SLAM, fusion possible

Significant LiDAR cost saving

SLAM possible

Raw data fusion

environmental model

MTBF: 148,000 hrs

MTBF: 414,000 hrs

+ Camera

3D LiDAR

2D LiDARs

Objects classification

& tracking

16Next-Generation LiDAR

Side view

Top view

Field of view target specs:Up to 90° VFOV

Up to 180° HFOV

Range: 75 m

180°1

80°

VFOV: 90°

Front view

17

Flash LiDAR – Technology

Roadmap

18Flash LiDAR – Long-Term Opportunities

Each Market Vertical Encompasses Distinct Product

Requirements and Deployment Timeframes

ADAS/AD Verticals

Passenger CarsRide Hailing

(Robotaxis)

Commercial

VehiclesAutonomous

Shuttles

Autonomous

Delivery Vehicles

L2+/3 - SOP 2021 L2+/3 – Earliest SOP

2021

L4 - Earliest SOP

2024

L4 – Earliest SOP 2022 L4 – Earliest SOP 2024 L4 – Earliest SOP 2020 L4 – Earliest SOP 2020

L5 - Future L5 - Future L5 - Future L5 - Future L5 - Future

SOP 2022 & after Earliest SOP 2020

19

Proof of Concept Long-Range 3D Flash LiDAR at CES 2019 (Las Vegas, USA)

Long-Range LiDAR

Convention center at ~200m m

Camera picture

20

Diffuser

With 1D Mems Mirror

18

°

60° x 18° FoV

RX-optics

Technology to Further Expand the FoV - Example

21The Auto and Mobility LiDAR Platform

At the heart of the

LeddarTech business model

is the Auto and Mobility

LiDAR Platform

that enables the development

and mass deployment of

ADAS and autonomous

driving solutions

by OEMs.

Platform Video

Product PartnerLeddarEngine Tier-1s

Leddar™ Modules

Architecture, design files,

and documentation

LiDAR development tools Perception

software kitEvaluation kits

LiDAR development

services

ADAS/AD development

services

LeddarEngine-based modules

LeddarEngine™

Core LiDAR software and hardware components: LeddarCore™

SoC and LeddarSP™ digital signal processing software

LiDAR Application and Sensor Development Tools and Services

Qualified Network of Key LiDAR Components, Tools, and Complementary Product Offering

22Passenger Car LiDAR Business Model

Leddar SoC

Laser board

Photodetector

Optics

Beam steering

Electrical

Mechanical

Processors:

LeddarSP™

& perception Tier 1 Car OEM

LiDAR

Manufacturer

23

Environmental Raw Data

Fusion Perception

24

The Lowest-Cost, Highest-Performance

Solid-State LiDAR Technology

LeddarTech – Total Solution

• Developing and commercializing the

LeddarEngine™ LiDAR platform

(SoC + software libraries)

• Positioned to be the most widely adopted

LiDAR technology that enables customers to

develop cost-optimized, high-

performance solid-state LiDAR (SSL)

sensor solutions

• Open architecture supported by a

deep, broad IP portfolio:

✓ 80 patents, with 52 granted

✓ 14 generations of SSL technology in volume

production

• M16, IS16, T16, Vu8, LeddarOne,

D-Tec, Pixell

• Next-generation LCA2 & LCA3-based SSL

with announced customer projects

Leddar signal

processing

library &

LiDAR modules

and tools

3D perception

software stack

dataset

infrastructure

Sensor fusion

LeddarCore

SoC, drivers, &

eval kits

The Four Pillars of LeddarEngine™

Passenger

carsRobotaxis

Autonomous

delivery vehicles

Commercial

vehicles

Autonomous

shuttles

Enabling ADAS and Autonomous Driving for

25LeddarTech Accelerates Delivery of Sensor Fusion & Perception Platform

LeddarTech 收购 VayaVision 以加速提供面向汽车和移动市场的综合开放传感器融合与感知平台

加拿大魁北克省, 2020 年 7 月 7 日 — LeddarTech® 是高级驾驶辅助系统 (ADAS) 和自动驾驶 (AD) 技术领军企业。日前，LeddarTech 宣布收购传感器融合与感知软件企业 VayaVision。LeddarTech 向 1 级和 2 级汽车系统集成商提供开放汽车和移动感知平台支持，包括其基于 LiDAR 的 LeddarEngine™。业界已达成共识，3 级至5 级自动驾驶应用需要使用多个传感器，以及 LiDAR、雷达和摄像头三种传感器的组合。传感器

融合开发会大幅增加客户的产品上市时间、成本和风险。在整合 VayaVision 的技术、产品和专业知识后，LeddarTech

可以通过传感器融合与感知堆栈帮助客户加快他们的产品上市时间，同时减少客户开发成本和风险，该堆栈可以将单一传感器扩展到多传感器组合，并且是跨硬件和操作系统软件的。VayaVision 是一家由 Nehmadi Youval 博士和 Ronny Cohen

于 2016 年在以色列成立的深科技企业，是传感器融合与感知领域的先驱。VayaVision 主要为汽车行业的核心企业提供自动驾驶解决方案，解决了 L2~L5 ADAS（高级驾驶辅助系统）和 AD（自动驾驶）的用例。其团队由机器和电脑视觉以

26Raw Data Fusion vs. Object-Level Fusion

27LeddarVision™ Perception Platform

Fully integrated perception solution

Synchronization and calibration

1

Upsampling

Fusion

3

Localization and ego-motion

Objects tracking & trajectories

Bird’s-eye view occupancy grid

Environmental model

Scene understanding

2

Non-DNN detections

DNN detection and classification

Detection

Innovative platform that combines multiple existing technologies in the world of ADAS/AD

28LeddarVision™ Technology

Fusion Solution Overview

Upsampling is increasing the map depth by up to 10x

LeddarVision upsampling

Original LiDAR sample

LeddarVision enables working with unsynchronized

sensors

⚫ High-density 3D image of the vehicle surroundings from the

camera, LiDAR points, and radar measurements

⚫ The method can be applied for low-density scanning LiDAR,

enabling the use of low-cost LiDAR.

⚫ …so that the various measurements at different times and

locations can be transformed into harmonized data.

LeddarVision synchronization and calibration

⚫ Vehicle’s sensors are currently not synchronized, but in order to

meet industry requirements, synchronization is a key feature…

⚫ Accuracy of the various sensors is ensured through continuous

calibration.

Calibrate, unroll, and match

⚫ LiDAR points not calibrated

and synchronized

(before applying the

LeddarVision algorithm)

⚫ LiDAR points calibrated and

synchronised

(after applying the LeddarVision

algorithm)

29LeddarVision™ Algorithms

Detection, Classification, & Tracking

Detection by

other

algorithms

Unclassified

objects

Detection by

classification

(DNN)

Two independent sets of algorithms which identify potential obstacles using the raw data fusion output

(RGBD model)

Two complementary algorithms enable an architecture for functional safety as well as providing better

detection rates and excelling at the detection of small and unclassified objects.

30LeddarVision™ Environmental Perception Framework

31Pillar #2 – L3 AD

Product Offering: Full Environmental Perception

• Detection, classification, tracking

• 3D bounding boxes

• Position, orientation, velocity

• Drivable area segmentation

• Bird’s-eye-view occupancy grid

• Real-time

32Pillar #2 – L3 AD

Product Offering: Full Environmental Perception

• 360-degree coverage

• Sensor type and configuration agnostic

• HW agnostic

• Harsh environmental conditions

33Pillar #2 – L3 AD

Product Offering: Full Environmental Perception

• Lane detection

• Ego-lane center estimation

• Multi-lane detection

• Lane curvature estimation

34Pillar #2 – L3 AD

Product Offering: Full Environmental Perception

• Robust performance at night time

35Pillar #2 – L3 AD

Product Offering: Full Environmental Perception

• High dynamic range resistance

36Pillar #2 – L3 AD

Product Offering: Full Environmental Perception

• Unclassified obstacle detection

37FuseNet 360 Camera + Radar

LiDAR free perception SW

Detection, classification, tracking

3D bounding boxes

Position, orientation, velocity

Multiple sensors support

Real-time

38

LeddarTech Complete Solution

39

The Lowest-Cost, Highest-Performance

Solid-State LiDAR Technology

LeddarTech – Total Solution

• Developing and commercializing the

LeddarEngine™ LiDAR platform

(SoC + software libraries)

• Positioned to be the most widely adopted

LiDAR technology that enables customers to

develop cost-optimized, high-

performance solid-state LiDAR (SSL)

sensor solutions

• Open architecture supported by a

deep, broad IP portfolio:

✓ 80 patents, with 52 granted

✓ 14 Generation of SSL technology in volume

production

• M16, IS16, T16, Vu8, LeddarOne,

D-Tec, Pixell

• Next-generation LCA2 & LCA3-based SSL

with announced customer projects

Leddar signal

processing

library &

LiDAR modules

and tools

3D perception

software stack

dataset

infrastructure

Sensor fusion

LeddarCore

SoC, drivers &

eval kits

The Four Pillars of LeddarEngine™

Passenger

carsRobotaxis

Autonomous

delivery vehicles

Commercial

vehicles

Autonomous

shuttles

Enabling ADAS and Autonomous Driving for

40

LEDDARTECH HEAD OFFICE

4535 boulevard Wilfrid-Hamel, suite 240

Québec (Québec) G1P 2J7

Canada

leddartech.com

CANADA

USA

AUSTRIA

FRANCE

GERMANY

ISRAEL

ITALY

HONG KONG

CHINA