25
[特別企画] Serverless Machine Learning Workshop clda.co/serverlessworkshop 10/04/2016 東京

Serverless Machine Learning Workshop

Embed Size (px)

Citation preview

Page 1: Serverless Machine Learning Workshop

[特別企画]  Serverless  Machine  Learning  

Workshop

clda.co/serverless-­‐workshop10/04/2016 東京

Page 2: Serverless Machine Learning Workshop

@alex_casalboni

clda.co/serverless-­‐workshop Workshop  |  東京

Web  Developer  (6+  years)

Sr.  SoBware  Engineer  @  Cloud  Academy

Master  in  Computer  Science

About  me

Page 3: Serverless Machine Learning Workshop

What  is  Machine  Learning?

Back  to  1959  (Arthur  Samuel)

How  computers  learn  from  Data

clda.co/serverless-­‐workshop Workshop  |  東京

How  to  solve  decision  problems

Page 4: Serverless Machine Learning Workshop

Machine  Learning  pipeline

Training Predic6on

batch real-­‐Ame

Feature  extrac6on

batch

data informaPon

features ML  models

clda.co/serverless-­‐workshop Workshop  |  東京

Page 5: Serverless Machine Learning Workshop

?

Machine  Learning  taxonomy

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

Page 6: Serverless Machine Learning Workshop

?Machine  Learning  taxonomy

classifica8on

regression 170cm

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

Page 7: Serverless Machine Learning Workshop

Machine  Learning  taxonomy

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

Page 8: Serverless Machine Learning Workshop

Machine  Learning  taxonomy

clustering

rule  extrac8on

group A group B

A, B C

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

Page 9: Serverless Machine Learning Workshop

What  problems  can  ML  solve  for  you?

Supervised    Learning

Unsupervised    Learning

classifica'on

regression

clustering

rule  extrac'on

?

170cm

gro gro

A, B C

clda.co/serverless-­‐workshop Workshop  |  東京

Page 10: Serverless Machine Learning Workshop

What  problems  can  ML  solve  for  you?

Supervised    Learning

Unsupervised    Learning

classifica'on

regression

clustering

rule  extrac'on

?fraud  detecPon

170cm

gro gro

A, B C

price  of  a  stock  over  Pme

purchase  likelihood

user  segmentaPon

clda.co/serverless-­‐workshop Workshop  |  東京

Page 11: Serverless Machine Learning Workshop

LearningDataMachine

Cloud

Big

Science

Information

Internet

Statistics

Technology

Python Future

Mining Social

Deep

IOT

AlgorithmsManagement

Storage Petabytes

Parallel

Network

Privacy

MillionNoSQL

PaaS

SQL

Database

Exabytes

Billion

Dataset

Hadoop

R

clda.co/serverless-­‐workshop Workshop  |  東京

Page 12: Serverless Machine Learning Workshop

Generated  data  started  growing  ~10  years  ago…

“90%  of  the  data  in  the  world  today  has  been    created  in  the  last  two  years  alone”  -­‐  IBM

“300+  hours  worth  of  video  content  is  being    uploaded  to  the  site  every  minute”  -­‐  Youtube

clda.co/serverless-­‐workshop Workshop  |  東京

Page 13: Serverless Machine Learning Workshop

…  and  it  keeps  geKng  bigger!

clda.co/serverless-­‐workshop Workshop  |  東京

Page 14: Serverless Machine Learning Workshop

Big  data  challenges

Manual  exploraPon  is  not  an  opPon

Data-­‐driven  decisions  are  a  must

Distributed/parallel  compuPng

The  curse  of  dimensionality

clda.co/serverless-­‐workshop Workshop  |  東京

Page 15: Serverless Machine Learning Workshop

clda.co/serverless-­‐workshop Workshop  |  東京

Page 16: Serverless Machine Learning Workshop

clda.co/serverless-­‐workshop Workshop  |  東京

Page 17: Serverless Machine Learning Workshop

Why  is  deploying  ML  models  a  challenge?

clda.co/serverless-­‐workshop Workshop  |  東京

Page 18: Serverless Machine Learning Workshop

Why  is  deploying  ML  models  a  challenge?

1.  Prototyping  !=  ProducPon-­‐ready

2.  We  need  ElasPcity

4.  MulP-­‐model  architectures

3.  Too  many  nice-­‐to-­‐have  features

clda.co/serverless-­‐workshop Workshop  |  東京

5.  Avoid  lack  of  ownership

Page 19: Serverless Machine Learning Workshop

Machine  Learning  as  a  Service  (MLaaS)

AmazonMachine  Learning

AzureMachine  Learning

GooglePredicAon  API

IMBWatson  AnalyAcs

BigML

Workshop  |  東京clda.co/serverless-­‐workshop

Page 20: Serverless Machine Learning Workshop

Amazon  Machine  Learning

AmazonML

One  of  the  first  MLaaS  soluPons  (1  year  old)

Great  service  for  classificaPon  and  regression

Only  linear  models  (linear  &  logisPc  regression  +  SGD)

No  support  for  advanced  scenarios  yet  

Workshop  |  東京clda.co/serverless-­‐workshop

Page 22: Serverless Machine Learning Workshop

Serverless  compuAng  to  the  rescue!

Transparent  scalability,  elasPcity  and  availability

Developer-­‐friendly  maintenance  (versioning  +  aliases)

AWS  Lambda

Event-­‐driven  approach  &  never  pay  for  idle

1  funcPon  =  1  model

A/B  tesPng  via  composiPon

clda.co/serverless-­‐workshop Workshop  |  東京

Page 23: Serverless Machine Learning Workshop

clda.co/serverless-­‐workshop Workshop  |  東京

Page 24: Serverless Machine Learning Workshop

Quick  Example

clda.co/ML-­‐Lambda

clda.co/serverless-­‐workshop Workshop  |  東京

Page 25: Serverless Machine Learning Workshop

Thank  you  for  aZending  :)

cloudacademy.com

Q  &  A

10/04/2016 東京