Serverless Machine Learning Workshop

Preview:

Citation preview

[特別企画]  Serverless  Machine  Learning  

Workshop

clda.co/serverless-­‐workshop10/04/2016 東京

@alex_casalboni

clda.co/serverless-­‐workshop Workshop  |  東京

Web  Developer  (6+  years)

Sr.  SoBware  Engineer  @  Cloud  Academy

Master  in  Computer  Science

About  me

What  is  Machine  Learning?

Back  to  1959  (Arthur  Samuel)

How  computers  learn  from  Data

clda.co/serverless-­‐workshop Workshop  |  東京

How  to  solve  decision  problems

Machine  Learning  pipeline

Training Predic6on

batch real-­‐Ame

Feature  extrac6on

batch

data informaPon

features ML  models

clda.co/serverless-­‐workshop Workshop  |  東京

?

Machine  Learning  taxonomy

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

?Machine  Learning  taxonomy

classifica8on

regression 170cm

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

Machine  Learning  taxonomy

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

Machine  Learning  taxonomy

clustering

rule  extrac8on

group A group B

A, B C

Supervised    Learning

Unsupervised    Learning

clda.co/serverless-­‐workshop Workshop  |  東京

What  problems  can  ML  solve  for  you?

Supervised    Learning

Unsupervised    Learning

classifica'on

regression

clustering

rule  extrac'on

?

170cm

gro gro

A, B C

clda.co/serverless-­‐workshop Workshop  |  東京

What  problems  can  ML  solve  for  you?

Supervised    Learning

Unsupervised    Learning

classifica'on

regression

clustering

rule  extrac'on

?fraud  detecPon

170cm

gro gro

A, B C

price  of  a  stock  over  Pme

purchase  likelihood

user  segmentaPon

clda.co/serverless-­‐workshop Workshop  |  東京

LearningDataMachine

Cloud

Big

Science

Information

Internet

Statistics

Technology

Python Future

Mining Social

Deep

IOT

AlgorithmsManagement

Storage Petabytes

Parallel

Network

Privacy

MillionNoSQL

PaaS

SQL

Database

Exabytes

Billion

Dataset

Hadoop

R

clda.co/serverless-­‐workshop Workshop  |  東京

Generated  data  started  growing  ~10  years  ago…

“90%  of  the  data  in  the  world  today  has  been    created  in  the  last  two  years  alone”  -­‐  IBM

“300+  hours  worth  of  video  content  is  being    uploaded  to  the  site  every  minute”  -­‐  Youtube

clda.co/serverless-­‐workshop Workshop  |  東京

…  and  it  keeps  geKng  bigger!

clda.co/serverless-­‐workshop Workshop  |  東京

Big  data  challenges

Manual  exploraPon  is  not  an  opPon

Data-­‐driven  decisions  are  a  must

Distributed/parallel  compuPng

The  curse  of  dimensionality

clda.co/serverless-­‐workshop Workshop  |  東京

clda.co/serverless-­‐workshop Workshop  |  東京

clda.co/serverless-­‐workshop Workshop  |  東京

Why  is  deploying  ML  models  a  challenge?

clda.co/serverless-­‐workshop Workshop  |  東京

Why  is  deploying  ML  models  a  challenge?

1.  Prototyping  !=  ProducPon-­‐ready

2.  We  need  ElasPcity

4.  MulP-­‐model  architectures

3.  Too  many  nice-­‐to-­‐have  features

clda.co/serverless-­‐workshop Workshop  |  東京

5.  Avoid  lack  of  ownership

Machine  Learning  as  a  Service  (MLaaS)

AmazonMachine  Learning

AzureMachine  Learning

GooglePredicAon  API

IMBWatson  AnalyAcs

BigML

Workshop  |  東京clda.co/serverless-­‐workshop

Amazon  Machine  Learning

AmazonML

One  of  the  first  MLaaS  soluPons  (1  year  old)

Great  service  for  classificaPon  and  regression

Only  linear  models  (linear  &  logisPc  regression  +  SGD)

No  support  for  advanced  scenarios  yet  

Workshop  |  東京clda.co/serverless-­‐workshop

Serverless  compuAng  to  the  rescue!

Transparent  scalability,  elasPcity  and  availability

Developer-­‐friendly  maintenance  (versioning  +  aliases)

AWS  Lambda

Event-­‐driven  approach  &  never  pay  for  idle

1  funcPon  =  1  model

A/B  tesPng  via  composiPon

clda.co/serverless-­‐workshop Workshop  |  東京

clda.co/serverless-­‐workshop Workshop  |  東京

Quick  Example

clda.co/ML-­‐Lambda

clda.co/serverless-­‐workshop Workshop  |  東京

Thank  you  for  aZending  :)

cloudacademy.com

Q  &  A

10/04/2016 東京