Hybrid Clouds: EC2/Heroku Calculator

Cloud Hybrids and

Heroku/EC2 Calculator

Marat Zhanikeev [email protected]

maratishe.github.io

2014/11/01

Cloudy＠iizuka

.

maratishe.github.io

What is Cloud?

M.Zhanikeev -- [email protected] Hybrid Clouds: EC2/Heroku Calculator -- bit.do/marat141101 2/44...

2/44

.

maratishe.github.io

Textbook Definitions

• SaaS: Software As A Service

• PaaS: Platform As A Service

• IaaS: Infrastructure As A Service

• ...


3/44

.

maratishe.github.io

Actual Clouds.Cloud is when.........any resouce can be converted into a cloud.

Cloud

• buildings： mostly datacenters (DCs)

• racks, desktops,smarthones： private-publiccloud hybrids

• cities： in frastructurevirtualization


4/44

.

maratishe.github.io

Actual Cloud Structure

• Tier 1: physical (buildings, DCs, etc.)• Tier 2: cloud platforms (Amazon ECs,etc.)

• Tier 3: cloud applications

• ...question: which one is heroku?


5/44

.

maratishe.github.io

What is Cloud? Terminology.

Cloud

• cloudization： to convert somethingto a cloud-like usage

• cloudization = virtualization• virtualization = API• API = blackbox


6/44

.

maratishe.github.io

Cloud = APIs


7/44

.

maratishe.github.io

Anything Cloud is an API

• starting from physical tier, allfunctionality is exported as APIs

• heroku： mostly unknown... built 100%on top of EC2, which means it isnot Tier 2 but Tier 3


8/44

.

maratishe.github.io

Some common APIs

• XCP : top 1 popular cloud platform(Xen Cloud Platform)

• EC2 : Elastic Cloud 2 (EC2 = Virtual

Machine = VM）

• S3 : Storage 3 （Amazon Storage

Service）


9/44

.

maratishe.github.io

git : Source Code Management


10/44

.

maratishe.github.io

What is Source Version Management?

• source management＝version management• a very important concept in software development• very helpful in multi-user/team environments


11/44

.

maratishe.github.io

git vs **

• CVS : the oldest framework◦ very clumsy, the worst thing that it would create a .cvs folder everywhere in the

source tree

• SVN : relaced CVS, biggest change is web interface◦ got better, but one would still find .svn folder everywhere in the source tree

• GIT : the most popular tool today◦ creates .git folder only at root folder◦ very easy and intuitive commands like push and pull


12/44

.

maratishe.github.io

git design

• repo＝repository : a folder atserver side where the keep your stuff

• you can pull (download) and push(upload) your stuff

• development cycle： pull, edit/update/delete some files, then push


13/44

.

maratishe.github.io

GitHub：the Most Popular Git Hosting


14/44

.

maratishe.github.io

GitHub : A small Howto

• First, create a GitHub account (free)◦ to use it over ssh you need to register your public key online

• make a ne wrepository in your account

• work on source code that repo

• you can find commandline references online


15/44

.

maratishe.github.io

Cloud Hybrids


16/44

.

maratishe.github.io

What are the Hybrids

• Today one gets 2 or more options, from different tiers, for any technology

• apps： heroku vs EC2 ← today

• storage： S3 vs Heroku Addon vs BigData storage

• Situation 1： select and use a combination of 2 options (hybrid)

• Situation 2： select one of two options for the same technology (migration)


17/44

.

maratishe.github.io

Specific EC2/Heroku Decision

• decision when making a new new app• heroku > EC2 migration

• EC2 > heroku migration


18/44

.

maratishe.github.io

EC2/Heroku places in the Tiers

• you should remember which tiers EC2and heroku come from


19/44

.

maratishe.github.io

EC2 Basics


20/44

.

maratishe.github.io

AWS Console


21/44

.

maratishe.github.io

AWS/EC2 Console


22/44

.

maratishe.github.io

EC2 : New VM


23/44

.

maratishe.github.io

EC2 : New VM Ready!


24/44

.

maratishe.github.io

EC2 : Run a Web Server

1. Create a new VM in EC2 (you can create one in free account)

2. install PHP (simple mini server)◦ yum remove httpd-* php-*◦ yum install php54

3. in VM firewall open 8001 port for webrequests

4. on VM : create app1 folder and a simpleindex.php inside

5. php -S VM.IP:8001 -t app16. you can find IP via ifconfig


25/44

.

maratishe.github.io

EC2 : Run Many Web Servers?

• use several ports (8001-800x?) createa web server (port, folder) on each

• why many servers? it is exactly thesame thing that heroku does on EC2VMs


26/44

.

maratishe.github.io

Heroku Basics


27/44

.

maratishe.github.io

Heroku (on top of EC2)

• heroku uses a container to isolate apps from eachother◦ 1 app = 1 container◦ isolation is not perfect

• how many? containers would you expect heroku tojam into 1 VM?


28/44

.

maratishe.github.io

heroku = git repo

• now you get why we talked git earlier• on heroku, one deploys apps usinggit

• heroku git = sourcemanagement + deployment

• there is a separate heroku commandwhich one can use to manage scale andruntime performance


29/44

.

maratishe.github.io

heroku vs EC2

• heroku app = web app• when heroku app runs, it is already a webserver

• sourcecode of heroku apps is (mostly) builtaround processing GET/POST requests


30/44

.

maratishe.github.io

heroku : web and workers.heroku apps .....

.

are made from web and workerprocesses

• web : gets 1 port for receiving webrequests

• worker : has no incoming ports, butcan send traffic


31/44

.

maratishe.github.io

heroku scale-out.scale out.....

.

... stands for increasingnumber of runninginstances whne necessary • user sets the scale

• heroku dynamically manages the scalebetween 1 and user setting

• in programming, many instances ofthe same app is not a trivialconcept to get used to


32/44

.

maratishe.github.io

heroku scale-out


33/44

.

maratishe.github.io

heroku : let's see a simple app


34/44

.

maratishe.github.io

EC/Heroku Calculator


35/44

.

maratishe.github.io

EC/Heroku : Formulation

• Situation 1: where to develop newapps

• Situation 2: when to migrateheroku > EC2

• Situation 3: when to migrate EC2> heroku


36/44

.

maratishe.github.io

Heroku Pricing


37/44

.

maratishe.github.io

EC2 Pricing


38/44

.

maratishe.github.io

Several Pricing Considerations

1. pricing : diffs in the tables in two slides above

2. migration : does you app need to migrate instances, data, resouces...?

3. programming： is programming easy, conventional?

4. social (crowds)： need to consider social structure of your user base?

5. data management ： traditional data or need special structure of processing?


39/44

.

maratishe.github.io

Metromap of FeaturesAs Cheap

As Possible

MostlyStatic

HeavyProgramming

OK

Few Users

Unusual Data Design

pricing

migration

programming

social (crowds)

data management

CheaperBetter

Price Doesn’t Matter

MigratesOften

Near ZeroProgramming

Volatile User Base(Flash Crowds)

(always)Many Users

Common Data Structures


40/44

.

maratishe.github.io

Example: Viber


41/44

.

maratishe.github.io

Viber in the MetromapAs Cheap

As Possible

MostlyStatic

HeavyProgramming

OK

Few Users

Unusual Data Design

pricing

migration

programming

social (crowds)

data management

CheaperBetter

Price Doesn’t Matter

MigratesOften

Near ZeroProgramming

Volatile User Base(Flash Crowds)

(always)Many Users

Common Data Structures


42/44

.

maratishe.github.io

OK, Let's Discuss

• Imagine yourself a business (startup,small/big business, etc.)

• define your app as a new train line goingthrough available stations in themetromap

• it is best if you can present astraightforward (calculator) map fordecision-making


43/44

.

maratishe.github.io

That’s all, thank you ...


44/44

Technology

Hybrid Clouds: EC2/Heroku Calculator