High Speed Data-transfer Into the Cloud

Younjin Jeong Amazon Web Services

Solutions Architect

60 mins duration,

HDV (DV-format video) 1080i,

needs 3.6MB/sec bandwidth to play at minimum,

13 GB of storage.

Video data transfer rates and disk space requirements

http://documentation.apple.com/en/finalcutpro/usermanual/index.html#chapter=13%26section=3%26tasks=true

What if you need 10000 VODs to start your service?

(130TB)

What if you need to change the format to DVCPRO HD 1080i?

(11.75MB/sec, 41.3 GB per video)

or,

or,

What if you need to transcode every single video to multiple

devices?

(iPhone, Android, iPad, etc.)

http://lolsnaps.com/upload_pic/WithBatmanOnHisTailTheJokerHasMunchToScreamAbout-64848.jpg

Whatever you want to do, the first thing you have to do is

TRANSFER

OK, but how?

What options do I have?

http://www.acmascis.org/images/2011/11/Career-Options.jpg

AWS Services – Direct Connect

1 Gbps

10 Gbps

http://aws.amazon.com/ko/directconnect/

AWS Services – AWS Import / Export

http://aws.amazon.com/ko/importexport/

S3 – Multipart Uploads

Part size – 5M to 5GB

Part number – 1 ~ 10,000

Parallel transfer to S3

Maximize TCP throughput

S3DistCp – AWS region to region (Option 1)

AWS Region - A AWS Region - B

S3 Bucket

Elastic Map Reduce

S3 Bucket

S3DistCp – AWS region to region (Option 2)

AWS Region - A AWS Region - B

S3 Bucket S3 Bucket

Elastic Map Reduce

TusnamiUDP - Open source approach

Develop TsunamiUDP to cluster level

AWS Partners - Aspera

http://cloud.asperasoft.com/news-events/aspera-direct-to-s3/

AWS Partners - riverbed

AWS Marketplace

aws.amazon.com/marketplace

aws.amazon.com/ko