54
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. AWSマイスターシリーズ Instance Store(Ephemeral Disk) & Elastic Block Store 2014.1.29 アマゾン データサービス ジャパン株式会社 プリンシパル ソリューションアーキテクト 荒 靖宏 ソリューションアーキテクト 平 毅 re:Generate

[AWSマイスターシリーズ] Instance Store & Elastic Block Store

Embed Size (px)

DESCRIPTION

 

Citation preview

  • 1. re:G ene rate AWS Instance Store(Ephemeral Disk) & Elastic Block Store 2014.1.29 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

2. Agenda ! ! ! ! Instance Store (Ephemeral Disk Elastic Block Store 2 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 3. 3 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 4. ! AWS1. Simple Queue Service 2. Instance Store 3. Elastic Block Store(EBS) 4. AWS Storage Gateway 5. Amazon Simple Storage Service(S3) 6. Amazon Glacier 7. Amazon ElastiCache 8. Amazon SimpleDB 9. Amazon DynamoDB 10.Amazon Relational Database Service(RDS) 11.Amazon Redshift 12.Amazon Kinesis44 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 5. EC2Instance Storage ElastiCacheEBSStorage GatewayS3SimpleDBDynamoDBRDSGlacier kinesisSQSYesSQL NoSQL5Redshift5 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 6. AWS1. Simple Queue Service 2. Instance Storage 3. Elastic Block Store(EBS) 4. AWS Storage Gateway 5. Amazon Simple Storage Service(S3) 6. Amazon Glacier 7. Amazon ElastiCache 8. Amazon SimpleDB 9. Amazon DynamoDB 10.Amazon Relational Database Service(RDS) 11.Amazon Redshift 12.Amazon KinesisEC2 6 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 7. EC2 EC2 EC2 i-SCSIEphe meral Disk EC2 () (Instance 7 )Stored CachedStorage GatewayVTL EBS Provisioned IOPS IOPS EBSEBS Standard S3GlacierWEB 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 8. AMI AMI (Amazon Machine Image EC2 Instance Store- Backed AMIEBS- Backed AMI(2009) EC2/ 8 EC2 EC2 EC2 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 9. Root DeviceInstance Store ! EC2 Describe Root Device Type Instance Store! AMI AMI Root Device Type instance storeShow/Hide Root Device9 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 10. Instance Store Ephemeral Disk10 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 11. Instance StoreEC2 /dev/xvdf EC2/dev/xvdg! EC2 EC2 HDD/SSD ! ! (Stop) [Reboot) EC211 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 12. Instance Store Ephemeral Disk ! Instance Store EC ! Ephemeral DiskInstance Store Volume ! EC2 EC2EC2 EC2 OSOSOS Instance Store Ephe meral12Ephe meralInstance Store Ephe meralEphe meral EC2 Ephe meralInstance Store Ephe meralEphe meral EBSEC2 EBSEphe meral 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 13. EC2 Instance Store ! EC2Instance Store Instance Type m1.small m1.medium m1.large m1.xlarge m2.xlarge m2.2xlarge m2.4xlarge m3.medium m3.large m3.xlarge m3.2xlarge t1.micro c1.medium c1.xlargeInstance Store Volumes 1 x 160 GB 1 x 410 GB 2 x 420 GB (840 GB) 4 x 420 GB (1680 GB) 1 x 420 GB 1 x 850 GB 2 x 840 GB (1680 GB) 1 x 4 GB SSD 1 x 32 GB SSD 2 x 40 GB SSD (80 GB) 2 x 80 GB SSD (160 GB) None(use Amazon EBS volumes) 1 x 350 GB 4 x 420 GB (1680 GB)Instance Type2014129 Instance Store Volumesc3.large c3.xlarge c3.2xlarge c3.4xlarge c3.8xlarge cc2.8xlarge cg1.4xlarge cr1.8xlarge hi1.4xlarge hs1.8xlarge i2.xlarge2 x 16 GB SSD (32 GB) 2 x 40 GB SSD (80 GB) 2 x 80 GB SSD (160 GB) 2 x 160 GB SSD (320 GB) 2 x 320 GB SSD (640 GB) 4 x 840 GB (3360 GB) 2 x 840 GB (1680 GB) 2 x 120 GB SSD (240 GB) 2 x 1024 GB SSD (2048 GB) 24 x 2048 GB (49 TB) 1 x 800 GB SSDi2.2xlarge2 x 800 GB SSD (1600 GB)i2.4xlarge i2.8xlarge4 x 800 GB SSD (3200 GB) 8 x 800 GB SSD (6400 GB)13 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 14. Instance Store EC2 WindowsC: EBSD: OS E:EBSEphe meral 14 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 15. Instance Store ! EC21Instance Store EC2EBS ! Oracle RAC EC2:N EBS:1EC2:1 EBS:NRegion Availability Zone - a15Ephe meralRegion Availability Zone - aEphe meralN EC2 Ephe meral 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 16. Instance Store EC2 Instance StoreElastic Block StoreAvailability Zone - aAvailability Zone - aEC2 EBS RootEphe Meral DataEC2EBS RootEC2EC2EBS RootEBS Root Detach EBS DataAttach16 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 17. Instance Store ! AMIStep 4 Add StorageType Instance Store! CLI-b ephemeral N $ec2-run-instances ami_id b /dev/xvda=ephemeral0 -b /dev/xvdb=ephemeral1and b /dev/xvdc=ephemeral217 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 18. EC2Ephemeral Disk ! EC2Instance Store AMI Change Instance Type AMIm1.large Ephemeral Disk m1.large Ephemeral Disk 18m1.large2 Ephemeral Disk EC2 EC2 EBS RootEphe MeralEphe MeralEC2 EBS Ephe Ephe Root Meral Meral 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 19. Instance Store ! Instance StoreEC2 ! Ephemeral DiskOS ! m1.large 420GEpheral Disk 2 2 840GOS 1EC2 m1.large OSEphe Meral 420GOS 840GEphe Meral 420G19 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 20. Instance Store ! Instance Store OS Device NameInstance2014129/dev/sda1, /dev/ root (/) xvda1, /dev/xvde1 WindowsC: /dev/sda2,xvdbm1.smallc1.medium /mmt/media/ephemeral1 /dev/sda3, /dev/ m1.smallc1.medium xvda3, /dev/xvde3 OS Linux /dev/sdb, xvdbM1.smallc1.medium /mnt /media/ephemeral120 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 21. ! AWS ! t1.microc1.mediumLinux 900MB SwapOn (Amazon Linux ) 21 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 22. Ephemeral Disk Block Device Mapping ! EC2Block Device MappingEphemeral Disk ! AMI Ephemeral Disk RootEC2AMIInstance Store Elastic Block Store 22 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 23. EC2Ephemeral Disk Block Device Mapping ! EC2 Linux $GET http://169.254.169.254/latest/meta-data/block-device-mapping/Windows >WGET http://169.254.169.254/latest/meta-data/block-device-mapping/Ephemeral Disk 23 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 24. Instance StoreAMI ! Create ImageAMIInstance Store AMIInstance Store EBS24 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 25. Ephemeral Disk Cloudwatch ! EC2EC2Disk Metric EBSEBSDisk Metric ! Ephemeral Disk EBSVolumeMetric25 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 26. Hi Storage Instance Instance Store HS1 (hs1.8xlarge)HPC HDDInstance Store 35 ECU 16core 117GiB RAM 2TB x 24 Local HDD201412948TB Instance Store MBRead Write2.6 GB / Cluster Compute 26 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 27. HI1 Instance Instance Store HI1 (hi1.4xlarge)I/OHPC SSD(Instance Store) 35 ECU 16core 60.5 GB RAM 1TB x 2 Local SSDCluster Compute2014129Instance Store Read 2 GB / Write 1.1 GB/ IOPS SSD PVLinux Block Size : 4KB , Randam Read 120,000 IOPSWrite 10,000 85,000 IOPS HVM()Linux,Windows Block Size : 4KB , Randam Read 90,000 IOPS 27 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not beWrite 9,000 75,000 IOPS of Amazon.com, Inc. copied, modified or distributed in whole or in part without the express consent 28. I2 Instance Instance Store I2 I/O SSD(Instance Store) IOPS Linux Kernel 3.8 4KB 2014129 SizeEC UsvCP UsMemo ry (GiB)Instance Storage (GiB)EBSOptimiz edRead IOPSFirst Write IOPSNetwork Performancei2.xlarge14430.51 x 800 (SSD)Yes35,00035,000Moderatei2.2xlarge278612 x 800 (SSD)Yes75,00075,000Highi2.4xlarge53161224 x 800 (SSD)Yes175,000155,000Highi2.8xlarge104322448 x 800 (SSD)-365,000315,00010 Gigabit28 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 29. C Instance Instance Store C3 CPU SSD(Instance Store)2014129 SizeECUsvCPUsMemory (GiB)Instance Storage(GiB)EBSOptimizedNetwork Performancec3.large723.752 x 16 (SSD)-Moderatec3.xlarge1447.52 x 40 (SSD)YesModeratec3.2xlarge288152 x 80 (SSD)YesHighc3.4xlarge5516302 x 160 (SSD)YesHighc3.8xlarge10832602 x 320 (SSD)-10 Gigabit29 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 30. M3 Instance Instance Store M3 CPU EBS SSD(Instance Store) 2014129 SizeECUsvCPUsMemory (GiB)EBSOptimizedInstance Storage (GiB)Network Performanc em3.medium313.751 x 4 (SSD)-Moderatem3.large6.5271 x 32 (SSD)-Moderatem3.xlarge134152 x 40 (SSD)YesModeratem3.2xlarge268302 x 80 (SSD)YesHigh30 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 31. Elastic Block Store Update31 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 32. Amazon Elastic Block Store Region Availability Zone - aAvailability Zone - bEC2EC2EBSEBSEBSEBSEBS SnapshotAmazon Simple Storage Service (S3)EBSEBSEC2 ! 1GB1TB ! //IO ! EC2EBS ! ! (AZ) ! EC2 ! EBS (AZ)32 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 33. EBS ! EBS ! EBSEC2 OS ! EBS OSEBS1 SCSI EC2 OS EBS 33SnapshotEBS 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 34. EBS ! EBSS3 2S3 AZEBS AZ EBS34 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 35. Snapshot Copy ! Snapshot RegionRegionRegion ! EBSMarketPlaceVM importAMIStorageGateway RDSRedshiftAMI (2014129) Create Image from EBS snapshotLinuxAMI Region : BRegion : A Availability Zone - aAvailability Zone - bInternetEBSSnapshot Copy35SnapshotAvailability Zone - aAvailability Zone - bEBSCreate EBS from SnapshotCreate AMIAMIfrom Snapshot 2012 Amazon.com, Inc. and Snapshot All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. its affiliates. Copy 36. EBSProvisioned IOPS! IOPSEBS ! EBS-Optimized ! VolumeStandardPIOPS ! IOPS10040001 (40002000) ! Root VolumeEBSPIOPS ! OSEBS ! EC2 ! 20TB, 10,000IOPS Volume Type Provisoned IOPSIOPS Input Output per Second 1I/O DISK1 1 IOPS36 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 37. EC2EBS-Optimized Instance! EBS ! 500Mbps2000Mbps 2000MbpsHPC1000Mbps ! Standard EBS ! EBS-Optimized Instance Provisioned IOPSI/ O ! EBS-Optimized-Instance EBSEC2normal PIOPS EBSPIOPS EBSEC2Net workEBS PIOPS EBSEC2EBS- OptimizedPIOPS EBSEC2 Net work37 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 38. PIOPSEBS-Optimized EBS-optimizedEC2 EBS-optimized EBSEC2normal EBSEC2Net work EBS- OptimizedIOEC2 P IOPS 38Net workPIOPSEBS-optimized PIOPS EBSnormal EBSEC2 PIOPSEBSPIOPS EBSEC2Net workPIOPSEBS-OptimizedEC2EBS- OptimizedIO PIOPS EBSPIOPS EBSEC2 Net work 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 39. EBS Optimized ! EBS Optimized EC2 ! EBS Optimized 2000Mbps 2014129Instance Type c1.xlarge1,0008,000c3.xlarge5004,000c3.2xlarge1,0008,000c3.4xlarge2,00016,000g2.2xlarge1,0008,000i2.xlarge5004,000i2.2xlarge1,0008,000i2.4xlarge2,00016,000m1.large5004,000m1.xlarge1,0008,000m2.2xlarge5004,000m2.4xlarge39Dedicated EBS Max 16K IOPS Throughput (Mbps)*1,0008,000m3.xlarge5004,000 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.m3.2xlarge1,0008,000 40. Elastic Block Store ! 20142EBS Standard Volume ! 20142EBS 1 1GB $0.12$0.085-29.1%/100 I/O $0.12$0.085-29.1%100G 100G0.85 0.85 0.85 8.5=25.5112 100G200G8.58.51/30/24=8.51240 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 41. Provisioned IOPS EBS Snapshot2 IOPS S3 Snapshot EBSI/OPIOPSIOPS EBS I/OCloudwatchIostat 20GG 10I/O $12 CSVI/O 1510I/O $12 ( 24G 22G 20G 4PIOPS 100IOPS PIOPS 1000.12=$12 2.2 2.4 2 15200IOPS PIOPS 2000.1215/30$12 41 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 42. 42 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 43. EBS ! ! ! ! OSDB / I/O RegionEBSEBS SnapshotRegionS3 EBS43 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 44. EBS ! Provisioned IOPSEC2 14000IOPS 16KBIOPS10% 99.9%! EBS-Optimized Instance EC2EBS Provisioned IOPSEC2OptimizedP-IOPS44 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 45. Instance Storage S3 ! ! ! ! 1 ! SSDIO ! Instance StorageS345 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 46. Ephemeral Disk / ! Windows Bitlocker (Microsoft Secure Cloud(TrendMicro) SafeNet ProtectV (SafeNet) Crypt Setup(OSS)! FS DRBD(OSS) ClusterPro (NEC) GlusterFS (OSS) Redhat Storage Server (Redhat)EC2disk EC2disk46 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 47. ! () ! OS(Linux,Windows):Fio Oracle Databese: Oracle ORION Microsoft SQLserver SQLIO ! 47 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 48. EC2EBS Instance Store AZ EC2 Availability Zone - aEC2 EBS RootBackup DataEphe Meral DataElastic Block Store AZ EBS Availability Zone - aEC2 EBS RootEBS DataSnap Shot48 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 49. Ephemeral Disk ! Ephemeral Disk ! AMI EC2 EC249EBS RootEphe Meral Data EC2 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 50. ! EC2EC2 ! S3 Availability Zone - aEC2EBS Root50Availability Zone - bCLIS3 Sync EC2Ephe Meral DataEphe Meral DataEBS RootOS S3 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 51. Storage Gateway ! Storage GatewayEC2OS 1) Ephemeral , 2)EBS PIOPS , 3) EBS Standard , 4) S3 OS Storage GatewayEC2 OSEBS Root EBS RootEBS EBS Cache UploadEphe EBS EBS Meral Data Data SSD) PIOPS Stan Data dard51 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 52. ! Instance Store (Ephemeral Disk)t1.micro SSD ! Root VolumeEBS Instance Store (Ephemeral Disk) ! Instance Store (Ephemeral Disk) S3 52 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 53. Appendix-1 ! Ephemeral Disk http://docs.aws.amazon.com/ja_jp/AWSEC2/latest/ UserGuide/ InstanceStorage.html#StorageOnInstanceTypes Elastic Block Store http://docs.aws.amazon.com/ja_jp/AWSEC2/latest/ UserGuide/AmazonEBS.html53 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc. 54. Appendix-2 ! EBS Optimized Instance () http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ EBSOptimized.html HI1 Instance () http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ storage_instances.html HS1 Instance ( http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ high_storage_instances.html I2 Instance http://aws.amazon.com/jp/glacier/pricing/54 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.