1. Amazon CloudWatch & Auto ScalingAWS Black Belt Tech Webinar 2014 ()

2. 2Agenda Amazon CloudWatch Auto Scaling 3. Amazon CloudWatch 4. 4Amazon CloudWatchAWSWebCloudWatch 5. 5CloudWatch AWS = CPU EC2 CPU60% EC2 Amazon CloudWatch Logs BlackBelt 6. 6CloudWatch CloudWatch EC2 EBS ELB Auto Scaling RDS DynamoDB ElastiCache EMR OpsWorks Redshift Route 53 CloudFront SNS SQS SWF Storage Gateway Billing EC2ELBCPUCreditBalanceCPUCreditUsageCPUUtilizationDiskReadBytesDiskReadOpsDiskWriteBytesDiskWriteOpsNetworkOutNetworkInStatusCheckFailed_InstanceStatusCheckFailedStatusCheckFailed_SystemVolumeIdleTimeVolumeQueueLengthVolumeReadOpsVolumeReadBytesVolumeTotalReadTimeVolumeWriteBytesVolumeWriteOpsVolumeTotalWriteTimeLatencyBackendConnectionErrorsHealthyHostCountUnHealthyHostCountRequestCountHTTPCode_ELB_5XXHTTPCode_Backend_4XXCPUUtilizationFreeableMemorySwapUsageFreeStorageSpaceDiskQueueDepthReadIOPSReadThroughputReadLatencyNetworkReceiveThroughputNetworkTransmitThroughputWriteIOPSWriteThroughputWriteLatencyDatabaseConnectionsBinLogDiskUsageEBSRDS 7. 7CloudWatchi-xxxxxxxxi-xxxxxxxx 8. 8CloudFrontNew!US East (N. Virginia) 9. 9CloudWatch e.g. CPUe.g. 60% 3 OK ALARM INSUFFICIENT_DATA Notification Amazon Simple Notification ServiceSNS HTTP(S)Amazon Simple Queue ServiceSQS Auto Scaling Auto Scaling GroupScaling Policy EC2 EC2Terminate 10. 10CloudWatchCPU70%315AutoScalingGroup 11. 11CloudWatchBillingUS East (N. Virginia) 12. 12 AWS CLIput-metric-dataAPI Toolsmon-put-dataPutMetricDataAPI list-metrics get-metric-statistics HTTP GET8KBHTTP POST40KB1PutMetricData20$ aws cloudwatch put-metric-data metric-name RequestLatency --namespace GetStarted --timestamp 2014-10-28T12:30:00Z --value 87 --unit Milliseconds $ aws cloudwatch put-metric-data --metric-name RequestLatency --namespace GetStarted--timestamp 2014-10-28T12:30:00Z --statistic-value Sum=60,Minimum=15,Maximum=105,SampleCount=5GetStartedRequestLatency 13. 13 get-metric-statistics$ aws cloudwatch get-metric-statistics --metric-name RequestLatency--namespace GetStarted--statistics Average--start-time 2014-10-28T12:30:00Z--end-time 2014-10-28T12:30:00Z--period 300 14. 14 OSCloudWatch Cron 5cron*/5 * * * * ~/aws-scripts-mon/mon-put-instance-data.pl--mem-util --disk-space-util --disk-path=/ --from-cron LinuxWindows Linux http://aws.amazon.com/code/8720044071969977 Windows http://aws.amazon.com/code/7932034889155460 15. 15 EC2UserData CloudWatchputIAM Role User Data EC2CloudWatch#!/bin/shcd /home/ec2-userwget http://ec2-downloads.s3.amazonaws.com/cloudwatch-samples/CloudWatchMonitoringScripts-v1.1.0.zipunzip CloudWatchMonitoringScripts-v1.1.0.ziprm CloudWatchMonitoringScripts-v1.1.0.zipchown ec2-user:ec2-user aws-scripts-monecho */5 * * * * ec2-user /home/ec2-user/aws-scripts-mon/mon-put-instance-data.pl--mem-util --disk-space-util --disk-path=/ --from-cron/etc/crontab 16. 16CloudWatch 2 2get-metric-statistics CloudWatch Logs 1 1AverageMaximumMinimum API 17. 17CloudWatch CloudWatch CloudWatchCloudWatch LogsEC2RDSEC2RDSPingCloudWatchCloudWatchCloudWatchCPUCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchI/OCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatchCloudWatch ELBCloudWatchCloudWatchOKINSUFFICIENT 18. 18CloudWatchCloudWatchAgentAgentCloudWatch AWS CloudWatch CloudWatch Auto Scaling EC2 19. 19CloudWatch EC25 EBSELBRDS1 1010 100API 1 5GB5GB 201410 Tokyo EC21$3.50/ 1$0.50/ 1$0.10/ API1000$0.01Get, List, Puthttp://aws.amazon.com/jp/cloudwatch/pricing/ 20. Auto Scaling 21. 21Auto Scaling EC2 CloudWatchAuto scaling GroupAlarmAuto ScalingElasticLoad BalancingAS 22. 22Auto Scaling ELBWeb SQSElastic Load BalancingSimple Queue ServiceWebAuto Scaling GroupCPUELBRequestAuto Scaling GroupSQS 23. 23NetflixCPUNetflix techbloghttp://techblog.netflix.com/2012/01/auto-scaling-in-amazon-cloud.html 24. 24Auto ScalingAuto Scaling GroupMinCloudWatchAuto Scaling PolicyEC2AMIEC2 25. 25Auto ScalingAuto Scaling GroupMinCloudWatchCloudWatchAutoScalingAutoScaling PolicyGroupAuto Scaling PolicyEC2AMIEC2Launch ConfigurationAutoScalingGroup 26. 26Auto Scaling Group Auto Scaling Group Launch Configuration Maximum Minimum Desired Capacity VPC Availability Zones Health Check Type Health Check Grace Period Load Balancer Termination Policy TagAuto scaling GroupAdd!DesiredcapacityAuto Scalingmin max 27. Auto Scaling GroupEC227Launch ConfigurationPolicyVPCSubnetELB 28. 28Launch Configuration Launch Configuration AMI kernel id RAMDISK ID Block Device Mappings Security group(s) Keypair IAM Profile Spot Price user-data ebs-optimized Detailed MonitoringAuto scaling GroupAdd!Auto ScalingAMI 29. Launch ConfigurationEC229Launch ConfigurationRoleAMI 30. 30Auto Scaling Policy Auto Scaling Group Policy Scaling adjustment Adjustment type ChangeInCapacity: X ExactCapacity: X PercentChangeInCapacity: X% Cooldown periodAuto ScalingPolicyAuto scaling GroupAdd!Auto Scaling/ 31. Auto Scaling PolicyAuto Scaling GroupScaling Policies31 32. 32CloudWatch CloudWatchAuto Scaling ActionAutoScaling GroupAuto Scaling Policy Auto Scaling GroupScaling Policy 33. 33 Auto Healing Min N, Max NNHealthy Auto Scaling Group 34. 34 $ aws autoscaling put-scheduled-update-group-action--scheduled-action-name ScaleUp --auto-scaling-group AUTO_SCALING_GROUP --start-time 2014-10-29T10:00:00Z --desired-capacity 3 cron$ aws autoscaling put-scheduled-update-group-action--auto-scaling-group AUTO_SCALING_GROUP --recurrence 30 0 1 1,6,12 0 --desired-capacity 3 35. 35Auto Scaling Auto Scaling GroupHealthy StatusHealthyMin CloudWatchAuto Scaling Action AutoScaling Policy Auto Scaling Group Max/Min/Desired Capacity Auto Scaling Policy AttachDetach AutoScaling GroupStatusUnhealthy 36. 36 New! EC2Auto Scaling GroupStatusPending EC2Auto Scaling GroupTerminateStatusTerminatingTerminate PendingTerminating60 48 SNSSQS EBS Auto Scaling 60Heartbeat 37. 37 AMI Launch Configurationuser data Auto Scaling Lifecycle HookEC2Hook:PendingAMIHook 38. 38 Terminate Auto ScalingTerminate Termination PolicyTerminate Dynamo DBElastiCache S3S3Hook:TerminatingTerminateDB/TerminateHook 39. 39EC2 Auto ScalingEC2LaunchTerminateStart/Stop Auto Scaling GroupAttachAutoScaling GroupDetach Auto Scaling Group Auto ScalingLaunch Auto Scaling GroupDetach Auto Scaling GroupEC2StandbyGroup LaunchAuto Scaling GroupTerminate 40. 40Auto ScalingAuto ScalingDesiredCapacityAuto Scaling PolicyAuto Scaling PolicyHook:LaunchingHook:TerminatingSNSSQSSNSSQS 41. 41Auto ScalingAttachAuto Scaling GroupStandbyAuto Scaling GroupDetachGroupAuto Scaling GroupTerminate InstanceAuto Scaling GroupTerminateHook:TerminatingSet HealthStandbyUnhealthySNSSQSAuto Scaling Group 42. 42Termination PolicyAuto Scaling GroupTerminate TerminationAZLaunch Configuration Terminate 1 OldestInstance / NewestInstance / Terminate OldestLaunchConfiguration Launch ConfigurationTerminate ClosestToNextInstanceHour Terminate Default 43. 43Auto Scaling Policy Policy EC2CPUELBLatencyRequestHTTP Policydefault cooldown300Policy Policy Policy--no-honor-cooldown Terminate Policy Auto Scaling 44. 44 Auto Scaling CloudWatch EC2 CooldownEC2 Auto Scaling Auto Scaling API/CLIexecute-policyattach-instancesset-desired-capacity ELBPre-Warming AutoScaling set-desired-capacityexecute-policy--no-honor-cooldown 45. 45Auto Scaling Auto Scaling Auto Scaling GroupTerminate Auto Scaling Auto Scaling Policy t2CPUCPU Pre-Warming AutoScaling Auto Scaling 46. 46 Amazon CloudWatch Developer Guide http://docs.aws.amazon.com/ja_jp/AmazonCloudWatch/latest/DeveloperGuide/WhatIsCloudWatch.html Amazon CloudWatch FAQ https://aws.amazon.com/jp/ec2/faqs/#amazon-cloudwatch Amazon CloudWatch http://aws.amazon.com/jp/cloudwatch/pricing/ Auto Scaling http://docs.aws.amazon.com/ja_jp/AutoScaling/latest/GettingStartedGuide/Welcome.html Auto Scaling Developer Guide http://docs.aws.amazon.com/AutoScaling/latest/DeveloperGuide/WhatIsAutoScaling.html Auto Scaling FAQ https://aws.amazon.com/jp/ec2/faqs/#auto-scaling Auto Scaling http://aws.amazon.com/jp/autoscaling/pricing/ 47. 47QA 48. 48Webinar AWS http://aws.amazon.com/jp/aws-jp-introduction/