1. Hadoop40 Cloudera 20131171

2. AboutMe email:kawasaki@cloudera.com twi>er:@kernel023 2 3. Hadoop 11 (?) Cloudera Eric Sammer 4. Cloudera Impala PDF Cloudera John Russell HadoopHBaseHadoop Hive Cloudera Cloudera World Tokyo 5. 5 Hadoop 6. Hadoop8 7. STRUCTUREDDATA20%BIGDATA != SIZE 9 8. 2011 90% 50500x1000 2STRUCTUREDDATA20%10 9. 11 10. CiscoSystems2013/512 11. 13 12. 14 13. 90% 15 14. 16 15. Q. 17h>p://www.jackhagley.com/lter/personal/896192 IftheTwi>ercommunitywas100people... h>p://www.ickr.com/photos/25541021@N00/3706760751/ 16. A. 18 17. A. 19 Photo:KrisKrug h>p://www.ickr.com/photos/kk/9240320949/ 18. 20 19. 21 20. 22 21. CPU -> CPU 23 22. -> 24 23. 25 24. 26 25. Hadoop Google27 26. 28 27. Google 29 28. ApacheHadoop Google DougCu^ng ChiefArchitect@Cloudera 30 29. ApacheHadoop 32 30. ApacheHadoop HDFS Yahoo!350PBFaceBook100PB 1MapReduce- 33 31. Hadoop 341 32. 72.165.33.132--[04/Nov/2013:21:57:09+0900]"GET/category/nance 28.114.157.122--[04/Nov/2013:21:57:09+0900]"GET/item/sports/2605 52.93.117.198--[04/Nov/2013:21:57:09+0900]"GET/category/electron 168.90.228.205--[04/Nov/2013:21:57:09+0900]"POST/search/?c=Music 28.42.27.49--[04/Nov/2013:21:57:09+0900]"GET/category/electronic 192.120.64.138--[04/Nov/2013:21:57:09+0900]"GET/category/books?f 156.189.222.57--[04/Nov/2013:21:57:09+0900]"GET/category/network 164.219.215.208--[04/Nov/2013:21:57:09+0900]"GET/category/books 84.42.208.90--[04/Nov/2013:21:57:10+0900]"GET/item/somware/3186 164.39.210.117--[04/Nov/2013:21:57:10+0900]"GET/item/garden/4484 196.144.35.85--[04/Nov/2013:21:57:10+0900]"GET/item/electronics/ 80.78.35.71--[04/Nov/2013:21:57:10+0900]"GET/item/electronics/35 80.174.161.70--[04/Nov/2013:21:57:10+0900]"GET/category/gardenH 192.186.87.52--[04/Nov/2013:21:57:10+0900]"GET/category/gamesHT 132.186.183.184--[04/Nov/2013:21:57:10+0900]"GET/item/somware/3 212.27.25.133--[04/Nov/2013:21:57:10+0900]"GET/item/electronics/ 32.21.118.159--[04/Nov/2013:21:57:10+0900]"GET/category/electron 56.99.155.75--[04/Nov/2013:21:57:10+0900]"GET/category/booksHTT 196.63.29.59--[04/Nov/2013:21:57:11+0900]"GET/category/gamesHTT 24.87.189.150--[04/Nov/2013:21:57:11+0900]"GET/category/somware3872.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/A168.90.228.205--[04/Nov/ 28.42.27.49--[04/Nov/201 192.120.64.138--[04/Nov/72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/A156.189.222.57--[04/Nov/2 164.219.215.208--[04/Nov/ 84.42.208.90--[04/Nov/20 72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/ 164.39.210.117--[04/Nov/ 196.144.35.85--[04/Nov/2 80.78.35.71--[04/Nov/201A 33. 72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/168.90.228.205--[04/Nov/ 28.42.27.49--[04/Nov/201 192.120.64.138--[04/Nov/156.189.222.57--[04/Nov/2 164.219.215.208--[04/Nov/ 84.42.208.90--[04/Nov/20164.39.210.117--[04/Nov/ 196.144.35.85--[04/Nov/2 80.78.35.71--[04/Nov/20139 34. 72.165.33.132--[04/Nov/2013:21:57:09+0900]"GET/category/nance 28.114.157.122--[04/Nov/2013:21:57:09+0900]"GET/item/sports/2605 52.93.117.198--[04/Nov/2013:21:57:09+0900]"GET/category/electron 168.90.228.205--[04/Nov/2013:21:57:09+0900]"POST/search/?c=Music 28.42.27.49--[04/Nov/2013:21:57:09+0900]"GET/category/electronic 192.120.64.138--[04/Nov/2013:21:57:09+0900]"GET/category/books?f 156.189.222.57--[04/Nov/2013:21:57:09+0900]"GET/category/network 164.219.215.208--[04/Nov/2013:21:57:09+0900]"GET/category/books 84.42.208.90--[04/Nov/2013:21:57:10+0900]"GET/item/somware/3186 164.39.210.117--[04/Nov/2013:21:57:10+0900]"GET/item/garden/4484 196.144.35.85--[04/Nov/2013:21:57:10+0900]"GET/item/electronics/ 80.78.35.71--[04/Nov/2013:21:57:10+0900]"GET/item/electronics/35 80.174.161.70--[04/Nov/2013:21:57:10+0900]"GET/category/gardenH 192.186.87.52--[04/Nov/2013:21:57:10+0900]"GET/category/gamesHT 132.186.183.184--[04/Nov/2013:21:57:10+0900]"GET/item/somware/3 212.27.25.133--[04/Nov/2013:21:57:10+0900]"GET/item/electronics/ 32.21.118.159--[04/Nov/2013:21:57:10+0900]"GET/category/electron 56.99.155.75--[04/Nov/2013:21:57:10+0900]"GET/category/booksHTT 196.63.29.59--[04/Nov/2013:21:57:11+0900]"GET/category/gamesHTT 24.87.189.150--[04/Nov/2013:21:57:11+0900]"GET/category/somware40 72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/A72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/ 72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/AA 35. -MapReduce MapJOBTask 72.165.33.132--[04/Nov/ 28.114.157.122--[04/No 52.93.117.198--[04/Nov/Task 168.90.228.205--[04/Nov/ 28.42.27.49--[04/Nov/201 192.120.64.138--[04/Nov/Task 156.189.222.57--[04/Nov/2 164.219.215.208--[04/Nov/ 84.42.208.90--[04/Nov/20Task 164.39.210.117--[04/Nov/ 196.144.35.85--[04/Nov/2 80.78.35.71--[04/Nov/20145 36. -MapReduce ReduceTask72.165.33.132,1 72.165.33.132,1 72.165.33.132,1 72.165.33.145,1168.90.228.205,1 168.90.228.205,1 192.120.64.138,1156.189.222.57,1 156.189.222.57,1 164.219.215.208,1164.39.210.117,1 164.39.210.117,1 164.39.210.118.146 37. -MapReduce OKTaskB TaskA72.165.33.132,1 72.165.33.132,1 72.165.33.132,1 72.165.33.145,1TaskB 168.90.228.205,1 168.90.228.205,1 192.120.64.138,1TaskC 156.189.222.57,1 156.189.222.57,1 164.219.215.208,1TaskD 164.39.210.117,1 164.39.210.117,1 164.39.210.118.147 38. 48 39. Q.Hadoop A. 49 HDFS MapReduce SQL 40. Q.Hadoop ClouderaWorld2013 h>p://h>p://www.cloudera.co.jp/jpevents/cwt2013/Clouderah>p://www.cloudera.com/content/cloudera/en/resources/library.html? category=cloudera-resources%3Awhy-cloudera%2Fwhite-papers&q= Strata+HadoopWorld h>p://strataconf.com/stratany2013/ 50 41. Q.Hadoop 2011915 5125 (2013/7/17) 42. A. http://cloudera.co.jp/university Hadoop HBase Hadoop Hadoop Hadoop Hadoop HBase Cloudera h>p://enterprisezine.jp/arxcle/corner/220/52 43. Q.Hadoop 53 44. A.SQLHadoop - Hive - Cloudera Impala54 45. A.GUIHadoopGUI Cloudera Hue Cloudera Manager55 46. A.GUIHadoopGUI Cloudera Hue Cloudera Search 56 47. ClouderaEnterprise5(ComingSoon) 57 48. ClouderaEnterprise Hadoop CDH(ClouderasDistribuxonincludesApacheHadoop) ClouderaImpala,Hue,Hive,.Cloudera Manager CDH CDH/Cloudera Manager Cloudera QuickStart VM: http://bit.ly/1966hRW 58 49. HadoopCloudera Team 20118 20128 100% 90% 80% 70%60%2350%270107240% 30% 20% 10%29270%Source:ApacheApacheSomwareFoundaxon59Cloudera MapR IBMHortonWorks EMC 50. ClouderaManager5(60 51. ClouderaManager5(61 52. 63 53. Hadoop HadoopCloudera Enterprise65 54. WeareHiring! Cloudera Hadoop Hadoop info-jp@cloudera.com 66 55. WeareHiring!67 56. Thankyou!TatsuoKawasaki,Manager/SeniorInstructor,ClouderaK.K@kernel023