18
Copyright © CELLANT Corp. All Rights Reserved. h t t p : / / w w w . c e l l a n t . j p / 1 1 自宅でHive愛を育む方法 Raspberry Pi20131223 株式会社セラン R&D戦室 須幸憲

自宅でHive愛を育む方法 〜Raspberry Pi編〜

Embed Size (px)

DESCRIPTION

 

Citation preview

  • 1. Hive Raspberry Pi 20131223 R&D Copyright CELLANT Corp. All Rights Reserved. 1 http://www.cellant.jp/
  • 2. vHadoop Advent Calendar 2013 23 l http://qiita.com/advent-calendar/2013/hadoop vHiveserver2 Copyright CELLANT Corp. All Rights Reserved. 2 http://www.cellant.jp/
  • 3. v@sudabon) v R&D v l 19972004 NEC / l 20052006 BIGLOBE / BtoB l 2012/8 vHadoop1 vHadoopHive Copyright CELLANT Corp. All Rights Reserved. 3 http://www.cellant.jp/
  • 4. Copyright CELLANT Corp. All Rights Reserved. 4 http://www.cellant.jp/
  • 5. Raspberry Pi vRaspberry PiARM v v25A35B2 Copyright CELLANT Corp. All Rights Reserved. 5 http://www.cellant.jp/
  • 6. Raspberry Pi Model A Model B $25 $35 SoC Broadcom BCM2835 (CPU, GPU, DSP, SDRAM) CPU 700 MHz / ARM1176JZF-S (ARM11 ) GPU Broadcom VideoCore IV, OpenGL ES 2.0 (24 GFLOPS) 1080p 30fps H.264/MPEG-4 AVC High Prole , MPEG-2, VC-1 (SDRAM) 256MB (GPU) 512MB (GPU) USB 2.0 1 2(USB) 10/100 Mbps RJ45 8 GPIO, UART, IC, SPI2, +3.3 V, +5 V, Copyright CELLANT Corp. All Rights Reserved. 6 http://www.cellant.jp/
  • 7. Raspberry Pi Copyright CELLANT Corp. All Rights Reserved. 7 http://www.cellant.jp/
  • 8. Raspberry Pi Copyright CELLANT Corp. All Rights Reserved. 8 http://www.cellant.jp/
  • 9. Raspberry Pi Copyright CELLANT Corp. All Rights Reserved. 9 http://www.cellant.jp/
  • 10. v l Raspberry Pi(Model B)2 l SD(16GB)2 l Ethernet2 l 100Mbps SW Hub1 v l HDMI l TV l USB l USB Copyright CELLANT Corp. All Rights Reserved. 10 http://www.cellant.jp/
  • 11. TaskTracker JobTracker Hiveserver DataNode HiveMetastore SecondaryNameNode TaskTracker NameNode DataNode Copyright CELLANT Corp. All Rights Reserved. 11 http://www.cellant.jp/
  • 12. Hive v 1. 2. 3. 4. 5. 6. 7. OS(Raspberian) OS(Raspberian) Java Hadoop / Hive / v l HiveRaspberry Pi http://www.slideshare.net/sudabon/how-toworkhiveonraspberrypi Copyright CELLANT Corp. All Rights Reserved. 12 http://www.cellant.jp/
  • 13. HiveBench v l Hadoop1.2.1 l Hive0.12.0 l HiveBench101 10000uservisits 1200rankings l SequenceFile v l SELECTJOIN l 1 v l http://www.slideshare.net/sudabon/how-toworkhiveonraspberrypi/16 Copyright CELLANT Corp. All Rights Reserved. 13 http://www.cellant.jp/
  • 14. v v 101 MapReduce Jobs Launched: Job 0: Map: 2 Reduce: 1 Cumulative CPU: 138.59 sec HDFS Read: 2027641 HDFS Write: 11399 SUCCESS Job 1: Map: 1 Reduce: 1 Cumulative CPU: 25.65 sec HDFS Read: 11863 HDFS Write: 10119 SUCCESS Job 2: Map: 1 Reduce: 1 Cumulative CPU: 25.39 sec HDFS Read: 10583 HDFS Write: 30 SUCCESS Total MapReduce CPU Time Spent: 3 minutes 9 seconds 630 msec OK 64.109.226.120 0.9987925 37.0 Time taken: 991.129 seconds, Fetched: 1 row(s) Copyright CELLANT Corp. All Rights Reserved. 14 http://www.cellant.jp/
  • 15. v Raspberry PiHadoop Hive v Raspberry Pi Hive v 512MB Hive Copyright CELLANT Corp. All Rights Reserved. 15 http://www.cellant.jp/
  • 16. vRaspberry Pi vHive Copyright CELLANT Corp. All Rights Reserved. 16 http://www.cellant.jp/
  • 17. vHadoop Advent Calendar Hive(@tagomoris) v Copyright CELLANT Corp. All Rights Reserved. 17 http://www.cellant.jp/
  • 18. Hive Copyright CELLANT Corp. All Rights Reserved. 18 http://www.cellant.jp/