HAdoop presentation

  • View
    510

  • Download
    1

Embed Size (px)

Transcript

  • HadoopEdit by Cassell Hsu2013.04.19

  • HadoopMasterSlaveSlaveSlave

  • HadoopMasterNameNodeJobTrackerSecondaryNameNode

  • NameNodeWhere is NameNode?MasterHDFS(Hadoop Distributed File System)What is NameNode?

  • NameNode? DataNode

  • DataNodeWhat is DataNodeWhere is DataNodeHDFSSlaves (and Master)

  • UserDataNodeNameNodeDataNodeDataNode128MbB64MbA64MbCheck hdfs-site.xmlB64MbA64Mb

  • HadoopDataNodeNameNodeMasterDataNodeDataNodeDataNodeSlaves

  • HadoopMasterNameNodeJobTrackerSecondaryNameNode

  • JobTrackerWhat is JobTracker?Where is JobTracker?Master

  • JobTracker & TaskTracker

    JobTrackerTaskTrackerWhereMasterSlavesWhat

  • HadoopDataNodeNameNodeMasterDataNodeSlavesJobTrackerTaskTracker

  • HadoopMasterNameNodeJobTrackerSecondaryNameNode

  • SecondaryNameNodeWhat is SecondaryNameNode?NameNodeWhere is SecondaryNameNode?Master

  • HadoopDataNodeNameNodeMasterDataNodeSlavesJobTrackerTaskTrackerSecondaryNode

  • MapReduceUserMasterSlave2Slave1AA1A2TaskNameNodeTaskResult1Result2ReduceFinal Result

  • MapReduceHadoop

    ***