Download pptx - Hadoop 在京东的应用

Transcript

[email protected]

[email protected]

- - -- - - -

- - -- - - -

HDFSsqoopimpalahbaseMapred,hive,R,mahouthueoozie

- HDFSnamenode

- URLYOUNGFULL GC/,HdfshdfsZookeeperHbase///hdfs//

- hive

Jobtrackersmart schedulerReduceNamenodecheckpointDatanodedatanode

-

- - -- - - -

/stormHbase

hadoop/Impala/spark

mysqlhbase/hdfsredis

- -----

-

-

-Geminifs3.0zxzxnkkakkkz/aa1axzzzznknknkknzknnBlockManagerBlockManagerHeartbeat Block replicate checkBlock managementDatanodeDatanodeDatanodeDatanodeNamenodeNamenodeNamenode1StorageNamespace

Thank you!19D39B7T. 028-65057196 F. 028-65057196E. [email protected] www.jd.com


Recommended