Upload
kota-tsuyuzaki
View
340
Download
0
Embed Size (px)
Citation preview
Copyright©2017 NTT Corp. All Rights Reserved.
Lightning Talk:OpenStack Swiftの最新機能とStorlets
Kota Tsuyuzaki [IRC: kota_][email protected] Software Innovation CenterOpenStack Storlets Project Team LeadOpenStack Swift Core Team
Copyright(c)2009-2017 NTT CORPORATION. All Rights Reserved.
2Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
OpenStack Swift and OpenStack Storlets
OpenStack Swift: Distributed Object Storage
OpenStack Storlets: Computable Object Storage
Swift Cluster
Storlets Environment UserApplication
Stolrets is computable environment on Swift Object Storage
APP APP APP
4Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
本日のLightning Talk
受かった
落ちた
⇒ こちらを中心にLT
6Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Erasure Coding
REPLICATION
DATA DATA DATA
ERASURE CODING (10:4)
3x
1.4x
DATAPart 2
DATAPart 3
DATAPart 4
DATAPart 5
PARITYPart 1
PARITYPart 2
DATAPart 7
DATAPart 8
DATAPart 9
DATAPart 10
PARITYPart 3
PARITYPart 4
DATAPart 1
DATAPart 6
7Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Problem with Data Centers
Network
DATAPart 5
PARITYPart 1
PARITYPart 2
DATAPart 9
DATAPart 10
PARITYPart 3
PARITYPart 4
DATAPart 2
DATAPart 3
DATAPart 4
DATAPart 7
DATAPart 8
DATAPart 1
DATAPart 6
8Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
1.EC Fragment Duplication
2.Composite Ring
Global Erasure Coding
9Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Global Erasure Coding
DATAPart 2
DATAPart 3
DATAPart 4
DATAPart 5
PARITYPart 1
PARITYPart 2
DATAPart 7
DATAPart 8
DATAPart 9
DATAPart 10
PARITYPart 3
PARITYPart 4
DATAPart 1
DATAPart 6
DATAPart 2
DATAPart 3
DATAPart 4
DATAPart 5
PARITYPart 1
PARITYPart 2
DATAPart 7
DATAPart 8
DATAPart 9
DATAPart 10
PARITYPart 3
PARITYPart 4
DATAPart 1
DATAPart 6
2.8x
10Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
• Multi-Worker Reconstructor
• Increase Part Power
Other Great Staffs on Swift Pike
Reconstructor
worker worker worker
11Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Storlets: Computing on Swift
https://www.openstack.org/videos/sydney-2017/using-storletsdocker-for-large-scale-image-processing
12Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Thank youRepository:https://github.com/openstack/swifthttps://github.com/openstack/storlets
IRC:#openstack-swift @ freenode#openstack-storlets @ freenode
Wiki:https://github.com/openstack/swifthttps://github.com/openstack/storlets
Presenter:[email protected]: kota_
13Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
• Global EC Cluster
• https://specs.openstack.org/openstack/swift-specs/specs/in_progress/global_ec_cluster.html
• https://www.slideshare.net/tsuyuzaki/global-ec-cluster-updates-openstack-mitaka-swift-design-summit
• Storlets
• https://www.slideshare.net/tsuyuzaki/using-storletsdocker-for-large-scale-image-processing
参考資料など: