My sql cluster_taipei_event

MySQL Cluster 7.2 Web-Scalability with Carrier-Grade Availability

杜修文 Ivan.Tu@Oracle.ComOracle MySQL Sales Consultant

HIGHLIGHTS

Servicing the Most Performance-Intensive Workloads

70x HIGHER complex query performance

Real-Time Analytics Across Live OLTP Data

4x HIGHER per node performance

Reducing TCO

NoSQL Memcached API

Schemaless, Key-Value Data Store

Multi-Site Clustering

Auto-Sharding Between Sites, with Auto-Failover

MySQL CLUSTER MANAGER

Simplifying Provisioning & Maintenance

<Insert Picture Here>

議程

• Databases Are Exciting Again!!!

• MySQL Cluster - What’s New

• Resources to Get Started

MySQL Cluster – 用戶和應用極佳的擴展性，可用度和成本效益比

http://www.mysql.com/customers/cluster/

• Web• High volume OLTP• eCommerce• User Profile Management• Session Management & Caching• Content Management• On-Line Gaming

• Telecoms• Subscriber Databases (HLR / HSS)• Service Delivery Platforms• VAS: VoIP, IPTV & VoD• Mobile Content Delivery• Mobile Payments• LTE Access

讀和寫的擴展力

99.999% 可用性

即時的回應速度

SQL & NoSQL APIs

低總成本，開放平台

Auto-sharding + Multi-master

Transactional, ACID-compliant relational database

Shared-nothing design, no Single Point of Failure

On-Line operations: Scale, Upgrade Schema, etc.

High-load, real-time performance

Predictable low latency, bounded access times

Complex, relational queries + Key/Value Access

MySQL, Memcached, C++, Java, JPA, HTTP / REST

GPL & Commercial editions

Commodity hardware, management & monitoring tools

重要效益

MySQL Cluster 的架構

Data Nodes

Node Group 1

F1

F3

F3

F1

Node 1

Node 2

Node Group 2

F2

F4

F4

F2

Node 3

Node 4

Application Nodes

Cluster Mgmt

Cluster Mgmt

RESTJPA

MySQL Cluster - 極大的容錯能力

Data Nodes

Node Group 1

F1

F3

F3

F1

Node 1

Node 2

Node Group 2

F2

F4

F4

F2

Node 3

Node 4

Application Nodes

Cluster Mgmt

Cluster Mgmt

RESTJPA

對計劃中的維護之處理線上作業

• 擴充 MySQL Cluster 容量 ( 線上增加和移除節點 ) 表的重拆分

• 作業系統的更新和上修復程式• 的更新和線上修復程式• 備份• 以即時，線上的方式更改架構 (Schema)

MySQL Cluster 7.2 GA

• 8 x Commodity Intel Servers• 2 x 6-core processors 2.93GHz • x5670 processors (24 threads

per total)• 48GB RAM• Linux

• Infiniband networking• flexAsynch benchmark

• C++ NoSQL API (NDB API)

Adaptive Query LocalizationScaling Distributed Joins

• 跨伺服器做複雜的查詢• JOINs 推到資料節點• 平行執行 • 傳回單一的結果集到 MySQL

• Opens Up New Use-Cases• Real-time analytics• Recommendations engines• Analyze click-streams

mysqld

Data Nodes

mysqld

AQL

Data Nodes

70x More

Performance

不需因牽就擴充力而犧生功能 !!

Auto-Sharding with High Availability

• 對應用程式是透通的• No need for application-layer sharding logic• Partitioning based on hashing all or part of the primary key• Each node stores primary fragment for 1 partition and back-up fragment for another

在固障移轉，升級和擴增容量以透通的方式維護 不會限制應用系統在 single-shard 的交易

MySQL Cluster 7.2 AQL Test QueryWeb-Based Content Management System

Copyright 2011 Oracle Corporation 19

DataNode1

DataNode2

MySQLServer

Web-Based CMS

Must Analyze tables for best results

mysql> ANALYZE TABLE <tab-name>;

87.23 seconds

1.26 seconds

70x More

Performance

Memcached Key-Value API

持續，可擴展， memcached 的高可用後端• No application changes: re-

uses standard memcached clients & libraries

• 結合快取和資料庫層• 去除 cache invalidation• 更容易重複使用多服務的資料• 改善服務水準

• 具佈署的彈性• 可以 Schema 或 Schema-less

的方式儲存NewNoSQL Access

MySQL 5.5 Server Integration• Configure storage engine per-table

• Choose the right tool for the job• InnoDB: Foreign Keys, XA Transactions,

Large Rows• MySQL Cluster: HA, High Write Rates, Real-

Time

• Reduces Complexity, Simplifies DevOps

• Take advantage of MySQL 5.5• 3x higher performance

• Improved partitioning, diagnostics, availability, etc.

Cross Data Center Scalability

Multi-Site Clustering

• 資料結點分散於多個資料中心• Synchronous replication

and auto-failover between sites

• Improved heartbeating to handle network partitions

• 增加高可用的選項• 不需處理衝突下的主／

主資料庫

Node Group 2

Node Group 1

Data Node 1

Data Node 3

Data Node 2

Data Node 4

Synchronous Replication

Synchronous Replication

主／主的跨區域複製

•跨資料中心複製完整的cluster 資料

• 災備和取用當地資料• 不需要投資於怠機備份

•簡化的主／主複製• 消除應用和架構變更所

需的需求• 以交易為單位倒回

Geographic Replication

Ease of Use

The existence, content and timing of future releases described here is included for information only and may be changed at Oracles discretion. October 3rd, 2011

簡化開通和維護用戶開通和整合

Monitoring & Recovery

High Availability Operation

Automated Management

Reducing TCO and creating a more agile, highly available database environment

MySQL Cluster Manager

Copyright 2011 Oracle Corporation 28

MySQL Cluster Manager 如何發揮效益 ?Example: Initiating upgrade from MySQL Cluster 7.0 to 7.2

• 1 x preliminary check of cluster state• 8 x ssh commands per server• 8 x per-process stop commands• 4 x scp of configuration files (2 x mgmd & 2 x

mysqld)• 8 x per-process start commands• 8 x checks for started and re-joined processes• 8 x process completion verifications• 1 x verify completion of the whole cluster. • Excludes manual editing of each configuration

file.

Total: 46 commands - 2.5 hours of attended operation

Before MySQL Cluster Manager With MySQL Cluster Manager upgrade cluster --package=7.1 mycluster;

Total: 1 Command - Unattended Operation

• Results• Reduces the overhead and complexity

of managing database clusters• Reduces the risk of downtime resulting

from administrator error• Automates best practices in database

cluster management

Copyright 2011 Oracle Corporation 29

MySQL Enterprise Monitor 2.3

Copyright 2011 Oracle Corporation 30

MySQL Cluster in ActionWeb Reference Architectures

Session Management eCommerce

MySQL Master

Content Management

Slave 1

MySQL Master

AnalyticsSlave 2 Slave 3 Slave 4 Slave 5

Slave 6 Slave 7 Slave 8 Slave 9 Slave 10

Slave N

Slave 2

Node Group 2

F2

F4

No

de 3

No

de 4

F2

F4

Node Group 1

F1

F3

No

de 3

No

de 4

F1

F3

MySQL Cluster Data Nodes

MySQL Servers

Node Group 2

F2

F4

No

de 3

No

de 4

F2

F4

Node Group 1

F1

F3

No

de 3

No

de 4

F1

F3

MySQL Cluster Data Nodes

MySQL Servers

Slave 1 Slave 3

Data Refinery Memcache / Application Servers

Distributed Storage

XOR• 4 x Data Nodes: 6k page hits per second• Each page hit generating 8 – 12 database operations

Whitepaper: http://www.mysql.com/why-mysql/white-papers/mysql_wp_high-availability_webrefarchs.php

如何開始

Learn More

Evaluate MySQL Cluster 7.2 Bootstrap a Cluster!

Scaling Web Databases Guide

www.mysql.com/cluster/

Download Todayhttp://www.mysql.com/downloads/cluster/

Download, No Obligationhttps://edelivery.oracle.com/

Copyright 2011 Oracle Corporation 32

總結

Scale Web Services with Carrier-Grade Availability

Don’t Trade Functionality for Scale

Try it out Today!

Copyright 2011 Oracle Corporation 33