Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 2
基于内存计算的自助服务大数据分析平台 钟振华 Aaron Zhong Oracle亚太区商务智能及工程系统架构首席顾问
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Oracle Confidential – Internal/Restricted/Highly Restricted 3
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
数据驱动的决策 #1 for execs1
分析 公司增长的关键, 竞争优势2
运营数据驱动决策的公司比不采用的公司运作的更好
1Gartner 2014 CEO Study, CIO Magazine Study 4
2MIT Study “Strength in Numbers”
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 5
4 个继续技术创新的关键
1 2 3 4
6
1
• 不同业务部分,不同时期都有不同的分析需求
• 有的需求时效性要求很高,并需要合并多个数据源
• 需要满足个人,部分和企业多个层面的需求
挑战
Today 完全依赖IT
获取数据 创建/修改ETL 数据验证
加入新数据
需要修改现有的模型 需要充分理解业务 需要和之前的模型整合
IT新的模型
新的报告 新的业务/系统 重要的临时分析
业务新需求
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
自助化信息探索
Oracle Confidential – Internal/Restricted/Highly Restricted 7
用户配置的数据和内容
加入新数据
直观分析可视化 详细记录特征 分享和协作
看见新图示
迅速组建探索应用程序 利用预先构建的导航 开箱即用的搜索
询问新问题
自助服务探索 IT 提供的探索
创新ETL
爬取非结构化数据
更高数据规模
加入新数据
创建先进的分析指标
优化和自定义文本浓缩
更高用户规模
看见新图示
实现深度探索应用程序 基于角色进行交互 高度调优搜索
询问新问题
形式化
发展
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
业务用户能自助服务完成多数据源的联合分析
Oracle Confidential – Internal/Restricted/Highly Restricted 8
易于使用的wizards指导业务用户的数据上传过程
Oracle BI 服务器模型
云和社交服务
个人Excel文件
IT 提供的企业数据
更多数据源包括JDBC,
Oracle BI服务器,JSON,Hadoop,Hive
在几分钟内创建新探索应用程序
随时间逐步增加更多的数据来创建不同的混搭式应
用 自助服务数据聚合和探索仪表板
9
• 自助化连接多数据源
• 无需模型设计
• 快速数据筛选和信息模式探索
方案
Tomorrow
Big Data Discovery
1
10
2
• 同时支持封装的APP和能个性化定制的开发环境
• 支持任何装置,任何形式
• 集成移动设备管理平台
• 使空闲时间的生产与移动见解
移动互联网
Today
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 11
• 在每家商店提高库存可见性实现更高的利润
• 每一个商店经理都能移动接入
• Oracle商务智能基础,移动商业智能和商务智能云服务器
12
2
• 大规模个性化
• 探索模板
• 内容具体的可视化
• 集成映射
• 语音识别和查询
方案
Tomorrow
13
3
• Hadoop,NoSQL和已有数据仓库的集成结合
• 从掌握数据的领先者到使用数据的领袖者
• 保护现有投资,发挥更大价值
更多数据,更多信息
Today
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data SQL 一个能跨越Oracle数据库,Hadoop和NoSQL的统一查询
在RDBMS,
Hadoop 和 NoSQL中
查询数据
Oracle SQL
Oracle
NoSQL DB
HDFS
Data Node
Oracle
NoSQL DB
HDFS
Data Node
Oracle Database
Storage Server
Oracle Database
Storage Server
真正的大数据应用 大规模并行处理
存储索引
本地过滤
最小化数据移动
Oracle Confidential – Internal
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 15
• 顾客 + 会员 + 快速支付
• 电子价目
• 智能工牌
• 二维码查询
• 互动商品组合广告
16
3
• Oracle Big Data Appliance
• Oracle Exadata
• Oracle Exalytics
更多数据,更多信息
Tomorrow
17
4
• 第一个集成内存计算,并为分析应用优化的工程系统
• 快速部署,降低风险,易于扩展
• 拥有最好的总拥有成本
一体机
Today
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle 一体机引领IT技术高端方案
100%
Oracle一体机的每一款产品都有明确的应用场景定位,并且针对Oracle特定软件进行软硬件一体化的优化和集成
6年 2008年Oracle Exadata V1开始,Oracle一体机产品线已经持续发展了6年时间
18 Oracle Confidential – Internal/Restricted/Highly Restricted
Exadata 数据库一体机
Exalogic 中间件一体机
Big Data Appliance
大数据一体机
Exalytics 内存计算一体机
SuperCluster
超级集群
一体机
Oracle
Database
Appliance
入门数据机
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Exalytics
Oracle Confidential – Internal/Restricted/Highly Restricted 19
X2-4
X3-4 X4-4
Upgrade Kit
1 TB RAM
4 Intel® Xeon® E7-4870
40 physical cores total
3.6 TBs of raw disk capacity
40 Gbps InfiniBand – 2 ports
10 Gbps Ethernet – 2 ports
1 Gbps Ethernet – 4 ports
2 TB RAM
4 Intel® Xeon® E7-4870
40 physical cores total
2.4TB PCI Flash
5.4 TBs of raw disk capacity
40 Gbps InfiniBand – 2 ports
10 Gbps Ethernet – 2 ports
1 Gbps Ethernet – 4 ports
2 TB DRAM
4 Intel® Xeon® E7-8895 v2
60 physical cores total
2.4TB PCI Flash
7.2 TBs of raw disk capacity
40 Gbps InfiniBand – 2 ports
10 Gbps Ethernet- 4 ports
Flash Upgrade kit
Memory and Flash
Upgrade kit
T5-8
+ 1TB RAM
+ 2.4 TB PCI Flash
+ bigger disks
+ Super-SKU CPU
+ even bigger disks
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Exalytics X4-4 集成系统
硬件 • 内存
– 2 TB DRAM, upgradable to 3TB
• 处理器
– 4 Intel® Xeon® E7-8895 v2, 60 cores total
• 网络
– QDR 40 Gbps InfiniBand
– 10 Gbps Ethernet
• 存储
– 2.4TB PCI Flash, upgradable to 4.8TB
– 7.2 TBs of raw disk capacity
软件 Oracle BI Foundation Suite
Oracle EPM
Oracle Endeca Information Discovery
Exalytics 唯一的集成特性:
– OBIEE Accelerator
– Essbase Accelerator
– In-Memory Data Caching
– BI Publisher Accelerator
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
独有的处理器: Intel® Xeon® E7-8895 v2 in Exalytics X4-4
Oracle Confidential – Internal/Restricted/Highly Restricted 21
挑战:
核数和主频的矛盾
方案:
“秘密武器” - 专门针对Oracle产品的工作量而设
计的处理器
方案:
主频灵活 2.8GHz to 3.6GHz
方案:
主频和核数可以为特定用例进行配置
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
技术创新 – 内存引擎
Oracle Confidential – Internal/Restricted/Highly Restricted 22
Database In-Memory Option • 100%技术透明 • 热点数据自我识别
Essbase In-Memory Enhancements • 支持更复杂的分析 • 支持更多的用户并发 • 支持更快的交互访问
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Database In-Memory Option Powering Business Analytics
Oracle Confidential – Internal/Restricted/Highly Restricted 23
• 全面内存计算 • 透明采用 • 满足任意数据量 • 最佳的成本效益 • 健壮,成熟,设计安全
Σ Data
Warehouse
100% Data In‐Memory
• 任意数据仓库
• 任意数据量
只有Exalytics能自动识别热点数据
• 更智能的可视化和使用体验 • 更佳支持移动访问 • 更快的决策 • 更多活跃用户 • 减少调优成本
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Exalytics: Fast Path to In-Memory Business Analytics Powered by 12c DB In-Memory Option
• Adaptive In-Memory Cache
– Superfast Interactive exploration and visualization
– Data mart automation with Oracle Business Intelligence
• No change to existing systems of record In-Memory Data
Cache Design
Infrastructure Management
Business Analytics Integration
Data Synchronization
In-Memory Data Cache Design
Infrastructure Management
Business Analytics Integration
Data Synchronization
• Fast Path to realize the value of memory computing
• Less Risk to adapt new technology
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Essbase In-Memory Enhancements
Oracle Confidential – Internal/Restricted/Highly Restricted 25
Dilemma:
• More performance enhancement requirements for calculation in BI and planning
• Support More BI and planning users
• Consolidate Essbase with BI/planning appliction
Solution:
• Essbase becomes “Pure” in-memory engine as calculation will no longer wait for I/O (background write)
Solution:
• Improved Resource management and CPU utilization
– Thread management and thread based memory allocation
– Fundamental improvement to Essbase infrastructure, will impact resource consumption, stability and performance.
– Execute any FIX commands in parallel
Solution :
• BSO MDX Bottom up calculation by ASO like dynamic aggregation in BSO
• Leverage X4-4 capabilities by improving scalability
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
What’s Coming
Oracle Confidential – Internal/Restricted/Highly Restricted 26
Project Visual Analyzer
• In-memory data sub-setting
• MOLAP Acceleration
ASK/Mobile
• In-memory Indexing
• Better scaling for mobile
User Data Management
• In-memory personal data store
• In-memory execution for mashups
• Optimized BI Server internal execution
HFM Certification
• HFM on Linux is coming with EPM PS4
• Certified to run on Exalytics
• Both bare metal and OVM configurations
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 27
• 为企业和专业人士提供全球领先的智能信息源
• 为全球用户提供高度互动的仪表盘和可视化平台
• 采用Oracle Exalytics云服务器,性能提升90倍
28
4
• Oracle数据库12C内存选件
• Essbase内存中查询增强
• 容量按需扩展
• Hyperion财务管理认证
• 商务智能云服务器
Exalytics
Tomorrow
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 29
创建新一代大数据分析平台
• 个性自助化
• 移动分析
• 大数据集成
• 内存计算