TDC2016SP - Trilha NoSQL

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |

Oracle NoSQL DatabaseOverview & Use CasesOracle Open World LAD 2016

Gustavo CastilhosBig Data Solutions SpecialistJun/2016


Agenda

Overview & Use Cases

Oracle’s Big Data & NoSQL Strategy

Technical Features

Customer References

2


Agenda



Technical Features

Customer References

3


• Real time event processing• Sensor data acquisition/IoT• Fraud detection and prevention• Real time recommendations• Globally distributed databases• Social networks and online gaming

Main reasons for enterprises adopting NoSQL:• Low cost• Performance• Scalability• Flexibility

Why use a NoSQL database?

4

Fonte: Oracle, 2013


• Real time event processing• Sensor data acquisition/IoT• Fraud detection and prevention• Real time recommendations• Globally distributed databases• Social networks and online gaming

Why use a NoSQL database?

5


• What an enterprise-class database should have:– Security– Durability– Transactions support– Hardware certifications– Integration between technologies– Means of administration– Reliable support

• Common characteristics of NoSQL databases:– Few security features– Performance X Durability– No hardware certification– No “out-of-box” integration tools– Complex API’s– Support by niche companies

The Challenges

6

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 7

An Enterprise-Class NoSQL DatabaseOracle NoSQL

Text

CoreDatabase

Functionality

Application Developer Friendly

Software Manageability

• Predictable, low latency• Highly available• Highly scalable

• Administrator friendly (IT)• Strong Integration• Enterprise-grade support

• Multiple high level API’s

• Simple, flexible schemas


Agenda



Technical Features

Customer References

8


Choose the RIGHT storage option for the jobHadoop Distributed File System

(HDFS) Oracle NoSQL Database Oracle Database

File System Key-Value Database Relational Database

No inherent structure Simple data structure Complex data structures, rich SQL

High volume writes High volume random reads and writes High volume OLTP with 2-PC

Limited functionality, roll-your-own applications

Simple get/put high speed storage, flex configuration

Security, Backup/Restore, Data life cycle mgmt, XML, etc.

Batch Oriented Real-Time, web-scale specialized applications

General purpose SQL platform, multiple applications, ODBC, JDBC



10

Reference Architecture

ActionableEvents

DataLake

Data Factory DataWarehouse

BI andReporting

Discovery Lab

ActionableInformation

ActionableInsights

Data Streams

Execution

Innovation

Discovery Output

Events & Data

Enterprise Data

Web & Social Data

Event Engine

Model FirstAnalytics

• Reporting-oriented• Often enterprise wide

in scope, cross LoB• “you know the

questions to ask”

Reports & Dashboards

Data FirstAnalytics

• Data Exploration• Highly visual and/or

interactive• “you don’t know the

questions to ask”

Discovery

• Telematics• Industry Services• Internet of Things• Sentiment

DataServices



11

Reference Architecture

ActionableEvents

DataLake

Data Factory DataWarehouse

BI andReporting

Discovery Lab

ActionableInformation

ActionableInsights

Data Streams

Execution

Innovation

Discovery Output

Events & Data

Enterprise Data

Web & Social Data

Event Engine

Model FirstAnalytics

• Reporting-oriented• Often enterprise wide

in scope, cross LoB• “you know the

questions to ask”

Reports & Dashboards

Data FirstAnalytics

• Data Exploration• Highly visual and/or

interactive• “you don’t know the

questions to ask”

Discovery

• Telematics• Industry Services• Internet of Things• Sentiment

DataServices


RDBMS

Integrating the best of breedOracle Big Data SQL

One fast SQL query, on all your data, in parallelSQL


Agenda



Technical Features

Customer References

13


Logical ArchitectureLinear scaling and replication

14

• Elastic Auto Sharding (split, add, contract)

Store

• Writes to elected node with flexible durability

• Reads from any node in shard

Expand and Rebalance

Shard

M

R

R

Shard

M

Shard

R

R

R R

Application

NoSQL Driver

M

Shard

R

R

M• Auto re-balance of data on expansion


Data Center Support• Availability Zones

• Flexible configuration• Primary Zones

– Durability guarantees– Low latency writes, HA

• Secondary Read-Only Zones– Asynchronous replication– Analytic workloads– Report generation

• Topology Aware Client Driver• Provides business continuity and distributed

workload management

15

DC1 DC2 DC3

PrimaryZones

ReportsBatch Analytics


Smart Topology Management

• Efficient disk usage• No I/O bottlenecks• Smart cache sharing• Automatic switchover• Bigger cluster, lower TCO

16

Shard

M

Shard

R

R

R R

Application

NoSQL Driver

M

Shard

R

R

M

Server #2

Server #1

Server #3


Configurable Consistency vs Availability• Greater Flexibility

– Configurable • Durability per operation• Consistency per operation

– ACID by default– Transactions may be composed of

multiple read/write operations

17


Complex data. Simple management.Flexible Data Model

advanced key-value database

Compound Primary key & Shard keyAutomatic data sharding & local indexingRange queries on any indexed field

1. JSON structures, Tables, Arrays, Maps2. BLOB’s, Multimedia3. Graph structures


Oracle NoSQL Database Cloud Service

DriverApplication


Agenda



Technical Features

Customer References

24


NoSQL for Flight Test Analysis

• Objectives:– Have a scalable and highly available storage for flight test sensor data– Allow simultaneous data ingestion and analysis

• Solution:– Oracle NoSQL database

• High speed storage and range based extraction of time series data• Agile, flexible schema, easily integrated with the existing application

– Oracle Big Data Appliance: efficient manageability and lowest TCO– Integration with Hadoop and RDBMS for post processing

Large scale sensor data acquisition and processing

Airbus


NoSQL for Flight Test Analysis

• Benefits– Increase scalability of data storage– Deliver higher concurrency between

data analytics and ingestion– Scale-out data loading independently

from analysis– Enterprise-grade support for mission

critical system– 750K key inserts/sec, 6TB/hour

Large scale sensor data acquisition and processing

Big Data Appliance

NoSQL DB Driver

Event Ingestion and Extraction

Oracle and/or third parties SQL/Data Analytics Tools

Airbus

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Confidential 29

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Confidential 30


Safe Harbor StatementThe preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.


Education

TDC2016SP - Trilha NoSQL