Download pptx - Doing More with Postgres - Yesterday's Vision Becomes Today's Reality

© 2013 EDB All rights reserved 8.1. 1

Postgres EvolutionsMarc Linster


Who is EDB?

Market forces

It’s happening – in the cloud

It’s happening – Postgres powers ERP

It’s happening – Not Only SQL

It’s happening – platform coexistence

Agenda


PostgreSQL

Postgres Plus Advanced Server Postgres Plus

Cloud

• 180+ employees

• Global presence

• Focused on serving needs of enterprise, government and ISV markets

• Platinum Sponsor of PostgreSQL

Who is EDB?


Market forces influence direction (PG Europe 2013)

Easy to use / deployHigh-end Enterprise

Requirements

PostgreSQL is growing from the “middle-out”

New Workloads/Platforms (Big Data, NoSQL & Cloud)


Marketplace Demand – Next Five Years

• Diagnosing Problems

• Configuring for success

• Still easier installs

• Tighter integration with frameworks

• Integration with other data stores

• Very simple in the cloud

• Vertical Scale (parallel query)

• Horizontal Scale

• Performance Diagnostics

• Incremental Backup

• Integration with other data stores

• Zero down time upgrades

• Liasons with other communities

• FDW for common no-SQL DB’s

• Continue to evolve new datatypes: JSON, XML, HStore

Easy to use / deployHigh-end Enterprise

Requirements

New Workloads & Platforms (Big Data/No/SQL/Cloud)


2011 2012 2013 2014 2015 2016 2017

Cloud PaaS/Data-base Man-age-ment Sys-tems ($M)

16.782520811416

27.866271886559

41.953764745096

58.719498532526

81.968896561826

114.45115358714

148.990476267072

10

50

90

130

Cloud PaaS/DBMS ($M)

• Cloud PaaS has the highest growth rate 35%+ (according to Gartner Group)

• EDB‘s Postgres Plus Cloud Database at AWS confirms this− Easy installation− Elastic and scalable− Automatic failover− PITR− VPC− ….

Postgres: Cloud – It’s Happening

05

1015202530354045

PPCD New Cluster# Growth/June – Sept’13

Source: Gartner 2013 Forecast: Public Cloud Services, Worldwide, 2011-2017, 3Q13 Update

© 2014 EnterpriseDB Corporation. All rights reserved. 7

• Infor LN (formerly Baan ERP) supported on Postgres Plus Advanced Server

Joint announcement by Infor, Red Hat & EDB - April 2014

• Part of the Infor Open Source Initiative

Postgres powers ERP

“We can deliver a better experience with open source because it is open enough to allow us to configure a seamless experience with our applications with fewer licensing and distribution restrictions. We can easily

move images between on premise and cloud as customer needs dictate.”

- Charles Philips, CEO, Infor


Infor LN/Postgres Stack

Red Hat Enterprise Virtualization

Red Hat Enterprise Linux

Postgres Plus

EDB OCL

libpq

LN / Infor Ming.le

LN VM + DB Driver

LN UI

Presentation Tier•Red Hat JBoss•Apache Tomcat

Application Tier•LN VM + LN DB Driver

Database Tier•Postgres Plus Advanced Server

Operating System Tier•Red Hat Enterprise Linux•Red Hat Enterprise Virtualization


Performance (250 Concurrent Users)

Postgres –87.4 transactions/user,

15 minutes

Proprietary RDBMS –

88 transactions/user,15 minutes0%

20%

40%

60%

80%

100%

120%

EnterpriseDB

Proprietary RDBMS

Limit

Normalized Transaction Times – 90th percentile(smaller is better)

Its happening! Postgres powers ERP!


Postgres + Documents (JSON) + KVP (HSTORE) = Best possible NoSQL solution

It’s happening – Not only SQL


• SQL databases can’t handle NoSQL data types− Postgres can (JSON and KVP)

• SQL databases are too slow and can’t ingest the data fast enough− Postgres can keep up

− We ran the tests− Benchmarks are public− Great feedback

• SQL databases can’t support Web 2.0 development approaches− Postgres can

− Support unstructured and structured data in the same environment− Move data from unstructured to structured (and back)− Use Web 2.0 languages inside the database (e.g.: PL/V8) or in the

application (node.js)− Integrate NoSQL data (FDW)

Standard Objections


• Goal− Help our customers understand when to chose Postgres and when to

chose a specialty solution− Help us understand where the NoSQL limits of Postgres are

• Setup− Compare Postgres 9.4 to Mongo 2.6− Single instance setup on AWS M3.2XLARGE (32GB)

• Test Focus− Data ingestion (bulk and individual)− Data retrieval

JSON Performance Evaluation


Performance Evaluation

Generate 50 Million JSON Documents

Load into MongoDB 2.6

(IMPORT)

Load into Postgres 9.4

(COPY)

50 Million individual INSERT commands

50 Million individual INSERT commands

Multiple SELECT statements

Multiple SELECT statements

T1

T2

T3


NoSQL Performance Evaluation

Data Load Insert Select Size0%

50%100%150%200%250%300%350%400%450%500%

276% 295%

465%

208%

Mongo DB 2.4/Postgres 9.4 Relative Performance Compar-ison (50 Million Documents)

PostgresMongoDB

Postgres MongoDB

Data Load (s) 4,732 13,046

Insert (s) 29,236 86,253

Select (s) 594 2,763

Size (GB) 69 145

Correction to earlier versions:

MongoDB console does not allow for INSERT of documents > 4K. This lead to truncation of the MongoDB size by approx. 25% of all records in the benchmark.

Thank you Alvaro Tortosa!


• Initial tests confirm that Postgres’ can handle many NoSQL workloads

• The test scripts are publically available https://github.com/EnterpriseDB/pg_nosql_benchmark

• EDB encourages community participation tobetter define where Postgres should be used and where specialty solutions are appropriate

• Join us to discuss the findings at http://bit.ly/EDB-NoSQL-Postgres-Benchmark

Performance Evaluations – Next Steps

https://github.com/EnterpriseDB/pg_nosql_benchmark

https://github.com/EnterpriseDB/pg_nosql_benchmark

http://bit.ly/EDB-NoSQL-Postgres-Benchmark


• Postgres Extended Document Type Developer Kit

• Provides end-to-end Web 2.0 example – all sources included

• Deployed as free AMI

• First Version− Postgres 9.4 (beta)

w. HSTORE and JSONB

− Python, Django, Bootstrap, psycopg2 and nginx

• Next Version: PL/V8 & Node.js

• Final Version: Ruby on Rails

PG XDK – Showcase Postgres & Web 2.0 Development

AWS AMI PG XDK v0.2 - ami-1616b57e


• Select PG XDK v0.2 - ami-1616b57e on the AWS Console

• Use https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#LaunchInstanceWizard:ami=ami-1616b57e

• Works with t2.micro (AWS Free Tier)

• Remember to enable HHTP access in the AWS console

Installing PG XDK

https://console.aws.amazon.com/ec2/v2/home?region=us-east-1%23LaunchInstanceWizard:ami=ami-1616b57e

https://console.aws.amazon.com/ec2/v2/home?region=us-east-1%23LaunchInstanceWizard:ami=ami-1616b57e


• FDW implements SQL/MED ("SQL Management of External Data")

• FDW− Makes data on other servers (or services) look like tables in Postgres− available for databases (MongoDB, MySQL, Oracle, …), files,

services (Twitter, …)

• MongoDB FDW: https://github.com/EnterpriseDB (a collaboration with CitusDB)

• The list: https://wiki.postgresql.org/wiki/Foreign_data_wrappers

Foreign Data Wrappers – Co-Existence Platform

https://github.com/EnterpriseDB

https://github.com/EnterpriseDB


• Has great deployment flexibility – start in the cloud, land in the data center

• Powers ERP workloads successfully

• Is the most flexible and most capable NoSQL (Not only SQL) operational database solution out there

• Outperforms key NoSQL-only solutions in important workloads

• A great platform for Web 2.0 applications

Conclusion – It’s happening

Do more with Postgres!


The Sky is the Limit!