Grid Engine State of the Union

Grid Engine “State of the Union”

Evolve Save money Get more value Accelerate

Who is Univa?

•  Data Center Automa4on Experts •  Based in Chicago, global reach •  Dras4c growth Y/Y in 2011 & 2012

•  # of customers, bookings, etc •  Unique Posi4oning – Home of Grid Engine

•  Sun Grid Engine core development team works for Univa •  4 of Top 5 Grid Engine sites by core counts •  4 of Top 5 Commercial Grid Engine sites •  4 of Top 7 Research Grid Engine sites •  2 of the Top Oil and Gas companies •  Add-‐on products and technologies •  Where Grid Engine evoluIon happens:

•  26 releases with close to 500 enhancements and fixes in 24 months

© Univa Corporation 2013. All Rights Reserved. 2

Grid Engine - 20 Years of History

•  1992: Initial developments @ Genias in Regensburg •  1993: First Customer Shipment (as CODINE) •  1996: Addition of GRD policy module

•  Collaboration with Raytheon & Instrumental Inc •  1999: Merger with Chord Systems into Gridware •  2000: Acquisition through Sun

•  Re-launch as Sun Grid Engine •  2001: Open Sourcing •  Until 2010: Massive growth in adoption (>10,000 sites) •  2010: Acquisition through Oracle

•  Open Source gets orphaned •  2011: Key engineering team joins Univa •  Now: 3rd product release of Univa Grid Engine

3 © Univa Corporation 2013. All Rights Reserved.

Situation

•  In 2010 Oracle changed the game •  Gone are the days - subsidy from a multi-billion company

•  Development in the open •  Features •  Support •  Bug fixes •  Qualified binaries

•  Choice remains •  Stay with open source •  Evolve forward


Grid Engine: Paid Development

97%

3%

Sun Grid Engine Code Contributions

(check-ins since day 1 in 2001) Sun

The community offered configuration and “how to” support. It was not a development oriented community

97% of Sun Grid Engine checkins were contributed by Sun. Those contributions ceased in 2010 with 6.2u5 The core development team now works for Univa.

Time

Open Source Grid Engine

Univa Grid Engine

6.2U5 8.0

8.0.1

8.1

We cannot predict the slope of this line. The past can help predict the future.

Future?

Jan 2011 May 2011 Oct, 2011 Aug, 2012

Line

s of

Cod

e C

hang

ed

Salaried Developers


Single largest contribution to open source outside of Sun by Univa. 20x larger than all combined 2001-2010.

Optimizes Resources Help organizations play a

better game of Tetris

•  Univa provides Grid Engine users with •  Active development of Grid

Engine features •  Active Technical Support •  Third party integrations •  Add-on products that increase the

value of existing systems •  Univa leads Scalability

•  Support large cluster capacity with customers above 100,000 cores

•  Univa offers Training •  Offer user and admin training to

customers •  Univa has partnered with leading HPC

hardware and software companies •  Univa leads the industry in Hadoop +

Grid Engine deployments •  5 customers in production with Cloudera and

Univa

Univa Grid Engine

“[Univa] Grid Engine certainly allows us to go live with a new component called Aggregator on Hadoop without a major investment. If we didn't have [Univa] Grid Engine, it would be a major investment to go live on Hadoop because we would have to build a new cluster and incur all the costs around that.”

- Katrina Montinola, VP Engineering, Archimedes Model 6

Accomplishments:

•  We lead the HPC industry in delivery and execution •  Significant investment in support of customer needs •  Feature Evolution - Targeted at saving time and money

•  Three production release of Grid Engine in a year •  >25 production patch releases •  Approximately 450 improvements to Grid Engine

•  Product Evolution - Targeted at improving TCO of Grid Engine

•  Delivered advanced reporting – UniSight •  Cluster analytics

•  About to release License Orchestrator •  Optimizes expensive application licenses

•  UniCloud •  Optimizes the availability of local and cloud servers needed to

support application workload

“There is little competition for Univa's Grid Engine business strategy. It knows its target customer base (which is very well qualified), makes its pitch (by phone), and either takes an order or walks away.” John Barr, The 451 Group


Customer Traction

Market Leading Workflow Management Sample Wins – 82% Revenue from Enterprise

© Univa Corporation 2013. All Rights Reserved. 8

What Univa Offers Grid Engine Users •  Univa Grid Engine Customer Program

•  Univa Grid Engine is a drop in replacement for Sun and Oracle Grid Engine users

•  Migration is an upgrade •  Technical Support from experienced team

•  What you need when you need it •  Security and maintenance patches

•  Hot fixes, configuration help, tuning guidance •  Continued Product Development

•  New, ground-breaking features and improvements – Examples: Hadoop Integration, Job Classes

•  Support for new hardware (GPU, Phi, ARM) and Operating Systems •  Access to add-on products - Example: UniSight •  Access to improved documentation

•  New Products •  UniCloud •  License Orchestrator •  Native Windows implementation

•  Indemnification from open source technologies used in Grid Engine 9 © Univa Corporation 2013. All Rights Reserved.

Feature How

Job Classes ✔ ✔ ✔ Templates providing ease of use, control and best fit

Resource Maps ✔ ✔ OpImal mapping of resources to jobs Core / NUMA Binding

✔ ✔ ✔ Tuned uIlizaIon of CPU and memory architectures

Database Spooling

✔ ✔ ✔ Increased upIme @ top performance

Fair Urgency ✔ ✔ Balanced uIlizaIon of criIcal resources

MPI IntegraIons ✔ ✔ ✔ Tuned, out-‐of-‐the-‐box integraIon with MPI versions

Improved DiagnosIcs

✔ ✔ Faster Ime to resoluIon of issues

Major 8.1 Features & Benefits


•  Univa Grid Engine 8.1 released in Aug 2012 •  Current: v8.1.3 (Nov ‘12) - Planned: 8.1.4 (April ’13)

Evolve with Univa

•  Lower TCO with our innovative new features •  Improved value is delivered with our new products for

Grid Engine sites •  Global enterprise support when and where you need it •  Peace of mind: Univa Grid Engine is an upgrade


Thank You

For more information check out http://www.univa.com Or contact me at [email protected] Watch out for more insideHPC Slidecasts to follow-on topics like •  Univa enabling Big Data and Big Compute conversion •  Resource management challenges in light of HPC architecture evolution and

Univa‘s solutions •  Univa‘s advanced license management (cross-org, cross-geo) •  Univa Grid Engine feature specifics

Technology

Grid Engine State of the Union