Academic Grid infrastructuresAcademic Grid infrastructures

Michael GindonisOlli TourunenOlli Tourunen

CSC – Tieteen tietotekniikan keskus Oy CSC – IT Center for Science Ltd.

Part 1: From Science to e-Science

Towards Computational Science

Theoretical

Computational

• Evolution of science [1]

– From being primarily Empirical to grow an Empirical

Theoretical

– Theoretical component and today also include a

– Computational component

• PITAC report 2005– Defines and emphasizes the advancement of Computational

Science“Advances in computing and connectivity make it possible to develop computational models and capture and analyze unprecedented amounts of experimental and observational data to address problems previously deemed intractable or

[1] J. Gray, G. Bell and A. Szalay, Petascale Computational Systems:Balanced CyperInfrastructure in a Data-Centric World, Report to NSF October 2005

p p ybeyond imagination.”

Evolution of Computational S iScience• Computational needs continuouslyComputational needs continuously

growingR h iti d j t h• Research communities and projects have become global

• The need to share data and resources

Evolution of Computational SScience

• Unified view of theory, experiments and numerical simulation e-Science or

e Research• Advances in computing and

t ki e Infrastructure

e-Research

networking e-Infrastructure

Building a Distributed Research I f t tInfrastructure• Sharing resources allows load balancingSharing resources allows load balancing• Better use of funding• Eases collaboration

Globus issuesGlobus issues

Part 2: Current production infrastructures

DEISA

DEISADEISA• A grid consisting of several European supercomputers, g g p p p

including CSC's Louhi.• A European grid project that shares computing

resources for demanding scientific applicationsresources for demanding scientific applications• Yearly applications for computing time (DECI call)• EU FP6: DEISA May 1st 2004 April 30th 2008• EU FP6: DEISA May 1st, 2004 – April 30th, 2008• EU FP7: DEISA2 May 1st, 2008 – April 30th, 2011• Most DEISA sites are connected via 10 Gb/s lines• Most DEISA sites are connected via 10 Gb/s lines• DEISA Global File System - eliminates need for file

staging

DEISA NetworkDEISA Network

Provided by GEANT2 and the National Research and Education Networks

EGEE

EGEEEGEE• EGEE processes up to 300,000 jobs per dayp p , j p y• more than 80,000 CPU cores• several tens petabytes of storageseveral tens petabytes of storage • available 24 hours a day, seven days a week

4000050000600007000080000

No. Cores

010000200003000040000

hti.0

4nä

.04

oka.

04m

i.05

hti.0

5nä

.05

oka.

05m

i.06

hti.0

6nä

.06

oka.

06m

i.07

hti.0

7nä

.07

oka.

07m

i.08

hti.0

8

hu hei l o

tam hu hei l o

tam hu hei l o

tam hu hei l o

tam hu

Grids in EuropeGrids in Europewww.eu-egi.eu

www.eu-egi.eu

Grids in Finland?Grids in Finland?• CSC is the key playery p y• Participation in large European projects

– DEISADEISA– EGEE

• Influencing the next generation of gridInfluencing the next generation of grid infrastructures– PRACE– EGI

• Coordinates national level grid infrastructureg

Some grid use cases in Finland• CERN Large Hadron ColliderCERN Large Hadron Collider

– ALICE and CMS experiments– Computational and storage facilities accessed

through grid– Finnish resources are hosted at CSC for the

Helsinki Institute of Physics

Some grid use cases in Finland, contd.• DEISA DECIDEISA DECI

– LIPOS - Study of Low Density Lipoproteins to Prevent Heart Attacksto Prevent Heart Attacks

• http://www.deisa.eu/science/deci/projects2007-2008/Lipos

DEISA Vi t l C it• DEISA Virtual Community– Planck satellite first light study

• http://www.esa.int/SPECIALS/Planck/SEM5CMFWNZF_0.html

Some grid use cases in Finland, contd.• PairsDB updatesPairsDB updates

– Gaining throughput without impacting local resourcesresources

– http://pairsdb.csc.fi/

Part 3: OutlookPart 3: Outlook

European CommissionEuropean Commission

“…for Grids we would like to see the move towardsthe move towards

long-term sustainable initiativesless dependent upon p p

EU-funded project cycles”

Viviane Reding, Commissioner, European Commission, at the EGEE’06 Conference, September 25, 2006

20www.eu-egi.eu

EvolutionEvolutionNational

European e-Infrastructure

EuropeanTestbeds Utility

Productive UseEuropean

21www.eu-egi.eu

Grids in EuropeGrids in Europewww.eu-egi.eu

www.eu-egi.eu

Grids in EuropeGrids in Europewww.eu-egi.eu

Each National Grid Initiative … should be a recognized national body with a single point-of-contact… should mobilize national funding and resources… should ensure the operation of a national e-Infrastructurep… should support user communities… should contribute and adhere to intl. standards and policiespolicies

www.eu-egi.eu

EGIEGI

• Ensure pan-European grid coordinationEnsure pan European grid coordination and integrityAi f t d di ti h ibl• Aims for standardization where possible

• National Grid Initiatives (NGIs) will operate National Grid Infrastructures

• EGI will link existing and new NGIsEGI will link existing and new NGIs• Operation starts January 2010• http://web.eu-egi.eu/

Partnership for Advanced pComputing in Europe

PRACE• Prepares for the creation of a persistent pan-European HPC service

PRACE

• Requires a periodic renewal of the systems and a continuous upgrade of the infrastructure

• Aims to provide European researchers with access to petaflop scale computers and form the top level of the European HPC ecosystemcomputers and form the top level of the European HPC ecosystem.

• The service will comprise three to five petaflop class supercomputing centres strengthened by regional and national HPC centres working in collaboration

• Current phase is undertaking all the necessary technical preparations, including the evaluation of components, systems and facilities, porting key scientific applications, and the developing training infrastructure

• Should be in a position to deploy and exploit the first petaflop/s systems in• Should be in a position to deploy and exploit the first petaflop/s systems in 2009/2010.

• CSC is in charge Dissemination, Outreach and Training• Funded by the European Commission’s 7th Framework Programme• Funded by the European Commission s 7th Framework Programme.

CSC and the CloudCSC and the Cloud

• Currently working with ”A data intensiveCurrently working with A data intensive customer”– Close collaboration to find suitable technologies fromClose collaboration to find suitable technologies from

Clouds and Grid to meet their needs.

• Enhancing the existing software products to g g pbetter support distributed computing– Chipster: user friendly DNA microarray analysis p y y y

software developed by CSC offers an intuitive graphical user interface to a comprehensive collection of up-to-date analysis methodsof up to date analysis methods

CSC and the CloudCSC and the Cloud

• Building Internal ExpertiseBuilding Internal Expertise• Following developments• Keen on involving customers as partners

in projects• Interested in Customer needs

Questions commentsQuestions, comments

Thank you!