Servizio Centrale Informatica e Reti (Maggio-2003) Ing. Silvio Migliori...

Servizio Centrale Informatica e Reti (Maggio-2003)

Ing. Silvio Migliori (migliori@enea.it)

Coordinatore Calcolo ScientificoENEA

INFRASTRUTTURA “GRID” PER IL CALCOLO

SCIENTIFICO in ENEA

Agenda

•Cenni sui concetti generali delle griglie computazionali

•Architettura dell'infrastruttura GRID ENEA

•Prossimi sviluppi per il SUD

•Esempi di  funzionamento

Ing. Silvio MiglioriCoordinatore progetti calcolo scientifico in ENEA

Milano 7/5/2003

The Grid: The Web on Steroids

On-demand creation of powerful virtual computing systems

http://

http://

Web: Uniform access to HTML documents

Grid: Flexible, high-perf access to all significant resources

Sensor nets

Data archives

Computers

Softwarecatalogs

Colleagues

Ian Foster

Network Exponentials Network vs. computer performance

– Computer speed doubles every 18 months– Network speed doubles every 9 months– Difference = order of magnitude per 5 years

1986 to 2000– Computers: x 500– Networks: x 340,000

2001 to 2010– Computers: x 60– Networks: x 4000

Moore’s Law vs. storage improvements vs. optical improvements. Graph from Scientific American (Jan-2001) by Cleo Vilett, source Vined Khoslan, Kleiner, Caufield and Perkins.

Ian Foster

Performance Extrapolation

N=1

N=500

Sum

1 GFlop/s

1 TFlop/s

1 PFlop/s

100 MFlop/s

100 GFlop/s

100 TFlop/s

10 GFlop/s

10 TFlop/s

10 PFlop/s

PFlop/scomputer

TFlop/sTo enter the list

Jac. Dongarra SC2002

Selected Major Grid ProjectsName URL & Sponsors Focus

Access Grid www.mcs.anl.gov/FL/accessgrid; DOE, NSF

Create & deploy group collaboration systems using commodity technologies

BlueGrid IBM Grid testbed linking IBM laboratories

DISCOM www.cs.sandia.gov/discomDOE Defense Programs

Create operational Grid providing access to resources at three U.S. DOE weapons laboratories

DOE Science Grid

sciencegrid.org

DOE Office of Science

Create operational Grid providing access to resources & applications at U.S. DOE science laboratories & partner universities

Earth System Grid (ESG)

earthsystemgrid.orgDOE Office of Science

Delivery and analysis of large climate model datasets for the climate research community

European Union (EU) DataGrid

eu-datagrid.org

European Union

Create & apply an operational grid for applications in high energy physics, environmental science, bioinformatics

g

g

g

g

g

g

New

New

Ian Foster

Selected Major Grid ProjectsName URL/Sponsor Focus

TeraGrid teragrid.org

NSF

U.S. science infrastructure linking four major resource sites at 40 Gb/s

UK Grid Support Center

grid-support.ac.uk

U.K. eScience

Support center for Grid projects within the U.K.

Unicore BMBFT Technologies for remote access to supercomputers

g

g

New

New

Also many technology R&D projects: e.g., Condor, NetSolve, Ninf, NWS

See also www.gridforum.org

Ian Foster

CitrixMetafra

me

CitrixNfuse

ICA

WEB(ICA)

power3.frascati.enea.it

boquad.frascati.enea.it

dafne.casaccia.enea.it

infocal.trisia.enea.it

8

622 Mbps

ENEAINFO

12017

0

NEW

Cray 39 Gflops

25 Gflops

Cluster Linux 50 Gflops

Software Conceptual StructureINFORMATICSINFORMATICS CENTRAL FUNCTIONS CENTRAL FUNCTIONS

ITALIAN NATIONAL AGENCY FOR NEW TECHNOLOGY ,ENERGY AND THE ENVIRONMENT

AFS Geographical cross platform& File System

AIX SGI SUN Compaq

NT Linux

Quadrics

…

Load Leveler LSF

Graphic User Interface

LSF multi-cluster as integrator

Telnet

User programs & commercial code

Portale Applicativo (Metaframe/Nfuse)

ICAWEB

Qu

alità

di serv

izio

Mon

itori

ng

di sis

tem

a e

d’u

tilizzo,

Recu

pero

e S

eg

nala

zio

ne A

uto

mati

co a

nom

alie,

pia

nifi

cazio

ne s

vilu

pp

o

New

Gestione generale di una specifica richiesta al sistema

InterfacciaGrafica

(RICHIESTA)LSF

Cluster Configuratio

n(STATICO)

Stato delle Risorse

(TEMPO REALE)

Politica delle code

(STATICO)•Accoda la richiesta

•Assegna la risorsa

•Lancia il comando sul calcolatore selezionato

DATI(SW/Prog.)

File Server

Client AFS

Cache locale

•Risolve la piattaforma•Verifica i diritti di accesso•Mantiene la coerenza dei dati

AFS

Data Base Server

Graphic environment under

AFS

ITALIAN NATIONAL AGENCY FOR NEW TECHNOLOGY ,ENERGY AND THE ENVIRONMENT

IBM SP

CATIA User(AIX)

FUS Project Users

UserInterferom

etriaOligrafia

Octane 2ProcBologna

Octane 2ProcCasaccia

Onyx3 4ProcFrascati

Cray

INFO Graphic Developers

UsersRobotica

Clu

ste

r Lin

ux A

lph

a

Onyx2 4ProcCasaccia

new

new

new

new

Simulazione RoboticaFig 2a

Visualizzazione Immersiva CR FrascatiVisualizzazione Immersiva CR Frascati

Visualizzazione Immersiva CR CasacciaVisualizzazione Immersiva CR Casaccia

Accesso WEB“Verticalizzazione” dell’accesso alle Applicazioni

ACCESSO AI SERVIZI DELLA CELLA afs fusione.enea.it

8

622 Mbps

ENEAINFO

Linux\Alpha100 Gflops

70

NEW

Cluster Linux 20 Gflops

Cray 32 Gflops

DataGrid at

ESA\ESRIN

GEANT

grid0007

ENEA GRID

GigaBit-Link

DB_2

DB_1

CPUS ENEA GRID

WEBICASSH

Integrazione Impianti e Calcolo

In fase di integrazioine

FTUMOVIE

Test Program “GOME”

ENEA-Geographic SUBMITION PROCEDURE

Input FilesLIV1

List of pathInput File

LIV1

IDL “GOME” Program

Output FileLIV2

.jpg Image

Input FileLIV1

List of pathInput File

LIV1

IDL Program“GOME”

Output FileLIV2

.jpg Image Input File

LIV1

List of pathInput FileLIV1

Case-1

Case_2

Case n

WEB

User afs/home

Por ti c

i

Brin

dis

i

Clus

ter

Clus

ter

Pote

nzia

men

to

New

8

622 Mbps

ENEAINFO

12017

0

NEW

Cray 39 Gflops

25 Gflops

Cluster Linux 50 Gflops

Brindisi

Portici Potenziamento

Web di GraficaWeb di Grafica

http://onyx2ced.frascati.enea.it/grafica/

ITALIAN NATIONAL AGENCYFOR NEW TECNOLOGY, ENERGY

AND THE ENVIRONMENT

RESEARCH AND TECHNOLOGY

AT THE NATION’S SERVICE