CNGrid: Today and Tomorrow

  • Upload
    trista

  • View
    27

  • Download
    3

Embed Size (px)

DESCRIPTION

CNGrid: Today and Tomorrow. Depei Qian Sino-German Joint Software Institute Beihang University [email protected] Oct. 28, 2007. Key project supported by the National High-Tech R&D Program (the 863 program) Earliest and largest Grid project in China Two phase development - PowerPoint PPT Presentation

Citation preview

CNGrid: Today and Tomorrow
Depei QianSino-German Joint Software InstituteBeihang University [email protected]. 28, 2007

Overview of CNGrid
Key project supported by the National High-Tech R&D Program (the 863 program)Earliest and largest Grid project in China Two phase developmentHigh performance computer and core software (2002-2005)100 Mil. Government fundingHigh productivity computer and Grid Service Environment (2006-2010) 640 Mil. Government funding

The current 863 key project
Period: 2006-2010, launched in Oct. 2006640 million (RMB) from the MOST and at least equal amount of matching funding from different organizationsMajor efforts:High productivity Computer developmentCNGrid developmentCNGrid GOS continuous development12-15 Grid applications

HPC development
Two phase developmentTwo 100TFlops machines in the first phase (By the end of 2008)One 1000Tflops in the second phase (TBD)Installation in CNGrid Major sites

CNGrid infrastructure
Upgrading of CNGrid resourcesincreased to 12 nodesAggregated computing power of 300TF1PB storageGrid monitoring and managementStrengthen CNGrid operation center

CNGrid resources
10 sites currently2 major sites, 8 ordinary sitesComputing resource: >25 TFlops Disk storage: >400TB>150 Application software

SCCAS
Equipped with Lenovo DeepComp 6800, 5.324TFlopsAverage utilization 86%Applications155 registered usersSupporting more than 120 important projects

SSC
Equipped with Dawning 4000A, 10.2 TFlopsUtilization >80About 150 users

Grid software development
Major tasksRobust softwareData grid functionaityGrid workflowGrid user interfaceGrid securityGrid management

CNGrid GOS architecture

Tomcat(Apache)+Axis, GT4, gLite, OMII

Dynamic DeployService

CA Service

System Mgmt Portal

Hosting Environment

Core

System

Tool/App

Message Service

Agora

User Mgmt

Res Mgmt

Agora Mgmt

Naming

HPCG, Data & Workflow Portals

GSML Browser

ServiceController

Other RController

BatchJob mgmt

MetaSchedule

Account mgmt

File mgmt

metainfo mgmt

HPCG Backend

Resource Space

GOS System Call (Resource mgmtAgora mgmt, User mgmt, Grip mgmt, etc

GOS Library (Batch, Message, File, etc)

Other Domain Specific Applications

Grip Runtime

Grip Instance Mgmt

Security

Res AC & Sharing

Other 3rd software & tools

Java J2SE

GridWorkflow

DataGrid

IDE

Compiler

GSML Composer

GSML Workshop.

Debugger

Grip

Gsh & cmd tools

VegaSSH

Cmd Line Tools

DB Service

Work Flow Engine

CNGrid GOS deployment
CNGrid GOS 3.2 deployed on 10 nodesSupport heterogeneous HPCs: Dawning 4000A, DeepComp 6800, Galaxy, etc.Support multiple platforms: Unix, Linux, Windows, Apache, WebSphere, etc.

CNGrid Applications
Applications from selected areasResource and EnvironmentNGG, DFG, SeisGrid, computational chemistryResearchSDG, BAGrid, DDG, Chinese medicine databasesServicesCMAG, TIG, railway cargo infomationManufacturingAviGrid, SimGrid

National Geological survey Grid: NGG
Undertaken by China National Geological Survey BureauNation-wide productive gridData exchange and sharing by servicesGrid-enabled resource evaluationShorten the evaluation time from 3 years to 3 monthsAchievementsNorth China ground water resources evaluationMineral resources evaluation

Scientific Data Grid

Drug discovery grid: DDG
Undertaken by Shanghai Institute of Materia Medica CASChemical Compound screening for new drug discoverySpeed up the process by computer simulationHigher accuracyUsing HPC in P2P mode New drug for diabetes is under development and will enter clinic testing

DDG Portal

Aviation Grid: AviGrid
Undertaken by AVIC II of ChinaSupporting distributed design, simulation, and manufacturingCAD software sharingData exchange and sharingComputing resource sharing

AviGrid
Aviation grid platform composed of three clusters in different locations

Railway cargo Information system

MICROSOFT CORPORATION

Railway cargo information system
Physical Databases
Virtual databasesUniform data schemaUniform access interfaceDynamic data integrationSingle system image
Business databasesDynamic data view construction

China Meteorological Grid

Process flow of ensemblenumerical weather prediction




























CNGrid (2006-2010)
HPC Systems100 Tflop/s by 2008,Pflop/s by 2010Grid Software: CNGrid GOSMerge with international effortsEmphasize maturenessCNGrid EnvironmentNodes, Centers, mgtApplicationsResearchResource & EnvironmentManufacturingServices

Cooperation with EU FP6
EUChinaGridInteroperability between CNGrid GOS and gLiteIPv6 supportApplication in HEPH, Biology and bioinformaticsEchoGridGrid roadmapCoordination between EU and Chinese grid researchers OMII-EuropeGrid standardization effortInteroperbility between main stream grid middlewareBRIDGEInteroperability between CNGrid GOS and GRIAGrid applications: Aerospace, Phama, MeteoXtreemOSNetwork centric OS

Future Cooperation:Kay Technology
VirtualizationVOVM Security and dependable computingData federation, access and sharingVirtual data spaceData driven software Cloud ComputingWorkflow and service coordinationProgramming supportMulti-coreNetwork computing

Future Cooperation: Grid infrastructure
Grid interoperabilityGrid Monitoring and managementCA and user managementInternational joint grid infrastructure


Future Cooperation: Grid-enabled applications
Grid enabled domain applicationsScientific databaseBiology and bioinformaticsGeo-scienceAviation (optimization)Pharmaceutical (drug discover)Product design & optimizationGrid application frameworkSpecialize Grid communityServe a range of usersScientific and engineering computing

New level of cooperation
Top down + bottom upContinue the current bottom-up approachGovernment level coordinationIdentifying common interestsNew funding schemeJoint fundingJoint calls and evaluation

Thank you!