The Earth Simulator and Its Impact on Science and Technology

Tetsuya SATO

The Earth Simulator Center

Japan Marine Science and Technology Center

July 16, 2003

The XXI International Symposium on Lattice Field Theory

The Earth Simulator site is located at Yokohama Institute for Earth Sciences, Japan Marine Science and Technology Center, which is about 40km south of Tokyo, and 12km south of Yokohama city.

Architecture of the Earth Simulator

PN cabinets(320)

IN cabinets(65)

65m (71yd)

Double Floor for Cables

Power Supply System

Magnetic Disk System

Air Conditioning System

Seismic Isolation System

50m (55yd)

This is a scale model of the Earth Simulator. The colored cabinets set inside a circle shape are the Earth Simulator which are housed in the specially constructed building. The blue cabinets set like a circle shape are the processor nodes, and light blue ones the interconnection network cabinets.

Configuration of the Earth SimulatorShared Memory16GBArithmetic Processor #0Arithmetic Processor #1Arithmetic Processor #7Shared Memory16GBArithmetic Processor #0Arithmetic Processor #1Arithmetic Processor #7Shared Memory16GBArithmetic Processor #0Arithmetic Processor #1Arithmetic Processor #7Processor Node #0Processor Node #1Processor Node #639Total peak performance:40TflopsTotal main memory:10TBPeak performance/AP: 8GflopsPeak performance/PN:64GflopsShared memory/PN:16GBInterconnection Network (full crossbar switch) Total number of APs:5120Total number of PNs: 640

The Earth Simulator (ES) is a Vector-based Parallel Supercomputer

Development of ES started in 1997 with the aim of making a comprehensive understanding of global environmental changes such as global warming.

26.58Tflops (65% of the peak performance) is obtained by a global atmospheric circulation code in May, 2002.

35.86Tflops (87.5% of the peak performance) is achieved in the Linpack benchmark in May, 2002.

Its construction was completed at the end of February, 2002 and the operation started from March 1, 2002 at the Earth Simulator Center

Sustained Performance

Computer Science

Arithmetic Processor Package

LSI Arithmetic Processor (AP)

Power Connector

MMU Interface Connectors

Build-up PCB

Clock Connector

Heat sink

( 115mm x 139mm )

Reductionism Approach

legs head arms

20th Century Science

Holistic Approach

21st Century Science

Application Fields:

Application Fields

Atmosphere/Ocean Science Solid Earth Science Computer Science Innovative projects International collaboration

Management of the Earth Simulator

Presidentof JAMSTEC

Earth SimulatorAdvisory Committee

Earth SimulatorReview Committee

Director-General

Committee forMission Definition

Committee forProject Selection

Enactment of basic charterand other important issues of the Earth Simulator

Review of management and results of the Earth Simulator

Earth Simulator Center

Draw up mission of the Earth Simulator

Execution of action programof the Earth SimulatorOperation and management of the Earth Simulator

Selection of projectsAllocation of resources

Allocation of Computer Resources

Climate Science

Solid Earth Science

Computer Science

Directors Discretion

Innovative Projects

30 35%

15 - 20%

25%

15%

10%

Graph3

32.5

17.5

10

15

25

Sheet1

32.5

17.5

10

15

25

Sheet1

0

0

0

0

0

Sheet2

0

0

0

0

0

Sheet3

34 projects are accepted in FY200312: Climate Science 9: Solid Earth Science11: Innovative Projects 2: Computer Science

International Collaboration Institution to Institution Agreement Scripps Institute (US) NERSC(US) Hadley Center (UK) CIRA (Italy) RPN (Canada) Individual participation in ES Project

ES-LANEarth SimulatorInternetAuthorized UserFire WallFire WallMass Data TransportationData

Archive System

Mass Data Processing System

Data Analysis

Earth Simulator

Output

Visualization

Flow of Simulation Data

CompleXcope

3D Sound System

Image Projector

Drastic cost reduction in Manufacturing Development of an expensive system that requires many trial stages, such as fusion reactor Development of an innovative machine that requires frequent model changes, such as autos and airplanes Synthesis of new materials, such as proteins, medicines and nano-carbon-ubesetc.

Reductionism has made humans thinking simple, and only neighboring, near-term conditions are taken into consideration in decision-making --- linear prediction Earth Simulator makes human consider global and long-term conditions and feedback them in decision-making ---nonlinear prediction Paradigm Shift in Humans Thinking

INDUSTRY

SCIENCE

HUMAN

ENVIRONMENT

Protection of lives and properties from natural disasters and environmental destruction

Huge cost reduction on innovative technology development which requires massive investments

Paradigm shift to global, future-oriented way of thinking

Development of innovative research tools attaching far-from-equilibrium, nonlinear and open systems

fin

This figure shows the total system of the Earth Simulator.

The Earth Simulatior is a MIMD type distributed memory parallel system which consisits of 640 processor nodes connected by full crossbar interconnection network. Each node , the blue one, is a shared memory system and has eight arithmetic processors which are vector processors. The total number of vector processors is 5120.

Peak performance of the arithmetic processsor is 8Gflops and therefore peak performance of the processor node is 64Gflops. The shared memroy capacity is 16GB.

So the total peak performance of the Earth Simulator is 40 Tflops and the total main memory capacity is 10TB.