49
Grid Development Tools & Interactive Applications 北北北北北北北北北北北ACT 北北北 [email protected] 2005.3.25

Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 [email protected] 2005.3.25

Embed Size (px)

Citation preview

Page 1: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Grid Development Tools & Interactive Applications

北航计算机新技术研究所( ACT )沃天宇

[email protected]

2005.3.25

Page 2: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Resume

• 沃天宇• 北京航空航天大学• 计算机学院• 2001 级博士研究生• 导师怀进鹏

• 北航计算机新技术研究所( ACT )• [email protected]

Page 3: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Content

• Background

• Interactive Application for Grid

• Grid Development Tools

Page 4: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Part 1 Background

Page 5: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Background

• Grid Research in China– 863 – CNGrid– MOE – ChinaGrid– NSFC – eScience

Page 6: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Network Based e-Science Environment

• CROWN– China Research Environment Over Wide-area Network

Cooperation

3 Scientific Problems

Manageability

Trust

Testbed Architecture

9 Key Technology

Service Management

Resource Sharing

Domain specificE-Science Activity

Supporting

User interface

Development

Testbed Security

Testbed Operation

Heterogeneous Resource

Encapsulation

Page 7: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Testbed Deployment (Stage 1)

• 5 universities and institutes• Many valuable research resources

Page 8: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Resource Organization & Management

Node Domain RLDS

Domain RLDS

Region Switch

Domain RLDS

Node NodeServices

Device

Device Driver Service

Other Regions

Gateway to EU DataGrid?

Gateway to Other Testbed

Page 9: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Middleware Architecture

Resource Service Layer

Application Supporting Layer

User Supporting Layer

Secu

rity &

System

Ad

min

istration

Develo

pm

ent

Meth

od

olo

gy

& T

oo

ls ApplicationDeveloper

PlatformAdministrator

Computation Power Storage Devices Software ……

Encapsulating

Researchers of all disciplines

High Energy Physics Bioinformatics Atmosphere ……

SharingSharing Sharing

EncapsulatingEncapsulating

Page 10: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Project

• CROWN Node Server

• CROWN RLDS

• CROWN Designer

• CROWN Portal

• CROWN Security & Trust (CROWN-ST)

Page 11: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Node Server

• Grid Service Container Middleware• Resource Encapsulation (as Services) & Monitor• Extensible / Reliable / High Performance /

Interoperable• Key technologies

– Hot deploy– Remote deploy– Resource Dynamic– Information Collecting

Page 12: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN RLDS

• RLDS = Resource Locating and Description Service

• Functions– Topological Management– Service Information Publish & Discovery– Subscription/Notification based Dynamic Information

Collection– Extensible Resource Information Model– Advanced GIQL Query

Page 13: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN RLDS

Page 14: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Designer

Page 15: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Portal

• Grid Application Consuming Environment

www.crown-grid.orgwww.crown.org.cn

Page 16: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Security & Trust (CROWN-ST)

• Communication Security– XML / SOAP Security– Secure Conversion– WS-Security / SAML / XACML

• Authentication

• Authorization (RBAC / ABAC)

• Trust Management

Page 17: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Part 2 Grid Development Tools

Page 18: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Motivation

• Grid Service Development in GT 3 / 4 (without an IDE)– Edit .java source Notepad / UltraEdit / vim / emacs– Compile javac classpath…– Generate WSDL java2wsdl / ant build.xml– Edit WSDD Notepad / UltraEdit / vim / emacs– Generate Gar file jar / ant build.xml– Deploy Copy– Service Client / Stub wsdl2java / ant– …

• WSRF ?– Resource / ResourceHome / JNDIConfig / Stub / Flatten / Binding

/ …

Page 19: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Requirements

• List of files required in a typical Globus project– service.wsdl– service-deploy.wsdd– jndi-config.xml– .java– security-descriptor– build.xml– …

Page 20: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Requirements

• Automatically (skeleton) generation / GUI• Syntax Error Checking• Development Process Control

– Write java code– Edit config files– Make gar– Deployment

• Supporting OGSA / WSRF• Extensible

Page 21: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Related Works• GT3IDE (Globus 2005)

– First release: May 2004– BSD license– Still under development– GT3, Will support GT4– http://gt3ide.sourceforge.net/

• Features– Automatic generation of WSDD and NS mappings– Partial generation of Java and WSDL– Java skeleton– Add a new remote method and the corresponding WSDL code is genera

ted.– “Generate + Compile Stubs” and “Build GAR” buttons

Page 22: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Designer

• Grid Development Environment• Eclipse Plug-in Based• Support GT4 (3.9.x) • Functions

– Service Development– Service Deployment (Remotely & Dynamically)– System Monitor & Admin (Drag & Drop deploy)

Page 23: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Designer

• Components– Wizards: Project / Service / Stub / Gar / …– Editors: WSDL / WSDD / JNDI / Keystore / WSPolicy /

Security-Service-Config / XACML / …– Views: CROWN Topology– Actions: Deploy

– GDEClasspath Container– Internal ant build file

Page 24: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Designer

Eclipse Platform

Eclipse Project

Workbench

JFace

SWT

Workspace

Platform Runtime

Debug

Team

HelpJDT

PDE

CRWON Plugins

WSDL2Java Wizard

WSDL Editor

XACML Editor

KeyStoreEditor

Java2WSDL Wizard

WSDD Editor

Grid Debug View

Grid View

Deploy Wizard

Page 25: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

CROWN Designer

Page 26: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Conclusion

• Grid service development is a tough work• A development tools will

– Reduce a lot of routine work– Easy to learn and master– Promote the development and deployment

efficiency

• Eclipse is good platform to develop an IDE (IDE lathe)

Page 27: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Future Works

• Dev Tools– MDA Based Design & Implementation

– WSDL / Java Code Synchronization– Exception Handling– Service (Remote) Debug– Workflow Modeling– Collaboration Support– Usability (Friendly UI / Documentation /

Internationalization)

Page 28: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Part 3 Interactive Application for Grid

Page 29: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Motivation

• Job Submission vs Interaction– Job Submission

• No interference during job execution• All input to be ready at submission time • e.g. Gene Sequence Searching

– Interaction• Multiple inputs required during job execution• Input/output dependency between steps (stages)• e.g. Chess Game, VR (Visual Surgical Operation)

Page 30: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Motivation

• Collecting the requirement of Interactive Application– Design– Development– Deployment– Running

• Investigate the WSRF / WS-Notification based design and implementation

Page 31: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Related Works

• CFD Design & Visualization (GCC 2004)– Aero-crafts Aerodynamic Simulation and Optimization by Using “CFD-Gr

id” Based on Service Domain

– Hong Liu, Xin-hua Lin, Yang Qi, Xin-da Lu, and Ming-lu Li

– LNCS 3251, p. 745 ff.

Page 32: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Related Works

• Immersed VR - Visual Surgical Operation (Euro Data Grid)– WP10 - Biomedical applications Network requirements for grid-aware m

edical image applications

– http://www.cnaf.infn.it/~ferrari/infn-grid-wp5/task-dg/task2/mig-network.pdf

Page 33: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

WS-Notification Based Interaction

• SOA– Stateless Service vs Stateful Resource

• OGSA– OGSI– WS-Addressing– WSRF (WSRP / WSLT / WSSG / WSBF)– WS-Notification (WS-Topic)

Page 34: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

WS-Notification Based Interaction

• Basic Principle– Subscriber– Producer– Consumer

– Topic• Space / Tree

– Notification

Page 35: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

WS-Notification Based Interaction

• Publisher

• Broker

Page 36: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Prototype - HalmaGame

• Basic Roles of Halma

Page 37: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Prototype - HalmaGame

• Main Problem– Game situation maintenance

• Players / Board / LastStep / History / Winner

– Get Notification when game situation changes

– HalmaGame Rule Implementation– UI

Page 38: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Interaction Design

Player1 Service Player2

createGame(“player1”)subscribe(tns:players)

subscribe(tns:lastStep)

notify(tns:players)

move

notify(tns:lastStep)

notify(tns:lastStep)

move

getGames()

joinGame

subscribe(tns:lastStep)

notify(tns:lastStep)

move

Players=Player1lastStep=null

Players=Player1|Player2

notify(tns:lastStep)

lastStep=Step(…)

Page 39: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

SWT based UI

Page 40: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Conclusion

• Interaction is an important feature and problem of Grid application

• WSRF / WS-Notification technologies can be apply to support interaction

• UML Interaction Diagram is a good tools to modeling interactive processes

Page 41: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Future Works

• Real Application

• Transaction Support

• Checkpoint Save & Restore

• Security & Reliability

• Portal based Interaction

Page 42: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

Thank you very much!

Q&A

Page 43: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

内容简介 (1)

• 题目:网格开发工具与交互式应用

• 结合北航计算机学院计算机新技术研究所( ACT )在网格领域的研究工作,介绍 ACT 承担的研究项目( CROWN ),介绍对于网格服务及网格应用的开发、部署、运行、监控等方面一些经验。

Page 44: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

内容简介 (2)

• 重点讨论网格开发工具的需求、当前面临的一些问题及技术解决方案。讨论基于 Globus Toolkit 的开发及工具支持。介绍已经开展的一些工作及 CROWN Designer 等研发成果。

Page 45: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

内容简介 (3)

• 讨论交互式应用的需求、开发、部署、使用过程并交流相关经验。介绍网格跳棋原形系统的一些情况。

Page 46: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

简历

• 1997 - 2001 :– 北航计算机系学习,获学士学位

• 2001-2005 :– 北航计算机学院博士研究生

Page 47: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

简历

• 2001 微软亚洲高校 .Net 程序设计大赛 ( 韩国汉城 ) 冠军

• 2002 访问微软公司西雅图总部• 2003 微软学者

Page 48: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

研究背景

• 2001-2003: 参与 863 Web Service 中间件(WebSASE) , 2003 年获教育部科技进步一等奖

• 2004: XLinker (轻量级 SOAP 消息中间件) XML / Web Service 安全,系统架构设计

• 2004 以来 : NSFC 网络为基础的科研活动环境试验平台 (CROWN)

Page 49: Grid Development Tools & Interactive Applications 北航计算机新技术研究所( ACT ) 沃天宇 woty@act.buaa.edu.cn 2005.3.25

研究兴趣

• Web Service 中间件技术• XML / Web Service 安全技术• Grid 服务及应用开发技术• 网格系统的可控可管体系结构及相关技术