Embed Size (px)
Citation preview
Astrogrid –Overview (Astrogrid –Overview ( 概况概况 ))
秦岭秦岭[email protected]@star.le.ac.uk
中国中国 ,, 桂林桂林2929thth Nov – 3 Nov – 3rdrd Dec Dec
Astrogrid – BackgroudAstrogrid – Backgroud背景背景
Astrogrid is a £10M project aimed at building a Astrogrid is a £10M project aimed at building a data-grid astronomy, to form a global Virtual data-grid astronomy, to form a global Virtual Observtory. It is also one of several Grid projects Observtory. It is also one of several Grid projects in the UK's e-Science initiative. in the UK's e-Science initiative.
Astrogrid is funded via the UK's Particle Physics Astrogrid is funded via the UK's Particle Physics & Astronomy Research Council (PPAR & Astronomy Research Council (PPAR 粒子物粒子物理和天文研究会理和天文研究会 ) and by the European ) and by the European Commission (Commission ( 欧洲委任会欧洲委任会 ). ).
The project was formally started on 2001 The project was formally started on 2001 September 1, with the first phase ending Dec September 1, with the first phase ending Dec 2004, and the current extension to Dec 2007 2004, and the current extension to Dec 2007
AG1 – AG2 – AG3AG1 – AG2 – AG3
Project MembersProject Members
Project Lead: Andy LawrenceProject Lead: Andy LawrenceProgramme Manager: Tony LindeProgramme Manager: Tony LindeProject Manager: Keith NoddleProject Manager: Keith NoddleProject Scientist: Nic WatsonProject Scientist: Nic WatsonDeveloper: Guy Rixson, Noel Winstanley, Developer: Guy Rixson, Noel Winstanley,
Dave Morris, Kona Andrews, Kevin Dave Morris, Kona Andrews, Kevin Benson, Jeff Lusted, Catherine Ling Qin, Benson, Jeff Lusted, Catherine Ling Qin, John Taylor, Elizabeth Auden etc..John Taylor, Elizabeth Auden etc..
Astrogrid Components (Astrogrid Components ( 结构结构 ))
Registry Registry 登记登记 ,, 注册注册Community Community 社区社区 ,, 共同体共同体FileManager/Filestore FileManager/Filestore 文件管理文件管理Workflow&Jes Workflow&Jes 工作流程和程序执行服务器工作流程和程序执行服务器CEA CEA 常用执行体常用执行体DSA DSA 数据库接口处理数据库接口处理Workbench Workbench 工作平台工作平台
Registry (Registry ( 登记登记 ,, 注册注册 )) The Registry is the centre of the virtual The Registry is the centre of the virtual
observatory. All resources are listed in it along observatory. All resources are listed in it along with metadata (with metadata ( 后资料后资料 ) ) that allows those that allows those resources to be matched to the task a user resources to be matched to the task a user wishes to perform.wishes to perform.
Basic Registry functionalities: Basic Registry functionalities: allowing resources to be added or removed and allowing resources to be added or removed and
updatedupdated harvesting into/from other registries. harvesting into/from other registries. Queries can be made against the registry using either Queries can be made against the registry using either
an XQuery based method or an IVOA standard query an XQuery based method or an IVOA standard query interface. interface.
Community (Community ( 社区社区 ,, 共同体共同体 ))
functionality to allow the management of functionality to allow the management of communities: creating accounts (persons) communities: creating accounts (persons) and groups, adding accounts to groups and groups, adding accounts to groups and removing them, assigning privileges to and removing them, assigning privileges to groups etc. groups etc.
FileManager/Filestore (VOSpace) FileManager/Filestore (VOSpace) 文件管理文件管理
The concept of virtual storage space, The concept of virtual storage space, allowing a user to store items of data, allowing a user to store items of data, whether files or database tables, at remote whether files or database tables, at remote locations without having to have an locations without having to have an account at those locations, and to access account at those locations, and to access those items without needing to specify any those items without needing to specify any physical address, is one promised by grid physical address, is one promised by grid technologies. technologies.
Workflow/JES Workflow/JES 工作流程和程序执行服务器工作流程和程序执行服务器
User interface (User interface ( 界面界面 ) for workflow ) for workflow construction construction Create complicated workflows with parallel Create complicated workflows with parallel
flows, sequences, branching and conditional flows, sequences, branching and conditional execution execution
Job Execution Service (JES) Job Execution Service (JES) execute, or cause to be executed, each task execute, or cause to be executed, each task
in a workflow in a workflow
Common Execution Architecture Common Execution Architecture (CEA)(CEA)
常用执行体常用执行体 相对比较小的用户界面和 相对比较小的用户界面和 概要合同概要合同 Reasonably small Reasonably small
set of interfaces and schema to model how to execute a set of interfaces and schema to model how to execute a typical Astronomical application within the Virtual typical Astronomical application within the Virtual Observatory (VO). Observatory (VO).
统一的界面 统一的界面 To create a uniform interface and model for To create a uniform interface and model for an application and its parameters. This has twin benefits; an application and its parameters. This has twin benefits;
It allows VO infrastructure writers a single model of an It allows VO infrastructure writers a single model of an application that that have to code for. application that that have to code for.
Application writers know what they have to implement to Application writers know what they have to implement to be compatible with a VO Infrastructure.be compatible with a VO Infrastructure.
To provide a higher level description than WSDL To provide a higher level description than WSDL
DataSet Access (DSA) DataSet Access (DSA) 数据库接口处理数据库接口处理
A facade for an archive of tabular data A facade for an archive of tabular data held in a RDBMS. Typically, it is used with held in a RDBMS. Typically, it is used with astronomical source-catalogues. DSA astronomical source-catalogues. DSA offers several web-service interfaces.offers several web-service interfaces.
Workbench – User’s PerspectiveWorkbench – User’s Perspective用户工作平台用户工作平台
Workbench – GUI (Graphical user interface) ApplicationWorkbench – GUI (Graphical user interface) Application Java WebStart / InstallerJava WebStart / Installer Rich user applicationsRich user applications
Data discovery – Astroscope & HelioscopeData discovery – Astroscope & Helioscope Task Launcher – run a single task ( e.g. SIAP query, remote Task Launcher – run a single task ( e.g. SIAP query, remote
applications, ADQL queries)applications, ADQL queries) Workflow Builder – combine CEA applicationsWorkflow Builder – combine CEA applications Lookout – Task Monitor and Result AccessLookout – Task Monitor and Result Access Myspace BrowserMyspace Browser Registy BowserRegisty Bowser
PLASTIC – exchange data with Topcat, Aladin, Vospece, PLASTIC – exchange data with Topcat, Aladin, Vospece, Visivo, Gaia, Specview, VOSpaceVisivo, Gaia, Specview, VOSpace Workbench does not analysis or visualization itself.Workbench does not analysis or visualization itself.
Scripting access to VO services (Python, Perl..)Scripting access to VO services (Python, Perl..)
Displays execution Displays execution progress and results fromprogress and results from Task Launcher tasksTask Launcher tasks WorkflowsWorkflows
Single place to look for Single place to look for progress information, progress information, execution transcripts, execution transcripts, resultsresults
PLASTIC integrated – PLASTIC integrated – local and staged results local and staged results can be passed to can be passed to applicationsapplications
Workflow BuilderWorkflow Builder
Building Complicated workflows (Drag and Building Complicated workflows (Drag and Drop)Drop)
DemonstrationDemonstration
Astro RuntimeAstro Runtime The Astro Runtime (AR) is a platform-independent (The Astro Runtime (AR) is a platform-independent ( 独立平台独立平台 ) )
executable that, in it's typical configuration, runs in the background executable that, in it's typical configuration, runs in the background on the user's desktop. It hides the complexity of the emerging VO on the user's desktop. It hides the complexity of the emerging VO system behind a simple, stable, consistent, self-contained façade. system behind a simple, stable, consistent, self-contained façade.
A library of virtual-observatory functions and clientsA library of virtual-observatory functions and clients Scope: integrate all VO standards, popular ad-hoc services, suitable Scope: integrate all VO standards, popular ad-hoc services, suitable
helper functionshelper functions Library is exposed as a desktop serviceLibrary is exposed as a desktop service
Accessible from almost all programming languagesAccessible from almost all programming languages XMLRPC, HTTP, RMIXMLRPC, HTTP, RMI
Trivial to install: Java WebStart; standalone; embedded.Trivial to install: Java WebStart; standalone; embedded. Minimal setup – no complication or native librariesMinimal setup – no complication or native libraries
Library design uses consistent abstractions and typesLibrary design uses consistent abstractions and types Cleaner API, fewer special cases, shallow learning curve, procedural / Cleaner API, fewer special cases, shallow learning curve, procedural /
object based design.object based design. Insulates client from change and detls.Insulates client from change and detls.
Shared componentShared component Single signon, single configurationSingle signon, single configuration Cached registry queries, other data.Cached registry queries, other data.
For more Information, Contact For more Information, Contact Noel Winstanley ([email protected])Noel Winstanley ([email protected])
PLASTIC PLASTIC
可塑者可塑者 Plastic is a protocol that allows heterogeneous Plastic is a protocol that allows heterogeneous
desktop applications to talk to each otherdesktop applications to talk to each other Plastic is a Plastic is a simplesimple messaging system messaging system
No security, encryption, guaranteed delivery, No security, encryption, guaranteed delivery, transactions etctransactions etc
Extensible via new messagesExtensible via new messages Publish-Subscribe architecture: “Publish-Subscribe architecture: “Plastic HubPlastic Hub”” Platform and language independentPlatform and language independent Communication over xml-rpc or JavaRMICommunication over xml-rpc or JavaRMI
More added if there's demandMore added if there's demand Based on the technologies in the AstroRuntimeBased on the technologies in the AstroRuntime
Why Plastic?Why Plastic?
It's very simple to implementIt's very simple to implement Your application can be “plasticized” in minutesYour application can be “plasticized” in minutes
Cross platformCross platform Language-agnosticLanguage-agnostic
Java, Python, Tcl, Perl, C++Java, Python, Tcl, Perl, C++ Large existing application-baseLarge existing application-base
>14 apps as of Oct 06>14 apps as of Oct 06 Access to the AstroRuntime and all IVOA services “for Access to the AstroRuntime and all IVOA services “for
free” – Aladin, Topcat etc…free” – Aladin, Topcat etc… For more Info: Contact For more Info: Contact John Taylor ([email protected])John Taylor ([email protected])
SummarySummary
Astrogrid welcome astronomers across the Astrogrid welcome astronomers across the world to be part of itworld to be part of it
China VO installation of Astrogrid China VO installation of Astrogrid Components onComponents on archive.lamost.orgarchive.lamost.org
Astrogrid trial route across the world: Astrogrid trial route across the world: http://thor.roe.ac.uk/weasl/index.faceshttp://thor.roe.ac.uk/weasl/index.faces
More Info: www2.astrogrid.org and More Info: www2.astrogrid.org and wiki.astrogrid.orgwiki.astrogrid.org
Simple DemoSimple Demo……
Thank You!Thank You!
