PythonData-AnalysisTools

HarryFergusonJWSTProposalPlanningWorkshop

18May2017

1

MoAvaAon

DataAnalysisTools•  EnablerigorousscienAficanalysis,fast•  Thesetoolsarewheretheastronomer

interactswiththedata.•  Manycommontasksacrossmissions&

observatories&scienAficdisciplines:–  Convert,combine,measure,model,visualize

•  Mustbebuiltonrich,robustscienAficlibraries•  Mustbeflexible,powerfulanduser-friendly•  Mustbewelldocumented

2

Data

AnalysisTools

Knowledge

WhousesPythonastheirgo-tolanguagefordataanalysis?

3

Whodoesn’tnowbutthinkstheymightinthenearfuture?

4

Tiersandkeydependencies

Languages

ScienAfic&numericallibraries

Astronomicallibraries

InteracAvevisualizaAontools

STScI-ledDataAnalysisTools

DATEfforts

6

JWSTToolsJWSTusecasesJWSTdataformats

CSI*GeneralusecasesCommunitydrivenAURAcoordinaAon

HSTToolsIRAFworkflows->PythonNotebooks,tutorials,tools

*CSI:CommunitySobwareIniAaAve

AstroConda: One-stop shopping

•  New distribution mechanism for all public STScI software–  Powered by Anaconda distribution tool–  Single command install of the python ecosystem–  Includes:

•  Data Analysis Tools/Astropy•  HST pipelines•  JWST pipelines•  non-python: IRAF, ds9, cfitsio, freetds

http://astroconda.readthedocs.io

JWST Data Analysis "Ecosystem"

Astronomy Python Tool Development at STScI

Astropy (mostly external)

cosmologyconstants

affiliated packages

CSI

Specutils

astropy-helpersWCS

astroquery

FITS

tutorials

nddatacoordination

JWST Tools

Spectral interactive toolsImage interactive tools

training & documentationsoftware distribution

data structures (gwcs, asdf…)Registration & combination

photometry tools

IRAF replacement

Jupyter notebooks

Augment python library

Build replacement pkgIRAF switchers guide

Assess usage

IRAFTransiAon•  >2000tasksintheIRAFdistribuAon

•  ~1000withincurrentscopeofprojectoverafewyearAmeline

•  HSTfundedworktotransiAonaway•  Jupyternotebookworkflowsfor

simpletasks•  Directorimprovedreplacements

forcriAcaltasks

•  STAKproject(notyetreleased)•  Libraryforthereplacementcode•  Homeofthenotebooks•  hgp://stak.readthedocs.io

•  JusAnEly,SaraOgaz,…

CommunitySobwareIniAaAve

CSIFillsUrgentNeeds

•  Stopgapfundingsourceforcoreinfrastructure– FITS,World-coordinates,Astropybuildtools

•  CoordinaAonbetweenAURAcenters(andbeyond)– Generalizedworld-coordinatesystems– Generaldatastructuresforspectroscopy

•  BegerdocumentaAonandtutorials

CSI2017plans

CSIsponsoredworkshop

WhousesAstropyregularly?

15

JWSTDataAnalysisTools

16

Harry Ferguson, Justin Ely, Susan Kassin, Jay Anderson, Larry Bradley, Ivo Busko, Mihai Cara, Nicholas Earl, Jonathan Eisenhamer, Perry Greenfield, Pey-Lian Lim, Thomas Robitaille, Megan Sosey, Erik

Tollerud, Matt Hill, Mario Gennaro, Gisella de Rosa, Martha Boyer & the JWST Data Analysis Development Forum

JWST Data Analysis: 5 Long Term Goals for Spring 2019 1.  Enable analysis on un-resampled data, such as photometry,

profile fitting, and spectral modeling of 1D/2D spectra and data cubes. (DMS-233, 630, 632, 633)

2.  Build infrastructure to enable rapid development of analysis tools by the community. –  Standards for data formats, in-memory data structures,

classes, and methods (DMS-233) –  Well-documented and well-integrated with all JWST tools

3.  Provide interactive spectroscopic data analysis tools. (DMS 233)

4.  Provide interactive image analysis tools. (DMS 233)

5.  Provide support for tools for constructing JWST point and line-spread functions for a given observation. (DMS 634)

WhohasusedGinga?

18

WhohasusedGlue?

19

JWSTDAT2017PlansThisYear

2018+

Howtogetinvolved

•  Contributecodeoralgorithms•  UsertesAngofearlyreleases

•  Specviz,PhotuAls,Glue&GingaarehighprioriAesforuserfeedback

•  Contributetutorials(wriAngorreviewing)•  Suggesttools,features•  Suggesttutorials•  ParAcipateinSprints

WhohasusedPhotuAls?

22

WhohastriedSpecViz?

23

Videos

•  SpecViz•  CubeViz•  MosViz•  Gingaplugin

WhatworkflowsdoyouwishwereeasierinPython?

25