47
Analysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance analysis of irregularly sampled 7me series Debashis Mondal (U Chicago) Analysis of event data Mul?‐taper Analysis Examples: Time‐Frequency/Scale Distribu?ons Data Adap?ve Histograms Sta$s$cal Challenges in Modern Astronomy V

Analysis of Unevenly Spaced Time Series - · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

Embed Size (px)

Citation preview

Page 1: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

AnalysisofUnevenlySpacedTimeSeries

JeffScargleNASAAmesResearchCenter

Commentaryon:Waveletvarianceanalysisofirregularlysampled7meseriesDebashisMondal(UChicago)

 Analysisofeventdata Mul?‐taperAnalysis Examples:Time‐Frequency/ScaleDistribu?ons DataAdap?veHistograms

Sta$s$calChallengesinModernAstronomyV

Page 2: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

Cross‐andAuto‐Correla?onFunc?onsforunevenlyspaceddata

EdelsonandKrolik:“TheDiscreteCorrela?onFunc?on:aNewMethodforAnalyzingUnevenlySampledVariabilityData”

AstrophysicalJournal333(1988)646

Page 3: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

EdelsonandKrolik:TheDiscreteCorrela?onFunc?on:aNewMethodforAnalyzingUnevenlySampledVariabilityData,Ap.J.333,1988,646‐star?ngpointforallelse!

Evenlyspaceddata

Arbitrarilyspaceddata

Page 4: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 5: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

dt

Height=1/dt n/dt E/dt

Page 6: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

dt’=dt×exposure

Area=1/dt’ n/dt’ E/dt’

Page 7: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 8: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 9: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 10: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

DataMode

 Photonevents Time‐to‐Spill Countsinbins Fluxmeasurements AnyMode/Sampling! Universal

TimeSeriesAnalysisMachine

Auto‐ Correla?onFunc?on FourierPowerSpectrum FourierPhaseSpectrum Waveletscalgram Waveletscaleogram StructureFunc?on Time‐FrequencyDistribu?on Time‐ScaleDistribu?on …

JeffScargle

Page 11: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

DataMode

 Photonevents Time‐to‐Spill Countsinbins Fluxmeasurements AnyMode/Sampling! Universal

TimeSeriesAnalysisMachine

Cross‐ Correla?onFunc?on FourierPowerSpectrum FourierPhaseSpectrum Waveletscalgram Waveletscaleogram StructureFunc?on Time‐FrequencyDistribu?on Time‐ScaleDistribu?on …

JeffScargle

 Photonevents Time‐to‐Spill Countsinbins Fluxmeasurements AnyMode/Sampling!

anycombina$on

Page 12: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

Time‐Frequency/Time‐ScaleAnalysisTransformtoanewviewofthe$meseriesinforma$on.

 ARealityinjoint?me&frequency(orscale)representa?on Atomicdecomposi?on

 Time‐frequencyatoms Over‐completerepresenta?ons Op?malBasisPursuit(Mallat),etc.

 UncertaintyPrinciple:T‐Fresolu?ontradeoff Non‐sta?onaryprocesses

 Flares TrendsandModula?ons Sta?s?calchange‐points

 InstantaneousFrequency Localvs.Globalstructure Interference(cross‐termsinbi‐linearrepresenta?on)Time‐Frequency/Time‐ScaleAnalysis(Temps‐Fréquence)PatrickFlandrinhjp://perso.ens‐lyon.fr/patrick.flandrin/publis.html;AWavelettourofSignalProcessing(UneExplora?ondesSignauxenOndelejes)StéphaneMallat

12

Page 13: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

Mul?‐taperAnalysis(Thomson1982)

 Tapers(windows)reducesidelobeleakage=bias Incompleteuseofdatalossofinforma?on Mul?tapersrecoverthisinforma?on Leakageminimiza?on=eigenvalueproblem

 Eigenfunc?ons:efficientwindowfunc?ons Eigenvalues

 measureeffec?veness determinehowmanytermstoinclude

SpectralAnalysisforPhysicalApplica3ons:Mul3taperandConven3onalUnivariateTechniques,DonPercivalandAndrewWalden(1993)

13

Page 14: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

14

Page 15: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

15

Page 16: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 17: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

SYNCHROSQUEEZINGAconsistentandinver$ble$me‐frequencyanalysistoolthatcaniden$fyandextractoscilla$ngcomponents(of$me‐varyingfrequencyandamplitude)

E.Brevdo,N.S.Fučkar,G.Thakur,andH‐T.Wu,TheSynchrosqueezingalgorithm:arobustanalysistoolforsignalswith3me‐varyingspectrum,Submijed,2011(arXivid:1105.0010)

I.Daubechies,J.Lu,andH.‐T.Wu,Synchrosqueezedwavelettransforms:Anempiricalmodedecomposi3on‐liketool,AppliedandComputa?onalHarmonicAnalysis,2010.

Matlabtools:hjp://www.math.princeton.edu/~ebrevdo/synsq/

Page 18: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 19: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 20: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 21: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 22: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 23: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 24: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 25: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 26: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 27: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 28: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 29: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 30: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 31: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 32: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 33: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 34: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 35: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 36: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 37: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 38: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 39: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 40: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 41: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 42: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

Star?ngvalueforfitrou?ne

Page 43: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

Func7on Domain Range Auto‐ Cross‐ PhysicalInterp

Bayesianblk.LightCurve

Time Flux ✔ ✔mul?var.BB

Flares,eventsetc.

ScajerPlot Flux1 Flux2 ✔ Dependency(notjustcor.)

Correla?on Lag <X2><XY> ✔ ✔ Correlatedbehavior/lags

Spectrum Frequency Power ✔ ✔ Periodicity1/fnoise…

Phase ✔ ✔ Shizs,lags

Structure Lag <X2><XY> ✔ ✔ Correlatedbehavior/lags

Scalogram Scale/Time Power ✔ ✔ Dynamicbehavior

Scalegram Scale Power ✔ ✔ 1/fnoiseQPOs

Distribu?on Time/scale/frequency

Power ✔ ✔ Dynamicbehavior

Page 44: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance

HandbookofSta$s$calAnalysisofEventData

MatLabCode;Documenta?on;Examples;Tutorial…fundedbytheNASAAISRProgram

AdvancesinMachineLearningandDataMiningforAstronomy

Editors:MichaelWay,JeffScargleKamalAli,AshokSrivastava

ChapmanandHall,animprintofCRCPress(adivisionofTaylorandFrancis)

RandiCohen,ComputerScienceAcquisi?onsEditorDataMiningandKnowledgeDiscoveryseries

Page 45: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 46: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance
Page 47: Analysis of Unevenly Spaced Time Series -  · PDF fileAnalysis of Unevenly Spaced Time Series Jeff Scargle NASA Ames Research Center Commentary on: Wavelet variance