31
Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis http:// www.methodisthealth.com/ NCI-ICBP CMCD U54 Progress Report

Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis NCI-ICBP CMCD U54 Progress Report

Embed Size (px)

Citation preview

Page 1: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Fuhai Li, Ph.D.BBP-TMHRI, Feb 7 2011

3D Tumor Stem Cell Niche Image Analysis

http://www.methodisthealth.com/icbp

NCI-ICBP CMCD U54 Progress Report

Page 2: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Tumor Stem Cell Niche

J Rosen, BCM

Page 3: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

From 2D to 3D

From center grant proposal

DAPI GFP

Dextran Superimposed .44 μm X .44 μm X 1 μm

Page 4: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Specific Aim

Digitize 3D images of tumor stem cell niche & provide quantitative data for

• Tumor modeling• Blood vessel tracing• Nuclei segmentation

Page 5: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

What information is expected?Anything we can see, image,

and imagine! E.g.,

• Spatial distributions (in normal and tumor, before and after treatment) of blood vessels, stem cells, stroma, etc.

• Cell morphology, proliferation and death

From John, Tegy, Mei Zhang, Michael T. Lewis

Page 6: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Blood Vessel and Nuclei Segmentation

Page 7: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Blood Vessel Segmentation

(Tracing)

Technical Challenges:

Noise Signal

Broken Points and Vessel Crossing

Page 8: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

3D Blood Vessel Image

Page 9: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Maximum Intensity Projection (MIP)

Page 10: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Validation of Available Segmentation Software

http://research.mssm.edu/cnic/tools-ns.html

Page 11: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

NeuronStudio

http://research.mssm.edu/cnic/tools-ns.html

Page 12: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

V3D

http://penglab.janelia.org/proj/v3d/V3D/About_V3D.html

Page 13: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

FARSIGHT

http://www.farsight-toolkit.org/wiki/Main_Page

Page 14: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Multi-scale Filtering and Optimal Linking Based Approach

Page 15: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Multiscale Vessel Enhancement Filtering

2

2

2

, ,

, ,

, ,

I I Ix y x zx

I I IH I y x y zy

I I Iz x z y z

Hessian Matrix

Multiscale means image filtering with Gaussian filters (with different sigmas)The eigenvalues of Hessian matrix tell us where are the vessels

A. Frangi, et. al, MICCAI, 1998

Page 16: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Binary Image of MIP (Original)

Page 17: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Multiscale Vessel Enhancement Filtering

Page 18: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Removal of Debris

Page 19: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Skeleton Extraction

T.C. Lee, et. al, GVGIP, 1994

Page 20: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Binary

3D View

Page 21: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Optimal Linking by Integer Programming (ongoing)

1

, ,i i

i i

p p ip p

v p q I p

argmax ,all possible broken pairs

v p q

Cost function:

,p q can only be linked to at most to once!subject to:

Fitness termsmoothness term

Solving:

Page 22: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Nuclei Segmentation

Technical Challenges:

Uneven Intensity and Cell Clustering

Page 23: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

3D View

Page 24: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

FARSIGHT

3D Analysis

Page 25: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Flowchart of Nuclei Segmentation

Z-Series 2D Images

Adaptive Thresholding

Distance Transform(Shape Info.)

Seed Image(Non-Maximum Suppression)

LoG Filtering(Intensity Info.)

Level Set Segmentation

Page 26: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

2D Image Analysis

Page 27: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

TT

Proposed

3D Analysis

Page 28: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Refine & Define Nuclei by Ellipsoid Fitting

Low Z resolution

digital 3D tumor stem cell nichenucleus = {o, a, b, c, α, β}

Page 29: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Ongoing Work

1. Blood vessel smoothing & broken points linking

2. Nuclei ellipsoid fitting, Image quantification & dividing cell identification

3. Process large volumes of image data to derive information for tumor modeling

4. Graphic user interface (GUI) tools for image analysis, visualization & tumor simulation

Page 30: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

TT

Normal

Breast

Tissue

From Dr. Michael T. Lewis (John David Acquired)

Page 31: Fuhai Li, Ph.D. BBP-TMHRI, Feb 7 2011 3D Tumor Stem Cell Niche Image Analysis  NCI-ICBP CMCD U54 Progress Report

Acknowledgements

BBP-TMHRI:

Stephen Wong

Xiaofeng Xia

Hong Zhao

Derek Cridebring

BCM:

Michael Lewis

Mei Zhang

Mary Dickinson

John Landua

Tegy Vadakkan

Wei Wei

NIH NCI-ICBP U54 Grant Support