image analysis for fluorescence - school of medical sciences · • image analysis tools help to...
Post on 18-Mar-2020
3 Views
Preview:
TRANSCRIPT
Image Analysis for Fluorescence
Terminology Table
Image Analysis The extraction of meaningful information from digital images by means of digital image processing techniques.
Macro A macro is a pre-saved set of input parameters that have been adjusted for a specific application.
Colocalization
Analysis technique that determines the contribution of each dye at every pixel location.
Intensity
Intensity of a pixel is proportional to the dye emission strength in the same area. Intensity ranges from 0 (no detectable signal) up to 1023 (very strong signal) for images captured with a 10 bit setting. Analysis intensity input parameters (min and max) are from 0-1 representing the intensity scale from 0-100%.
Dye
Dye is the name of the fluorescent dye. There is no need to enter color values to deconvolve dyes for Aperio’s FL algorithms. Fluorescent images taken with Aperio’s ScanScope FL are separate monochrome images per dye that are pseudo-colored and fused to make one image.
AFI Aperio Fused Image -The AFI file is a special type of image file. It is a composite file that points to the separate channel images that make up the fused image.
Page 2
FL Image Analysis Illustrated Image Analysis extracts meaningful data:
• Analyzing fluorescent digital slides helps you quantitate the area of staining of a particular biomarker.
• Image analysis tools help to automate such repetitive processes and provide quantitative data that is accurate and repeatable, telling you more about each slide beyond the capabilities of manual microscopy.
• Aperio’s FL image analysis can provide valuable area and intensity data and answer questions such as:
• How much area of the tissue is stained for a particular biomarker? • What is the average intensity of the biomarker staining throughout the tissue or region
of interest? • Do multiple biomarkers co-localize in the tissue, or in the cells, and if so, to what
extent?
Image Analysis tools can present a markup image to highlight analysis results.
Page 3
Original Markup
FL Image Analysis Illustrated How Image Analysis works:
• Apply an algorithm directly to the whole digital slide image or selected region of the digital slide image.
• Aperio ScanScope FL images are comprised of separate images (one for each fluorescent dye on the slide) resulting in an Aperio Fused Image or AFI. Since images are captured during scanning as monochrome images and pseudo-colored based on a reference chart (by the dye’s name) pixels are already separated by the fluorescent dye or dye.
• Image analysis algorithms measures pixel intensity (proportional to dye emission) to determine the average intensity of single dyes and when dye appear together.
• Image analysis algorithms count pixels to determine: • Area of analysis. • The total area of staining (all dyes). • The area of single dyes. • The area of dyes appearing in combination (in the same pixel location).
0
1023 Intensity: 0 = signal undetectable 1023 = very strong signal Image analysis scales the intensity range 0-1 (0-100%)
Page 4
Pixel
DAPI
CY3
CY5
Aperio Image Analysis Tools
FDA Cleared: Her2 510(k) & ER/PR 510(k) Area Quantification
Positive Pixel Count FL Area Quantification FL Positive Pixel Count Color Deconvolution Colocalization
Object Identification Microvessel Analysis Rare Event Detection
Cell Quantification Nuclear Membrane
Page 5 Page 5
Note: User guides, manuals training presentations and demo videos are available on Aperio’s Member Center at: members.aperio.com
Each algorithm has a set of control parameters that allow you to tailor it to your specific needs. Several of Aperio's image analysis algorithms are FDA cleared for specific clinical applications, and are intended for research use for other applications. Note that each algorithm has it’s own user guide. Please see the Intended Use section of the respective user guide for the specific cleared applications you wish to use and for details on in vitro diagnostic use.
Aperio Image Analysis Tools
Aperio Image Analysis Algorithm
Genie Histology
Pattern Recognition
Combined Image Analysis Tool
(Algorithm + Genie ) A smart tissue classifier that recognizes significant tissue components coupled with an FL image analysis algorithm.
Genie is intended for research use only. Genie is not covered in Image Analysis 101 for Fluorescence. Please see TRN-0017 for user related course content.
Page 6 Page 6
Positive Pixel Count FL:
• Quantifies the area and intensity of a selected fluorescent dye.
• Area and area fraction analysis, for example, analysis of fluorescent digital slides showing amyloid plaque myelin and nuclei.
• Licensed without fee with other Aperio software.
Aperio Image Analysis FL Tools
Page 7
Markup
Original
Amyloid Plaque Quantification
Area Quantification FL:
• Quantifies the area and intensities of up to 3 dyes. • Area and colocalized marker analysis, for example, analysis of fluorescent digital
slides showing gene and protein expressions.
Aperio Image Analysis FL Tools
Page 8
Pancreatic Islet Protein Expression
Markup Original
Aperio Image Analysis Tools Histology Pattern Recognition
• Genie: A smart tissue classifier that recognizes significant tissue components and aids analysis.
Page 9
Islet Exocrine
Classification
Quantification
Original
Page 10
Viewing Fluorescence Slides Viewing Fluorescence Slides in ImageScope
• Images from the ScanScope FL are grayscale images, pseudo-colored during the scanning process.
• ImageScope offers a full range of fluorescence features for ScanScope FL fused (composite) Images:
• Change the display color for each channel image.
• Adjust brightness, contrast, and gamma (viewing the results on the image and on a histogram display).
• Hide image channels or display them in grayscale.
• Adjust registration between channels.
Original
Color Adjustments
Channel in Grayscale Channels Hidden
Note: Modifying viewing options in ImageScope does not affect the analysis.
Performing Analysis Selecting Areas to Analyze
• Analyze entire digital slide or selected areas. • Use ImageScope drawing tools to select or exclude areas to analyze.
Pen - draw free-form area of interest. Negative Pen – draw free-form area to exclude from analysis. Rectangle – draw a rectangular area of interest.
Page 11
View annotation information in ImageScope’s Annotations window.
Performing Analysis Methods to Run Analysis
In most cases, it is expected that a digital slide will be opened in Spectrum. For this training, all images will be opened in Spectrum.
Page 12
• Open a local digital slide image (that is, an image on your workstation or on the network where your workstation can see it via Microsoft file sharing) and analyze using ImageScope.
• Use ImageScope to connect to an image on an Aperio ImageServer.
ImageScope Analysis
• Open an image from Spectrum and initiate analysis using a Spectrum
licensed algorithm macro.
Spectrum Plus Analysis
• Analyze a batch of digital slide images that reside on the ImageServer by selecting multiple images and using Spectrum’s Analyze command Batch Analysis
Page 13
ImageScope Image Analysis Analysis Workflow – Using an Existing Macro
• Run analysis using a macro with input parameters already tuned for your application.
Ready to analyze an image.
Select view menu>analysis,
choose macro and analysis options and click Analyze.
View results.
Spectrum
Licensed Image
Analysis Algorithms
on Spectrum
Macros are pre-saved sets of algorithm input parameters that have been adjusted for specific image analysis applications.
Dye
Intensity
Other Inputs
Page 14
ImageScope Image Analysis Analysis Workflow – Modifying an Existing Macro
• Select an existing macro, modify the input parameters for your application and save.
Ready to analyze
an image.
Are the results & markup
acceptable?
Select view menu>analysis, select
macro name and click Test button.
Test Window Adjust input parameters for your
slide/application. Use Tuning window as needed.
Click Run to analyze and get test results.
Click Save macro from test
window.
Select view menu>analysis,
choose macro and analysis options and click Analyze.
YES NO
Spectrum
Licensed Image
Analysis Algorithms
on Spectrum
Select view
menu>analysis, choose macro and analysis options and click Analyze.
View results.
Page 15
ImageScope Image Analysis Analysis Workflow – Creating a New Macro
• Use this method if the algorithm has not been used and saved as a macro. • Use to create a macro using the algorithm’s default parameters.
Ready to analyze
an image.
Are the results & markup
acceptable?
Spectrum
Licensed Image
Analysis Algorithms
on Spectrum
Select view menu>analysis and click Create button.
Test Window Adjust input parameters for your
slide/application. Use Tuning window as needed.
Click Run to analyze and get test results.
Click Save macro from test
window.
Select view menu>analysis,
choose macro and analysis options and click Analyze.
YES NO
Select view
menu>analysis, choose macro and analysis options and click Analyze.
View results.
Select an algorithm to
modify
Page 16
ImageScope Image Analysis Analysis Window
• When performing analysis on an image opened from Spectrum, the Algorithm Server Job displays registered macros.
• Go to the Test window to modify input parameters or click Create to make a new Macro.
List of macros
Analysis options
Analysis Buttons Test – modify existing macro for selected algorithm and test before saving. Create – creates new macro based on the original algorithm. Analyze – run analysis. Cancel – cancel current analysis job.
Page 17
ImageScope Image Analysis Test Window – test out input parameters before saving them
• Tune algorithm input parameters and view results, select outputs displayed in Spectrum and save settings as a new macro.
List of input parameters
Analysis options
List of output parameters (to display in Spectrum)
Tune – Allows operators to see instant markup up results in a separate window and results in the annotations window while adjusting the algorithm’s input parameters. Run – run analysis.
Turn on result plots here!
Select Algorithm – select to load an algorithm with its default settings. Import Macro – import an image analysis macro. Save Macro – save an image analysis macro to Spectrum.
Note: If image was opened and analyzed locally, an Export Macro button will appear instead on the Save button.
ImageScope Image Analysis Creating New Macros – from your licensed algorithms
• Only users with the appropriate Spectrum administrator permissions can create new macros and register them in Spectrum.
• After opening a digital slide in ImageScope, open the View menu and select Analysis.
• Click Create, the Select an Algorithm window appears. • Select the Algorithm you want to create a macro for, the Analysis window appears.
Page 18
Note: ImageScope may highlight the last selected macro in this window; ignore this and click Create.
Note: Algorithms selected for this list will have their default input parameters.
ImageScope Image Analysis Creating New Macros
• Modify the parameters. • Use the Tuning window to see the
effect of the parameter changes. • Run analysis and continue to adjust
the inputs until desired results are achieved.
Page 19
Remember, the output button allows you to select the results that will appear in Spectrum.
Modify input parameters
Tuning window
ImageScope Image Analysis Creating New Macros
• Select Save Marco button. • Name the macro with a naming
convention that helps identify it and its application.
• Using the same name as an existing macro will display a prompt asking if you want to overwrite the existing macro.
Page 20
Once saved, your new macro will appear in the Analysis window’s list of macros.
Page 21
ImageScope Image Analysis More on the Algorithm Tuning Window
• Quickly see the results of analyzing an area of an image or test changes made to the algorithm parameters.
Toggle on/off markup
Page 22
ImageScope Image Analysis More on the Algorithm Tuning Window
• As the parameters are changed, the Tuning window will display the markup image for current parameters.
• The Annotations window displays the numerical results in a Tuning Layer.
After parameter change
Immediately see results after parameter changes!
Note: Upon closing the Tuning window, the Tuning Layer disappears. Analysis results from the tuning layer cannot be saved.
ImageScope
Inputs entered in ImageScope from the Test window.
Spectrum
Inputs from saved macro or from the default algorithm.
Analysis Output or Results
Other Attributes
Intensity Dye(s)
Analysis Inputs
Analysis Parameters
• Inputs • Dye(s)– Typing in the Dye name
points the algorithm to the correct component image of the AFI (or dye color channel).
• Intensity – Dye intensity minimum and maximum values determine the intensity range to be analyzed.
• Other Attributes: • Markup Image Type – Color
coding of pixels to display area of dye (single dye and or combination of dyes together).
• Display Plots - Select to display result plots and set histogram start/end values and number of bins.
Page 23
ImageScope Image Analysis
-OR-
Analysis Output or Results
Other Attributes
Intensity Dye(s)
Analysis Parameters
• Outputs (Analysis Results) • Area and Intensity Results
• Total area of analysis (mm2). • Total stained area (mm2). • Total area of each dye (mm2). • Percent for each dye. • Average intensity for each dye. • Percent and intensity colocalized
dye results. • Result plots.
• Markup • A color coded layer displayed
over the area of analysis that corresponds with the analysis results.
• Displays only the pixels that fall within the set intensity range.
• The markup layer displays colors that match the pseudo-colors used to color the grayscale images in the scanning process.
Page 24
ImageScope Image Analysis
Analysis Outputs
Spectrum
Analysis saved in Spectrum (If performed
server-side).
ImageScope
Analysis results displayed in
ImageScope in the Annotations
window.
Sever- side analysis: When an image is
accessed from Spectrum and
analyzed using an Spectrum licensed
algorithm.
ImageScope Image Analysis Analysis Results - ImageScope
• Layer Attributes - results for entire layer (all regions analyzed). • Layer Regions - results per region analyzed. • View result plots - click the Display Plots button in the Layer Attributes pane. • Export from ImageScope - click the Export button in the Layer Attributes pane
to export to an Excel spreadsheet.
Page 25
ImageScope Image Analysis Analysis Results - Spectrum
• Spectrum analysis results – analysis column must be displayed in the Digital Slide table to view the analysis results.
• Select image checkbox and click Export Data link to export data from Spectrum.
Page 26
Analysis Column
Select image for data export
Click Export Data
Page 27
Positive Pixel Count FL Positive Pixel Count FL
• Positive Pixel Count FL looks for pixels for the dye specified within the intensity range set (minimum and maximum).
• Outputs: • Total area of analysis (mm2). • Total area of specified dye (mm2). • Mean intensity of specified dye .
Original Markup
The markup image displays only the pixels that fall within the set intensity range for the specified dye. The markup image color matches the pseudo-color used for that dye in the scanning process.
Positive Pixel Count FL Inputs - Workflow
Positive Pixel Count FL
Page 28
1. Enter dye name.
• Enter fluorescent dye name.
2. Set intensity thresholds.
• Set the dye intensity minimum and maximum intensity thresholds.
Positive Pixel Count FL Positive Pixel Count FL Inputs
• Input parameters allow the user to identify the fluorescent dye or dye the and intensity thresholds.
• The user enters the dye as it appears in the ImageScope Image Fusion Adjustments window. This specifies the target color channel/component image of the AFI for analysis.
Dye name and intensity thresholds
Genie parameters
Page 29
Default for ScanScope images
Positive Pixel Count FL Positive Pixel Count FL Analysis Results
• Analysis results are viewed from the Annotations Window in ImageScope. • PPC analysis results are area based quantification and intensity values.
• If running analysis in ImageScope, a false color Markup image can be generated.
Positive Pixel Count FL results: Total area of analysis, the total area of specified dye and its mean intensity.
Input parameters are always saved with the analysis results.
Results are color coded to match the dye’s pseudo-color used in the scanning process
Page 30
Area Quantification FL
• Quantifies the area and intensity of each dye and within combinations of dyes. • Good for analysis of “colocalized” markers. • Quantification FL analysis calculates the contribution of each dye at every
image pixel as either part of a single dye or representing a dye combination. • Outputs:
• Total Analyzed Area • Total Stained Area • Percent area of dye and average intensity (for single dyes and dye combinations).
Area Quantification FL
Page 31
Original All Dyes Dye -3 (only)
All pixels where dyes appear (alone and with other dyes)
Dye -2 (only)
Pixels where dyes appear alone w/o other dyes
Pixels where dyes appear only in specified combinations
Dyes 1+2
Area Quantification FL – Tuning
• Area Quantification FL Tuning Markups • All Dye 1, Markup displays image channel for dye 1 only (in grayscale) and false colors
only the pixels within the intensity ranges. • All Dye 2, Markup displays image channel for dye 2 only (in grayscale) and false colors
only the pixels within the intensity ranges. • All Dye 3, Markup displays image channel for dye 3 only (in grayscale) and false colors
only the pixels within the intensity ranges.
Area Quantification FL
Page 32
Alexa Fluor 647
Tuning All Dye -3
DAPI
Tuning All Dye -1
Alexa Fluor 532
Tuning All Dye -2 Original
Area Quantification FL Area Quantification FL Inputs - Workflow
Page 33
1. Enter the number of dyes, and dye names.
• Enter the number of dyes (1-3). • Enter the fluorescent dye names.
2. Set intensity thresholds.
• Set the dye intensity minimum and maximum intensity thresholds for each dye.
3. Set markup image type and
enter plot values.
• Select the Markup Image Type. • Enter plots start and end values and the number
of bins.
Area Quantification FL Area Quantification FL Inputs
• Number of Dyes to Colocalize - 1, 2, 3 • Dye 1, 2, 3 - Enter the dye name
displayed in ImageScope’s Image Fusion Adjustments window for each dye you want to include as part of the analysis.
• Intensity Thresholds - Min and Max threshold and # of bins for dyes 1, 2 & 3.
• Markup Image Type • Tuning Dyes (1, 2, 3) • Colocalized – All Dyes • Colocalized – 1 only, 2 only, 3 only, 1+2
only, 1+3 only, 2+3 only, 1+2+3.
• Display Plots - View result plots. • Histogram Start/End Values
Intensity Lower and Upper Threshold parameters
Page 34
Default Dyes: Dye (1) = DAPI Color (2) = FITC Color (3) = TRITC
Select Mark-up Image Type
Select Yes to display Plots with results. Enter Start, End values and number of Bins
Pick number of dyes.
How to access Please contact Dr Maria Sarris if you wish to use this image analysis algorithm. All algorithms apart from the
Positive Pixel Count are licensed and need to be installed on your workstation (please note: charges apply).
Step 1: Extract the region at full resolution that you want test on your desktop. Extracting Image Using the Extraction Tool to remove a select region of the active image. Click on in the toolbar. Place your cursor on the digital slide. Click and drag a rectangle on the screen to capture the area: Choose output File location Choose Output/Compression File type Click Extract Step 2: Open image in Imagescope Step 3: Go to VIEW then ANALYSIS Step 4: Select Algorithm and then click on TEST Step 5: Make your adjustments (optimise algorithm) Step 6: When satisfied with your adjustments click EXPORT MACRO Step 7: Save to your desktop with your name and original algorithm name and version eg SARRIS Nuclear V9 Step 8: Once the algorithm is saved please email m.sarris@unsw.edu.au. The algorithm will on the server in the
Spectrum Analysis dropdown menu within 24 hrs.
Page 35
top related