![Page 1: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/1.jpg)
HARVARD MEDICAL SCHOOL
Color aspects and Color Standardization in Digital Microscopy
Yukako Yagi, PhD [email protected]
Director of the MGH Pathology Imaging & Communication Technology Center
Assistant Professor of Pathology, Harvard Medical School Affiliate Faculty, Wellman Center for Photomedicine, MGH
![Page 2: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/2.jpg)
HARVARD MEDICAL SCHOOL
Today’s Topics
Towards Standardization
Color Aspects
Types of Color Issues in WSI
Color Standardization
![Page 3: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/3.jpg)
HARVARD MEDICAL SCHOOL
Towards Standardization
![Page 4: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/4.jpg)
HARVARD MEDICAL SCHOOL
Standardization of the image quality and the color displayed are important aspects of digital pathology implementation. While the most common reason for the variations of color and image quality is the variance in the protocols and practices in the histology lab, the image displayed can also be affected by variation in capture parameters, image processing and display factors in the digital systems themselves. It is difficult to identify which exactly causes the problem.
Standardization in Digital Microscopy
![Page 5: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/5.jpg)
HARVARD MEDICAL SCHOOL
1. To Notice To realize the image quality and color issues are often
present in the images we use
2. To Identify To identify the causes of issues in WSI
3. To Solve To develop the methodologies to improve the color and
image quality of WS images
4. To Promote To introduce the methods solutions to the public
Steps: Towards Color and Image Quality Standardization
Standardization
Today, we focus on “color” in Whole Slide Imaging (WSI)
![Page 6: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/6.jpg)
HARVARD MEDICAL SCHOOL
Color Aspects
![Page 7: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/7.jpg)
HARVARD MEDICAL SCHOOL
Thickness of Specimen Staining Scanner or Scanning process Viewer Software Display
Color Aspects in Digital Pathology
![Page 8: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/8.jpg)
HARVARD MEDICAL SCHOOL
Thickness of Specimen Staining Scanner or Scanning process Viewer Software Display
Color Aspects in Digital Pathology
![Page 9: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/9.jpg)
HARVARD MEDICAL SCHOOL
3um
3um 6um 7um 5um 4um 5um 6um 7um 8um
3um 3um
Thickness of Specimen & Staining Thicker sections are stained more by the automated staining machine
![Page 10: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/10.jpg)
HARVARD MEDICAL SCHOOL
2um
9um
More details can be seen on slides of thinner sections
Thickness of Specimen & Staining
![Page 11: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/11.jpg)
HARVARD MEDICAL SCHOOL
The appearance of stained slide varies between laboratories or institutions Examples of H&E stained variations caused by variations in staining protocols
Thickness of Specimen & Staining
![Page 12: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/12.jpg)
HARVARD MEDICAL SCHOOL
Color issues in WSI 3D (Staining)
Original
Standardized
![Page 13: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/13.jpg)
HARVARD MEDICAL SCHOOL
Before color normalization
![Page 14: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/14.jpg)
HARVARD MEDICAL SCHOOL
After color normalization
![Page 15: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/15.jpg)
HARVARD MEDICAL SCHOOL
Thickness of Specimen & Staining issues in serial sections of WSI
![Page 16: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/16.jpg)
HARVARD MEDICAL SCHOOL
Color appearance
slides from same block
Thickness of Specimen & Staining issues in serial sections of WSI
![Page 17: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/17.jpg)
HARVARD MEDICAL SCHOOL
Thickness of Specimen Staining Scanner or Scanning process Viewer Software Display
Color Aspects in Digital Pathology
![Page 18: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/18.jpg)
HARVARD MEDICAL SCHOOL
Same slide, different scanners
Scanner or Scanning Process
![Page 19: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/19.jpg)
HARVARD MEDICAL SCHOOL
Same slide, different scanners Scanner or Scanning Process
![Page 20: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/20.jpg)
HARVARD MEDICAL SCHOOL
miraxlung.jpg
Scanner A Scanner B
Scanner or Scanning Process IHC
IHC Double Stains
![Page 21: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/21.jpg)
HARVARD MEDICAL SCHOOL
Scanner A Scanner B
Scanner or Scanning Process IHC
H&E
![Page 22: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/22.jpg)
HARVARD MEDICAL SCHOOL
Thickness of Specimen Staining Scanner or Scanning process Viewer Software Display
Color Aspects in Digital Pathology
![Page 23: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/23.jpg)
HARVARD MEDICAL SCHOOL
Same scanner, same slide, two different viewers
Viewer Software
![Page 24: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/24.jpg)
HARVARD MEDICAL SCHOOL
Thickness of Specimen Staining Scanner or Scanning process Viewer Software Display
Color Aspects in Digital Pathology
![Page 25: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/25.jpg)
HARVARD MEDICAL SCHOOL
Same images in same PC were viewed by 2 different displays
Display
![Page 26: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/26.jpg)
HARVARD MEDICAL SCHOOL
Same image in same PC was viewed by 3 different displays
Display
![Page 27: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/27.jpg)
HARVARD MEDICAL SCHOOL
Example Experiment: Color of Display
![Page 28: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/28.jpg)
HARVARD MEDICAL SCHOOL
In color-related fields, a color chart is a physical arrangement of standardized color samples, used for color comparisons and measurements such as in checking the color reproduction of an imaging system. Color charts are used to calibrate and to profile graphic devices, such as digital cameras and scanners. Therefore standardized IT8 targets are made by several companies.
Macbeth Color Chart
![Page 29: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/29.jpg)
HARVARD MEDICAL SCHOOL
Display
Experiment with Macbeth Color Chart at the Department of Pathology in MGH
The standard displays of our Department are of 2 different models. We randomly selected 23 standard displays from one of the two models for this experiment. All driver software and display settings were exactly the same for all the 23 displays.
We measured the each color on each display by Display
Analyzer. If the data is too offset, we calibrated using Monitor
Calibration tool
![Page 30: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/30.jpg)
HARVARD MEDICAL SCHOOL
Macbeth Color Chart RGB Value
0
50
100
150
200
250
300
1 3 5 7 9 11 13 15 17 19 21 23
Series1
Series2
Series3
![Page 31: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/31.jpg)
HARVARD MEDICAL SCHOOL
Red Value 23 Displays
0
20
40
60
80
100
120
140
160
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
#1#2#3#4#5#6#7#8#9#10#11#12#13#14#15#16#17#18#19#20#21#22#23
Chart Color #
Red Value
0
50
100
150
200
250
300
1 3 5 7 9 11 13 15 17 19 21 23
Series1
Series2
Series3
![Page 32: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/32.jpg)
HARVARD MEDICAL SCHOOL
0
20
40
60
80
100
120
140
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
#1#2#3#4#5#6#7#8#9#10#11#12#13#14#15#16#17#18#19#20#21#22#23
Chart Color #
Green Value 23 Displays Green Value
0
50
100
150
200
250
300
1 3 5 7 9 11 13 15 17 19 21 23
Series1
Series2
Series3
![Page 33: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/33.jpg)
HARVARD MEDICAL SCHOOL
0
10
20
30
40
50
60
70
80
90
100
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
#1#2#3#4#5#6#7#8#9#10#11#12#13#14#15#16#17#18#19#20#21#22#23
Blue Value 23 Displays
Chart Color #
Blue Value
0
50
100
150
200
250
300
1 3 5 7 9 11 13 15 17 19 21 23
Series1
Series2
Series3
![Page 34: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/34.jpg)
HARVARD MEDICAL SCHOOL
Example of Color differences: before calibration and after calibration
Chart Color #
before calibration
After calibration
![Page 35: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/35.jpg)
HARVARD MEDICAL SCHOOL
Pathologists were looking at same image without noticing the differences in color. After the calibration, the color differences were clearer.
Results: Experiment with Macbeth Color Chart at Dept of Pathology, MGH
Probably, it is not good to use the WSI ?? User should be able to notice the color shift of his own display
![Page 36: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/36.jpg)
HARVARD MEDICAL SCHOOL
Until we showed the result, no one noticed how bad our
displays were
![Page 37: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/37.jpg)
HARVARD MEDICAL SCHOOL
Why is it problem?
![Page 38: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/38.jpg)
HARVARD MEDICAL SCHOOL
Scanning
Display Staining
Is it problem?
![Page 39: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/39.jpg)
HARVARD MEDICAL SCHOOL
Scanning
Display Staining
Is it problem?
Pathologist looks at an actual slide under the microscope
Yes
![Page 40: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/40.jpg)
HARVARD MEDICAL SCHOOL
Is it problem? Yes
It may cause diagnostic error; or pathologists may be uncomfortable to make a diagnosis.
When a pathologist looks at the image on the monitor without a glass slide, it is difficult to know if the color of the image is accurate or not.
![Page 41: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/41.jpg)
HARVARD MEDICAL SCHOOL
Is it problem?
![Page 42: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/42.jpg)
HARVARD MEDICAL SCHOOL
7.9% 8.8%
Is it problem? Yes
![Page 43: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/43.jpg)
HARVARD MEDICAL SCHOOL
7.9% 8.8%
Is it problem? Yes
•When we use it for Computer Aided Diagnostic System or image analysis
![Page 44: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/44.jpg)
HARVARD MEDICAL SCHOOL
Color Standardization in WSI
•To prevent diagnostic errors •To use WSI for Computer Aided Diagnostic System
![Page 45: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/45.jpg)
HARVARD MEDICAL SCHOOL
The reason of Color Standardization for us
• Between scanners • To make sure the color (WSI) is safe to use before showing pathologists or using for analysis
![Page 46: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/46.jpg)
HARVARD MEDICAL SCHOOL
Scanning
Display Staining
Color Standardization in WSI From Staining to Display
Viewer software
![Page 47: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/47.jpg)
HARVARD MEDICAL SCHOOL
Scanning Display
Staining
Color Standardization in WSI: From Staining to Display
Multispectral Imaging
application Today’s topics
![Page 48: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/48.jpg)
HARVARD MEDICAL SCHOOL
How can we identify the cause of the difference in color and standardize?
![Page 49: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/49.jpg)
HARVARD MEDICAL SCHOOL
To identify the causes of issues in
WSI
Calibration Slides for Scanner
Calibration Slides for Pathologist (Display)
Image Quality & color
Color
Color
We have developed a slide set at MGH
![Page 50: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/50.jpg)
HARVARD MEDICAL SCHOOL
Color Calibration Slide (Overview of telepathology, virtual microscopy, and whole
slide imaging: prospects for the future, Ronald Weinstein et al. In Human Pathology, 2009)
9 color filters were selected for Histology Stained Slides, which especially works best with H&E stained slides. The filter selection was based on spectral information of each color. Previously, a research study was conducted.
Original Slide for Microscope
![Page 51: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/51.jpg)
HARVARD MEDICAL SCHOOL
15-day old or older mouse embryo paraffin block is sectioned by automated sectioning machine with 3um/section. (100 slides at a time)
Image Quality Slide
![Page 52: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/52.jpg)
HARVARD MEDICAL SCHOOL
•H&E stain is performed with an automated staining machine at the same time. •All Slides are scanned with one of the scanner in the lab and scanned images are posted on the web site.
Image Quality Slide
![Page 53: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/53.jpg)
HARVARD MEDICAL SCHOOL
Display for the Viewer
Go to Calibration slide web of PICT Center, MGH
Compare the color of calibration slide vs calibration slide on the display. If it is too far, contact HELP DESK
This Slide is hand made in the lab. The cost is very close to 0. It can be given
to all pathologists
![Page 54: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/54.jpg)
HARVARD MEDICAL SCHOOL
Scanning Review Display
VS
The Imaging web site has the colors of the Calibration slide.
Compare the displayed colors of the calibration slide to their actual colors to understand the difference
Scanner
The Imaging web site has Calibration slide.
![Page 55: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/55.jpg)
HARVARD MEDICAL SCHOOL
Almost all colors are
wrong
Results: Scanner 1
![Page 56: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/56.jpg)
HARVARD MEDICAL SCHOOL
Results: Scanner 2
Better than Scanner 1.
Especially Pink and Blue are
wrong
![Page 57: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/57.jpg)
HARVARD MEDICAL SCHOOL
Results: Scanner 3
Better than Scanner 1.
Especially Green and Yellow are
wrong
![Page 58: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/58.jpg)
HARVARD MEDICAL SCHOOL
Results 20x vs 40x of the scanner 1
Original
40x 20x
Original
20x 40x
![Page 59: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/59.jpg)
HARVARD MEDICAL SCHOOL
Results
We have tested 5 different scanners with the calibration slides. No scanner produced exactly same color with the original even after the adjustment of the error of each Display
![Page 60: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/60.jpg)
HARVARD MEDICAL SCHOOL
Image Quality Evaluation & Color Standardization
![Page 61: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/61.jpg)
HARVARD MEDICAL SCHOOL
Color Standardization
![Page 62: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/62.jpg)
HARVARD MEDICAL SCHOOL
Color patches
Original Reference
Standardize using the original and reference color patches
Original Reference
Original - Produced by a whole slide scanner
Colors are not accurate enough
Reference - Produced by using spectral information of the patches
![Page 63: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/63.jpg)
HARVARD MEDICAL SCHOOL
Polynomial transformation
HARVARD MEDICAL
SCHOOL
Reference color of the color patches
Color of the patches as produced by a particular scanner
Each scanner will have its own Color transformation matrix
Color transformation matrix will be stored for used in color standardization
![Page 64: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/64.jpg)
HARVARD MEDICAL SCHOOL
Whole slide scanners and Color Imaging
Whole slide scanner 1 (WSI 1)
Whole slide scanner 2 (WSI 2)
Use the mouse embryo slide to
confirm the color transformation
matrix
H&E stained images
The same tissue slide scanned by different scanners .
![Page 65: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/65.jpg)
HARVARD MEDICAL SCHOOL
Results in Liver
![Page 66: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/66.jpg)
HARVARD MEDICAL SCHOOL
Scanner A Scanner B
Thumbnail images of the original whole slide images
Liver
There is color variation….
![Page 67: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/67.jpg)
HARVARD MEDICAL SCHOOL
Liver
Scanner A Scanner B
Thumbnail images of the standardized whole slide images
Application of color correction minimizes the color differences….. ….
![Page 68: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/68.jpg)
HARVARD MEDICAL SCHOOL
Scanner A Scanner B
Without color correction…
Liver
![Page 69: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/69.jpg)
HARVARD MEDICAL SCHOOL
Scanner A Scanner B
Result of color correction…
Liver
![Page 70: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/70.jpg)
HARVARD MEDICAL SCHOOL
RGB color distribution
There is separation in the distribution-> dissimilar color
A
Original
B
100
120
140
160
180
200
220
240
50 80 110 140 170 200 230
blue
cha
nnel
Red channel
Nu (Orig)
A B
![Page 71: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/71.jpg)
HARVARD MEDICAL SCHOOL
RGB color distribution
A
Corrected
B
100
120
140
160
180
200
220
240
50 80 110 140 170 200 230
Blu
e ch
anne
l
Red channel
Nu (Corrected)
A B
Overlap in the color distribution-> similar color
![Page 72: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/72.jpg)
HARVARD MEDICAL SCHOOL
140
160
180
200
220
240
160 180 200 220 240
Blu
e ch
anne
l
Red channel
Cytoplasm(orig)
A
RGB color distribution
There is separation in the distribution-> dissimilar color
A
Original
B
![Page 73: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/73.jpg)
HARVARD MEDICAL SCHOOL
RGB color distribution
A
Corrected
B
Overlap in the color distribution-> similar color
140
160
180
200
220
240
160 180 200 220 240
Blu
e ch
anne
l
Red channel
Cytoplasm(Corrected)
A B
![Page 74: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/74.jpg)
HARVARD MEDICAL SCHOOL
Results in Lymphoma
![Page 75: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/75.jpg)
HARVARD MEDICAL SCHOOL
Lymphoma
Scanner A Scanner B
Thumbnail images of the original whole slide images
There is color variation….
![Page 76: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/76.jpg)
HARVARD MEDICAL SCHOOL
Lymphoma
Application of color correction minimizes the color differences…..
Scanner A Scanner B
Thumbnail images of the standardized whole slide images
![Page 77: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/77.jpg)
HARVARD MEDICAL SCHOOL
Scanner A Scanner B
There is color variation…. (no correction)
![Page 78: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/78.jpg)
HARVARD MEDICAL SCHOOL
Scanner A Scanner B
Application of color correction minimizes the color differences…..
![Page 79: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/79.jpg)
HARVARD MEDICAL SCHOOL
100
120
140
160
180
200
220
240
50 100 150 200 250
blue
cha
nnel
Red channel
Nu (Orig)
A B
RGB color distribution
There is separation in the distribution-> dissimilar color
A
Original
B
A
B B
A
![Page 80: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/80.jpg)
HARVARD MEDICAL SCHOOL
100
120
140
160
180
200
220
240
50 100 150 200 250
Blu
e ch
anne
l
Red channel
Nu (Corrected)
A B
RGB color distribution
A
Corrected
B Overlap in the color distribution-> similar color
![Page 81: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/81.jpg)
HARVARD MEDICAL SCHOOL
90
110
130
150
170
190
210
230
250
50 100 150 200 250
Blu
e ch
anne
l
Red channel
Cytoplasm(orig)
A B
RGB color distribution
A
Original
B
A
B There is separation in the distribution-> dissimilar color
![Page 82: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/82.jpg)
HARVARD MEDICAL SCHOOL
90
110
130
150
170
190
210
230
250
50 100 150 200 250
Blu
e ch
anne
l
Red channel
Cytoplasm(Corrected)
A B
RGB color distribution
A
Corrected
B Overlap in the color distribution-> similar color
![Page 83: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/83.jpg)
HARVARD MEDICAL SCHOOL
Image Quality Evaluation
![Page 84: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/84.jpg)
HARVARD MEDICAL SCHOOL
Image Quality Evaluation Algorithm
Image Quality nsq γβα ++=
Multiple regression analysis
Definitive evaluation index , is calculated by qγβα ,, are derived from training data.
![Page 85: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/85.jpg)
HARVARD MEDICAL SCHOOL
![Page 86: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/86.jpg)
HARVARD MEDICAL SCHOOL
Discussions • The two types of calibration slides helped users to
improve the color accuracy of the images they are looking at.
• Two algorithms for color and quality are working well for 5 scanners
• We have developed additional calibration slides to improve the reliability of WSI system
• Many pathologists have started to realize that accurate color and image quality are important in WSI.
![Page 87: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/87.jpg)
HARVARD MEDICAL SCHOOL
Online Management System is available
Scanning
Color Standardization
Algorithm
Image Quality Evaluation Algorithm
Summary : Standardization Display
Staining
Digital Staining Standardization is available
![Page 88: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/88.jpg)
HARVARD MEDICAL SCHOOL
Acknowledgements
• This research was partially supported by Olympus, Canon, 3DHISTECH, Kurabo. • Authors acknowledge to PICT Lab, Pathology Informatics, Department of Pathology at MGH
![Page 89: Color aspects and Color Standardization in Digital Microscopy · HARVARD MEDICAL SCHOOL Standardization of the image quality and the color displayed are important aspects of digital](https://reader034.vdocuments.net/reader034/viewer/2022042213/5eb894f76b973d07362e5705/html5/thumbnails/89.jpg)
HARVARD MEDICAL SCHOOL
Thank You!