p.r. underhill, c. uemura, d. butt and t.w. krause ......0.25988 4-0.00134...
TRANSCRIPT
![Page 1: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/1.jpg)
P.R. Underhill, C. Uemura, D. Butt and T.W. Krause
Department of Physics, Royal Military College of Canada, Kingston, ON, K7K 7B4
![Page 2: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/2.jpg)
Outline
Application Approach Intro to Hit/Miss POD Results Summary
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 3: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/3.jpg)
Application
FerrousFastener
Lap‐JointEdge
BottomLayer
TopLayer
FastenerAurora (P-3 Orion)
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 4: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/4.jpg)
Objective
Develop a rapid scanning technique to identify fasteners with second (and first) layer cracks without fastener removal◦ Reduce down time/cost◦ Eliminate possible damage due to
fastener removal Use bolt hole eddy current as a
confirmatory technique (sizing)
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 5: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/5.jpg)
Pulsed Eddy Current Detection of Cracks
Specially designed probe uses pulsed rather than conventional eddy current
Generates data that is reduced to a small number of scores (5) using PCA that totally encapsulate the information
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 6: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/6.jpg)
Cluster Analysis
Mahalanobis Distance
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 7: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/7.jpg)
Characteristics
Blind to the operator Treats the data as a group rather
than fastener by fastener Uses robust statistics to overcome
the blind inclusion of defects Previous work showed excellent
ability to detect cracks Next step was to establish a
Probability of Detection (POD)
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 8: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/8.jpg)
Angular Size
0
2
4
6
8
10
12
14
Coun
t
Notch Size (mm)
NDT in Canada 2018 | June 19-21 | Halifax, NS
Generate a PODSample Size Distribution
![Page 9: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/9.jpg)
Method For each sample (of 7)◦ take and process data (10 passes)◦ Use bootstrap method to generate data◦ Do robust statistics (modified smallest half volume)◦ Use a pre-set cut-off to determine hits and misses ◦ Repeat so that each notched fastener appears
approx. 100 times Combine data into one large matrix ◦ Approx (101 rows (fasteners) by 83 columns (trials)
Use MIL HBK 1823 software to do POD◦ a50, a90, a90/95
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 10: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/10.jpg)
Hit/Miss POD
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
-5 -4 -3 -2 -1 0 1 2 3 4 5
Z
Logit
1
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 11: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/11.jpg)
Initial Results
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 12: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/12.jpg)
Appropriateness of Fit
0
0.2
0.4
0.6
0.8
1
1.2
0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00
Prob
ability of D
etectio
n
Crack Size (mm)
Fastener
Logit Fit
Binned
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 13: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/13.jpg)
Operator to Operator Comparison
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
0 0.2 0.4 0.6 0.8 1
Det
ectio
n Ra
te O
pera
tor
2
Detection Rate Operator 1
• 3 worst samples• 45 fasteners• 31 @ (1,1)
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 14: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/14.jpg)
Empirical (marginal) a90/95
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 15: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/15.jpg)
Empirical (marginal) a90/95Number of Notches in Simulation
C1 C2 C3 C4
False Call Rate Data Fraction/ (mm/inch) - Using ImageJ
5% False Call
95% 2.72 / 0.107
2.74 / 0.108
3.00 / 0.118
3.10 / 0.122
97.5% 2.60 / 0.102
2.67 / 0.105
2.90 / 0.114
2.98 / 0.117
100% 2.43 / 0.095
2.75 / 0.108
3.24 / 0.128
3.53 / 0.139
10% False Call
95% 2.22 / 0.088
2.33 / 0.092
2.35 / 0.093
2.66 / 0.105
97.5% 2.07 / 0.082
2.26 / 0.089
2.33 / 0.092
2.29 / 0.090
100% 2.04 / 0.080
2.28 / 0.090
2.59 / 0.102
2.90 / 0.114
15% False Call
95% 1.93 / 0.076
2.05 / 0.081
2.10 / 0.083
2.11 / 0.083
97.5% 1.91 / 0.075
2.02 / 0.080
1.96 / 0.077
2.08 / 0.082
100% 1.71 / 0.067
1.93 / 0.076
2.28 / 0.090
2.56 / 0.101
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 16: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/16.jpg)
Summary
More than just size affects the detection rate Automated robust analysis gives a marginal a90/95(80 fasteners/15% FC) 2 mm/0.08” Have nearly 50% detection down to 0.75 mm/0.03” Detection rate gets worse with smaller sample
sizes (40 fasteners/15% FC) a90/95 = 2.57 mm/ 0.10”
Large statistical data set makes it possible to separate out some extra effects (operator)
Statistical approach makes it possible to generate “Quality” statistics that indicate if the inspection was carried out properly and the sample conforms to the low defect assumption
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 17: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/17.jpg)
Questions
NDT in Canada 2018 | June 19-21 | Halifax, NS
![Page 18: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/18.jpg)
Cumulative Distribution of Results for a single operator
0
2
4
6
8
10
12
14
0 2 4 6 8 10 12 14
Actual
Predicted
Cumulative Hits
0.37
0.41
0.42
0.43
Binomial distribution for p=0.4
![Page 19: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/19.jpg)
ApproachPulsed Eddy Current
MPCA
sj = S1jV1 + S2jV2
![Page 20: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/20.jpg)
Robust StatisticsModified Smallest Half Volume
![Page 21: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/21.jpg)
Blind Detection Issues
How to obtain an uncontaminated covariance matrix and centroid for the blanks?
Robust Statistics Lab samples are defect rich. How to
generate large numbers of blanks like the real case?
Bootstrap Method
![Page 22: P.R. Underhill, C. Uemura, D. Butt and T.W. Krause ......0.25988 4-0.00134 0.01956-0.00196-0.01007-0.02041 -0.0117 0.00295 0.08017 6 0.01749 2 0.00521 5 0.01765 6 0.48483 0.07621 8-0.08172](https://reader036.vdocuments.net/reader036/viewer/2022071419/6117c83aae0567138a731a48/html5/thumbnails/22.jpg)
Bootstrap
S2 S3 S4 S50.59337
60.04551
9-
0.09982-
0.014910.50036
40.09798
2 -0.0933-
0.017270.44707
10.07175
8-
0.07776-
0.013580.49072
60.07744
5-
0.08257-
0.010780.47631
40.05139
5-
0.07991 -0.0113
0.484830.07621
8-
0.08172-
0.013240.44351
50.02831
3-
0.07137-
0.012770.44633
70.05596
7-
0.07361-
0.012680.49945
6 0.0651-
0.08216-
0.012870.44151
10.10997
8-
0.07812-
0.01169-
0.29658-
0.061580.03951
90.01077
4-
0.268920.06024
7 0.054130.00597
6
S2 S3 S4 S5-
0.46111-
0.011350.08881
7-
0.020260.30769
70.19112
40.01930
4 0.00513
0.29056-
0.05131-
0.05987-
0.023910.18009
2 -0.0654-
0.04422-
0.03478- 0.20707 -
Blanks
Cracks
0.002606
0.014639
-0.00898
-0.00704
-0.08587
0.131992
-0.00031 -0.001
-0.11465
-0.02632
0.026286
0.006772
-0.33553
-0.02745
0.009381
0.002782
-0.0343-
0.016390.01160
7-
0.000280.11737
1-
0.05911-
0.01063-
0.00201-
0.11154 0.002010.02609
40.00034
50.25988
4-
0.00134-
0.01956-
0.00196-
0.01007-
0.02041 -0.0117-
0.002950.08017
60.01749
20.00521
50.01765
6
0.484830.07621
8-
0.08172-
0.01324-
0.391450.07217
80.02476
10.00505
70.00399
8-
0.00893 -0.01530.00272
3-
0 038120.01479
20.01332
2-
0 00216
Test Data Set