experimental design and statistical analysis seth price department of chemical engineering new...
TRANSCRIPT
![Page 1: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/1.jpg)
Experimental Design and Statistical Analysis
Seth PriceDepartment of Chemical Engineering
New Mexico TechRev. 11/4/14
![Page 2: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/2.jpg)
Designing Experiments
• Find what variables have been important (literature, past data, etc.)
• Find what “knobs to turn”
• Run screening experiments to determine appropriate ranges
• Identify what cannot be controlled
![Page 3: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/3.jpg)
Factorial Analysis
• Once ranges of variables are established, set up a test matrix– One test at each “corner” of the data, plus
one center point– For a 2D analysis: 5 tests– For a 3D analysis: 9 tests
![Page 4: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/4.jpg)
Optimization Example
• There is an RF enhanced CVD reactor of a certain design (constant). You can control: – RF power: (100 mW to 500 mW)– Gas flow rate: (0.5 L/min to 1.5 L/min)
• Find the optimal range for maximizing coating thickness rate (μm/s)
![Page 5: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/5.jpg)
Factorial Analysis
![Page 6: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/6.jpg)
Optimum Area
![Page 7: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/7.jpg)
Close Enough?
• If more time is available, choose:– Another factorial analysis, using current
area as new corners– Repeated experiments for statistical
analysis
![Page 8: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/8.jpg)
Simple Statistics
• Average (Mean)
• Variance
• Standard Deviation
• Range
![Page 9: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/9.jpg)
Process Engineering
• Likely involves statistical analysis– Why is our result not what was expected?– Is the new equal or better than the old
way?
• Important skills– Pattern recognition– Decision making
![Page 10: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/10.jpg)
Pattern Recognition?
![Page 11: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/11.jpg)
Types of Problems
• Is this process in control?
• We made a change to one part of the process. Has it influenced another part?
• We did equipment maintenance to a machine. Has it fixed the problem?
• Does ambient air pressure influence our process?
![Page 12: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/12.jpg)
Is This Process In Control?
• In Control: – We know exactly how this system behaves– What output to expect with changes to input
• Example: – If a flow rate upstream changes, what
change in our output can we expect?
![Page 13: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/13.jpg)
SPC Chart
• Mean chart– Plot data vs. time– Center line is mean (or target)– Define zones of concern
• Sigma chart– Target line is 0– Define control limits
![Page 14: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/14.jpg)
SPC Mean Chart
![Page 15: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/15.jpg)
Western Electric Rules
http://www.infinityqs.com/resources/spc-tools
![Page 16: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/16.jpg)
Western Electric Rules• A good starting point:
– Zone A: 2σ – 3σ , -2σ to -3σ– Zone B: 1σ -2σ, -1σ to -2σ– Zone C: Mean to 1σ, Mean to -1σ
• Can redefine these as process develops
• Does not have to be symmetric
• Also look for patterns in data
![Page 17: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/17.jpg)
In Control?
![Page 18: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/18.jpg)
NO! (8pts on one side)
![Page 19: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/19.jpg)
In Control?
![Page 20: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/20.jpg)
NO! (2 of 3 in Zone A)
![Page 21: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/21.jpg)
In Control?
![Page 22: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/22.jpg)
Yes (W.E. Rules) and No (Cyclic)
![Page 23: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/23.jpg)
Comparison
• Did the changes to my process affect something downstream?– Make a “null hypothesis”– Test it. You cannot compare averages
directly– Reject the null hypothesis, or “fail to reject”
the null hypothesis
![Page 24: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/24.jpg)
Comparison Methods• One sample T/Z-tests:
– Test to see if a sample is from a certain population
• Two sample T/Z-tests:– Test two samples to see if they came from the same
population
• Dependent T/Z tests:– Same samples used before/after treatment
• ANOVA: ANalysis Of VAriance – Testing if multiple samples (3+) are from the same
population
![Page 25: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/25.jpg)
Rather than evaluating each method…
• No-Frills Statistics: A Guide for the First-Year Student– Susan H. Gray– ISBN 0822603802
– Amazon: $2.49 (used)
![Page 26: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/26.jpg)
Linear Regression• Is there a correlation between two variables?
– This is when you guys dump data into Excel and do a best fit line.
• How correlated are these variables?– “R squared value”, range 0 to 1– 0 is no correlation at all– 1 is a perfectly positive linear correlation
![Page 27: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/27.jpg)
Correlation and Causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
![Page 28: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/28.jpg)
Still didn’t get it?
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
• Correlation does not prove causation
![Page 29: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/29.jpg)
Proof
http://www.venganza.org/images/PiratesVsTemp.png
![Page 30: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/30.jpg)
If Correlation Proved Causation…
• Climate change caused by lack of pirates
![Page 31: Experimental Design and Statistical Analysis Seth Price Department of Chemical Engineering New Mexico Tech Rev. 11/4/14](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfbc1a28abf838ca173d/html5/thumbnails/31.jpg)
If Correlation Proved Causation…
• Climate change caused by lack of pirates
• Solution to climate change is more pirates