skepticism at work - logical fallacies. asq buffalo
Post on 19-Oct-2014
717 views
DESCRIPTION
http://asqbuffalo.org We should only believe things for which there is adequate evidence. But what evidence is adequate? We decide based on our experiences, beliefs, judgments, and reasoning. However, we often commit logical fallacies (errors in reasoning). When this happens either sound evidence is rejected or questionable evidence is accepted while leaving us feeling that we have made the right decision. Recognizing these errors can help us avoid making wrong decisions and promote data based decision making.TRANSCRIPT
![Page 1: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/1.jpg)
SkepticismAt WorkRecognizing
Logical FallaciesSteve Cena
2013
![Page 2: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/2.jpg)
Basic Definitions
Cynicism: To doubt without evidence. To dismiss a claim out of hand.
Skepticism: To doubt based on the evidence or the lack thereof.
Faith: To believe without evidence or in spite of contrary evidence. “Faith is believing what you know ain’t so.”*
Belief: To accept based on the available evidence.
* Mark Twain
![Page 3: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/3.jpg)
“I’m a skeptic not because I do not want
to believe but I want to know.”
Michael Shermer, The Believing Brain Prolog
![Page 4: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/4.jpg)
Discussions of belief & skepticism are often centered on paranormal or
pseudoscientific topics
![Page 5: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/5.jpg)
Business Claims
• We need a fresh set of eyes to work on this problem.
• We tried that before & it didn’t work.• The test is 99% accurate.• It’s just an outlier.• I can’t explain why but whenever we do it this
way it works.
![Page 6: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/6.jpg)
Which Claims Should We Believe?
WE SHOULD ONLY BELIEVE THINGS FOR
WHICH THERE IS ADEQUATE EVIDENCE.
![Page 7: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/7.jpg)
What is adequate evidence?
How do we evaluate the data?
DATA
JudgmentsReasoning
![Page 8: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/8.jpg)
Judgments = OpinionsReasoning = Logic
Errors in Reasoning = Logical Fallacies
Claims are made on what seem to be good arguments but these arguments are based on incorrect logical principles. Thus, the claims are not valid.
![Page 9: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/9.jpg)
Ad Hominem Attack
Ad hominem is Latin for "to the person”
• Not invented here
• Outside expert error
• Guilty by group association
![Page 10: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/10.jpg)
False Dichotomy(The Excluded Middle)
• “You are either for us or against us.”
• "You are either part of the solution or part of the problem.”
Arbitrarily reducing the set of probabilities to only 2.
• "It's either the design or the process."
![Page 11: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/11.jpg)
Response or Problem
Measurement Method Material
Machine Mother Nature Manpower
![Page 12: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/12.jpg)
Response or Problem
This
That
![Page 13: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/13.jpg)
Anecdotes Do Not Equal Evidence• Memory is fallible & malleable
– Memories are reconstructed not replayed
• Anecdotes rely on intuition & subjective interpretation
• “… we are apt to want our version of the truth, rather than the truth itself, to prevail.”*
• Anecdotex ≠ Data– The plural of anecdote is not data.
• Show me the data * Steven Pinker, How the Mind Works, pg. 289
![Page 14: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/14.jpg)
Conjunction Fallacy
• 80% of the time delivery is late• 80% of the time the quantity is wrong• What is more likely?
– The next delivery will be late– The next delivery will be late and the wrong
quantity
The tendency to think 2 conclusions are more likely than either conclusion
alone.
![Page 15: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/15.jpg)
Conjunction Fallacy
• 80% of the time delivery is late– P(late) = .80
• 80% of the time the quantity is wrong– P(quantity) = .80
• P(late) x P(quantity) = .80 x .80 = .64
![Page 16: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/16.jpg)
Base Rate Fallacy
When considering the probability of something happening failing to consider
the probability that it can happen.
![Page 17: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/17.jpg)
Base Rate Fallacy
Test 100 acceptable parts99 are correctly identified
1 incorrectly identified
Test 100 unacceptable parts99 are correctly identified
1 incorrectly identified
![Page 18: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/18.jpg)
Base Rate Fallacy
99% accurate!99% of shipped product is acceptable!
99% of rejected product is unacceptable!
Only if half of the product made is unacceptable.
![Page 19: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/19.jpg)
Base Rate Fallacy
Produce 10,000 units
95% are acceptable
10,000 x .95 = 9,500 acceptable units10,000 – 9,500 = 500 unacceptable
![Page 20: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/20.jpg)
Base Rate Fallacy
9,500 acceptable units tested at 99% accuracy
9,500 x .99 = 9,405 accepted 95 incorrectly rejected
![Page 21: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/21.jpg)
Base Rate Fallacy
500 unacceptable units tested at 99% accuracy
500 x .99 = 495 rejected 5 incorrectly accepted
![Page 22: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/22.jpg)
Base Rate Fallacy
9405 correctly accepted + 5 incorrectly accepted 9410 total accepted units
What Shipped
9405/9410 = .9995Considering the BASE RATE
99.95% of shipped product is acceptableNOT 99% as claimed.
![Page 23: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/23.jpg)
Base Rate Fallacy
495 correctly rejected + 95 incorrectly rejected 590 total rejected units
What is Rejected
495/590 = .839Considering the BASE RATE
83.9% of rejected product is unacceptableNOT 99% as claimed.
![Page 24: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/24.jpg)
Post Hoc Ergo Propter Hoc
• Assumption: if A precedes B then A must cause B
• Coincidences happen• Correlation ≠ Causation
– “New York City Has Most Millionaires In The Country” *
• By What Mechanism?
Latin for "after this, therefore because of this“
* http://www.huffingtonpost.com/2010/08/04/new-york-city-has-most-mi_n_670474.html#s122573&title=New_York_667200
![Page 25: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/25.jpg)
Post Hoc Ergo Propter Hoc
XKCD
![Page 26: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/26.jpg)
Regression to the mean
An extreme measurement will tend to be followed by a measurement that is closer to the mean.
![Page 27: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/27.jpg)
Regression to the mean
![Page 28: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/28.jpg)
Regression to the mean
![Page 29: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/29.jpg)
Regression to the mean
![Page 30: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/30.jpg)
Regression to the mean
![Page 31: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/31.jpg)
Regression to the mean
![Page 32: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/32.jpg)
Regression to the mean
![Page 33: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/33.jpg)
Why do you believe?
• Is it because the belief is comfortable or convenient?
• Does the data reaffirm what you already "know" to be true?
• Are contrary data ignored or rationalized away?
• Did you objectively analyze the data and come to this conclusion?
![Page 34: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/34.jpg)
What would change your mind?
• NOTHING!• Falsifiable claim
– “The Scientific method consists of the use of procedures designed to show not that our predictions and hypotheses are right, but that they might be wrong”*
• Rabbit in the Precambrian**
What is your rabbit?* Mistakes Were Made, Tarvis & Aronson**J.B.S. Haldane
![Page 35: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/35.jpg)
What would you do if you’re wrong?
• Minimize – It’s not that bad• Mobilize – Moving target• Optimize – (POB) Pervasive Optimistic Bias• Rationalize – Justify• Invoke any logical fallacy
![Page 36: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/36.jpg)
What would you do if you’re wrong?
Why do you believe?
What would change your mind?
![Page 37: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/37.jpg)
A Short Story
MinimizationMobilization
Argument From Authority
Rationalization
RationalizationStraw Man Argument
Argument From IgnoranceOptimize (POB)
![Page 38: Skepticism at work - Logical Fallacies. ASQ Buffalo](https://reader034.vdocuments.net/reader034/viewer/2022051816/54449f42afaf9f9c098b4902/html5/thumbnails/38.jpg)