caqdas 2014 pecha kucha - stuart shulman
DESCRIPTION
A fun ramble through the history of my contributions to qualitative software and methods.TRANSCRIPT
What have CAT & DiscoverText done for qualitative methodology?
Stuart Shulman, Texifter
2014 Conference: Past, Present and Future25 years of CAQDAS
Stuart Shulman – Texifter
Pronounced “Tech-Sifter”
Stuart Shulman – Texifter
Circa 1999
Stuart Shulman – Texifter
May 2001Council for Excellence in Government
June 2002National Defense University
Computer Science & NSF Influences:Measure Everything!
Stuart Shulman – Texifter
How fast?How reliable?
How accurate?
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Inter-Rater Reliability is Key
Understanding the landscape of human interpretation better prepares us to face the challenge of machine classification
Stuart Shulman – Texifter
Adjudicate Boundary Cases
Stuart Shulman – Texifter
“CoderRank for Enhanced Machine Learning” is Patent Pending
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Labeling, Tagging, or AnnotationImproves Machine Learning Over Time
Stuart Shulman – Texifter
Iterate Human Coding & Machine-Learning
Stuart Shulman – Texifter
Word Sense Disambiguation (Relevance)
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Naturally Occurring Clusters of Free Text Can Be Discovered Automatically
Stuart Shulman – Texifter
Purist
A Spectrum of Methods Approaches
deep immersioncloseness to data
antipathy to numberscredible interpretation
in-depth analysiscontextualsubjective
experimental mixed methodadaptive hybrid
flexible approachinterdisciplinary quantitative
focus on errormeasurement criticalvalidity and reliability
replication & objectivity generalizationhypotheses
PositivistPluralist
• Free and open source software options• Web-based (crowd source) collaborative tools• Measurement innovation• Free and premium social data collection• Random sampling and keystroke coding• Advanced search and filtering• Deduplication and clustering algorithms • Custom machine learning classifiers• Word sense disambiguation • CoderRank for enhanced machine learning
Stuart Shulman – Texifter
What have CAT & DiscoverText done for qualitative methodology?
Stuart Shulman – Texifter
Dr. Stuart W. ShulmanFounder & CEO, Texifter, LLCResearch Associate Professor, UMass AmherstDirector, Qualitative Data Analysis Program (QDAP)Editor Emeritus, Journal of Information Technology & Politics
Contact [email protected]://people.umass.edu/stu/@stuartwshulman
Thanks for Listening!