weka: the bird · machine learning for data mining 2 6/11/2013 university of waikato 3 weka: the...
TRANSCRIPT
![Page 1: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/1.jpg)
Machine Learning for Data Mining 1
Department of Computer Science, University of Waikato, New Zealand
Eibe Frank
WEKA: A Machine Learning Toolkit
The Explorer• Classification and
Regression
• Clustering
• Association Rules
• Attribute Selection
• Data Visualization
The Experimenter
The Knowledge Flow GUI
Conclusions
Machine Learning with WEKA
6/11/2013 University of Waikato 2
WEKA: the bird
Copyright: Martin Kramer ([email protected])
![Page 2: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/2.jpg)
Machine Learning for Data Mining 2
6/11/2013 University of Waikato 3
WEKA: the software
Machine learning/data mining software written in Java (distributed under the GNU Public License)
Used for research, education, and applications
Complements “Data Mining” by Witten & Frank
Main features: Comprehensive set of data pre-processing tools,
learning algorithms and evaluation methods
Graphical user interfaces (incl. data visualization)
Environment for comparing learning algorithms
6/11/2013 University of Waikato 4
WEKA: versions There are several versions of WEKA:
WEKA 3.0: “book version” compatible with description in data mining book
WEKA 3.2: “GUI version” adds graphical user interfaces (book version is command-line only)
WEKA 3.3: “development version” with lots of improvements
This talk is based on the latest snapshot of WEKA 3.3 (soon to be WEKA 3.4)
![Page 3: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/3.jpg)
Machine Learning for Data Mining 3
6/11/2013 University of Waikato 5
@relation heart-disease-simplified
@attribute age numeric@attribute sex { female, male}@attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina}@attribute cholesterol numeric@attribute exercise_induced_angina { no, yes}@attribute class { present, not_present}
@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...
WEKA only deals with “flat” files
6/11/2013 University of Waikato 6
@relation heart-disease-simplified
@attribute age numeric@attribute sex { female, male}@attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina}@attribute cholesterol numeric@attribute exercise_induced_angina { no, yes}@attribute class { present, not_present}
@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...
WEKA only deals with “flat” files
![Page 4: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/4.jpg)
Machine Learning for Data Mining 4
6/11/2013 University of Waikato 7
6/11/2013 University of Waikato 8
![Page 5: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/5.jpg)
Machine Learning for Data Mining 5
6/11/2013 University of Waikato 9
6/11/2013 University of Waikato 10
Explorer: pre-processing the data Data can be imported from a file in various
formats: ARFF, CSV, C4.5, binary
Data can also be read from a URL or from an SQL database (using JDBC)
Pre-processing tools in WEKA are called “filters”
WEKA contains filters for: Discretization, normalization, resampling, attribute
selection, transforming and combining attributes, …
![Page 6: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/6.jpg)
Machine Learning for Data Mining 6
6/11/2013 University of Waikato 11
6/11/2013 University of Waikato 12
![Page 7: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/7.jpg)
Machine Learning for Data Mining 7
6/11/2013 University of Waikato 13
6/11/2013 University of Waikato 14
![Page 8: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/8.jpg)
Machine Learning for Data Mining 8
6/11/2013 University of Waikato 15
6/11/2013 University of Waikato 16
![Page 9: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/9.jpg)
Machine Learning for Data Mining 9
6/11/2013 University of Waikato 17
6/11/2013 University of Waikato 18
![Page 10: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/10.jpg)
Machine Learning for Data Mining 10
6/11/2013 University of Waikato 19
6/11/2013 University of Waikato 20
![Page 11: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/11.jpg)
Machine Learning for Data Mining 11
6/11/2013 University of Waikato 21
6/11/2013 University of Waikato 22
![Page 12: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/12.jpg)
Machine Learning for Data Mining 12
6/11/2013 University of Waikato 23
6/11/2013 University of Waikato 24
![Page 13: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/13.jpg)
Machine Learning for Data Mining 13
6/11/2013 University of Waikato 25
6/11/2013 University of Waikato 26
![Page 14: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/14.jpg)
Machine Learning for Data Mining 14
6/11/2013 University of Waikato 27
6/11/2013 University of Waikato 28
![Page 15: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/15.jpg)
Machine Learning for Data Mining 15
6/11/2013 University of Waikato 29
6/11/2013 University of Waikato 30
![Page 16: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/16.jpg)
Machine Learning for Data Mining 16
6/11/2013 University of Waikato 31
6/11/2013 University of Waikato 32
Explorer: building “classifiers” Classifiers in WEKA are models for predicting
nominal or numeric quantities
Implemented learning schemes include: Decision trees and lists, instance-based classifiers,
support vector machines, multi-layer perceptrons, logistic regression, Bayes’ nets, …
“Meta”-classifiers include: Bagging, boosting, stacking, error-correcting output
codes, locally weighted learning, …
![Page 17: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/17.jpg)
Machine Learning for Data Mining 17
6/11/2013 University of Waikato 33
6/11/2013 University of Waikato 34
![Page 18: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/18.jpg)
Machine Learning for Data Mining 18
6/11/2013 University of Waikato 35
6/11/2013 University of Waikato 36
![Page 19: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/19.jpg)
Machine Learning for Data Mining 19
6/11/2013 University of Waikato 37
6/11/2013 University of Waikato 38
![Page 20: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/20.jpg)
Machine Learning for Data Mining 20
6/11/2013 University of Waikato 39
6/11/2013 University of Waikato 40
![Page 21: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/21.jpg)
Machine Learning for Data Mining 21
6/11/2013 University of Waikato 41
6/11/2013 University of Waikato 42
![Page 22: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/22.jpg)
Machine Learning for Data Mining 22
6/11/2013 University of Waikato 43
6/11/2013 University of Waikato 44
![Page 23: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/23.jpg)
Machine Learning for Data Mining 23
6/11/2013 University of Waikato 45
6/11/2013 University of Waikato 46
![Page 24: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/24.jpg)
Machine Learning for Data Mining 24
6/11/2013 University of Waikato 47
6/11/2013 University of Waikato 48
![Page 25: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/25.jpg)
Machine Learning for Data Mining 25
6/11/2013 University of Waikato 49
6/11/2013 University of Waikato 50
![Page 26: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/26.jpg)
Machine Learning for Data Mining 26
6/11/2013 University of Waikato 51
6/11/2013 University of Waikato 52
![Page 27: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/27.jpg)
Machine Learning for Data Mining 27
6/11/2013 University of Waikato 53
6/11/2013 University of Waikato 54
![Page 28: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/28.jpg)
Machine Learning for Data Mining 28
6/11/2013 University of Waikato 55
6/11/2013 University of Waikato 56
![Page 29: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/29.jpg)
Machine Learning for Data Mining 29
6/11/2013 University of Waikato 57
6/11/2013 University of Waikato 58
![Page 30: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/30.jpg)
Machine Learning for Data Mining 30
6/11/2013 University of Waikato 59
6/11/2013 University of Waikato 60
![Page 31: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/31.jpg)
Machine Learning for Data Mining 31
6/11/2013 University of Waikato 61
6/11/2013 University of Waikato 62
![Page 32: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/32.jpg)
Machine Learning for Data Mining 32
6/11/2013 University of Waikato 63
6/11/2013 University of Waikato 64
![Page 33: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/33.jpg)
Machine Learning for Data Mining 33
6/11/2013 University of Waikato 65QuickTime™ and a TIFF (LZW) decompressor are needed to see this picture.
6/11/2013 University of Waikato 66QuickTime™ and a TIFF (LZW) decompressor are needed to see this picture.
![Page 34: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/34.jpg)
Machine Learning for Data Mining 34
6/11/2013 University of Waikato 67QuickTime™ and a TIFF (LZW) decompressor are needed to see this picture.
6/11/2013 University of Waikato 68
![Page 35: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/35.jpg)
Machine Learning for Data Mining 35
6/11/2013 University of Waikato 69
6/11/2013 University of Waikato 70
![Page 36: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/36.jpg)
Machine Learning for Data Mining 36
6/11/2013 University of Waikato 71
6/11/2013 University of Waikato 72
![Page 37: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/37.jpg)
Machine Learning for Data Mining 37
6/11/2013 University of Waikato 73
6/11/2013 University of Waikato 74
![Page 38: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/38.jpg)
Machine Learning for Data Mining 38
6/11/2013 University of Waikato 75
QuickTime™ and a TIFF (LZW) decompressor are needed to see this pict
6/11/2013 University of Waikato 76
![Page 39: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/39.jpg)
Machine Learning for Data Mining 39
6/11/2013 University of Waikato 77
6/11/2013 University of Waikato 78
![Page 40: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/40.jpg)
Machine Learning for Data Mining 40
6/11/2013 University of Waikato 79
6/11/2013 University of Waikato 80
QuickTime™ and a TIFF (LZW) decompressor are needed to see this picture.
![Page 41: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/41.jpg)
Machine Learning for Data Mining 41
6/11/2013 University of Waikato 81
QuickTime™ and a TIFF (LZW) decompressor are needed to see this picture.
6/11/2013 University of Waikato 82
![Page 42: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/42.jpg)
Machine Learning for Data Mining 42
6/11/2013 University of Waikato 83
QuickTime™ and a TIFF (LZW) decompressor are needed to see this picture.
6/11/2013 University of Waikato 84
![Page 43: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/43.jpg)
Machine Learning for Data Mining 43
6/11/2013 University of Waikato 85
6/11/2013 University of Waikato 86
![Page 44: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/44.jpg)
Machine Learning for Data Mining 44
6/11/2013 University of Waikato 87
6/11/2013 University of Waikato 88
![Page 45: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/45.jpg)
Machine Learning for Data Mining 45
6/11/2013 University of Waikato 89
6/11/2013 University of Waikato 90
![Page 46: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/46.jpg)
Machine Learning for Data Mining 46
6/11/2013 University of Waikato 91
6/11/2013 University of Waikato 92
Explorer: clustering data WEKA contains “clusterers” for finding groups of
similar instances in a dataset
Implemented schemes are: k-Means, EM, Cobweb, X-means, FarthestFirst
Clusters can be visualized and compared to “true” clusters (if given)
Evaluation based on loglikelihood if clustering scheme produces a probability distribution
![Page 47: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/47.jpg)
Machine Learning for Data Mining 47
6/11/2013 University of Waikato 93
6/11/2013 University of Waikato 94
![Page 48: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/48.jpg)
Machine Learning for Data Mining 48
6/11/2013 University of Waikato 95
6/11/2013 University of Waikato 96
![Page 49: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/49.jpg)
Machine Learning for Data Mining 49
6/11/2013 University of Waikato 97
6/11/2013 University of Waikato 98
![Page 50: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/50.jpg)
Machine Learning for Data Mining 50
6/11/2013 University of Waikato 99
6/11/2013 University of Waikato 100
![Page 51: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/51.jpg)
Machine Learning for Data Mining 51
6/11/2013 University of Waikato 101
6/11/2013 University of Waikato 102
![Page 52: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/52.jpg)
Machine Learning for Data Mining 52
6/11/2013 University of Waikato 103
6/11/2013 University of Waikato 104
![Page 53: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/53.jpg)
Machine Learning for Data Mining 53
6/11/2013 University of Waikato 105
6/11/2013 University of Waikato 106
![Page 54: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/54.jpg)
Machine Learning for Data Mining 54
6/11/2013 University of Waikato 107
6/11/2013 University of Waikato 108
Explorer: finding associations WEKA contains an implementation of the Apriori
algorithm for learning association rules Works only with discrete data
Can identify statistical dependencies between groups of attributes: milk, butter bread, eggs (with confidence 0.9 and
support 2000)
Apriori can compute all rules that have a given minimum support and exceed a given confidence
![Page 55: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/55.jpg)
Machine Learning for Data Mining 55
6/11/2013 University of Waikato 109
6/11/2013 University of Waikato 110
![Page 56: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/56.jpg)
Machine Learning for Data Mining 56
6/11/2013 University of Waikato 111
6/11/2013 University of Waikato 112
![Page 57: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/57.jpg)
Machine Learning for Data Mining 57
6/11/2013 University of Waikato 113
6/11/2013 University of Waikato 114
![Page 58: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/58.jpg)
Machine Learning for Data Mining 58
6/11/2013 University of Waikato 115
6/11/2013 University of Waikato 116
Explorer: attribute selection Panel that can be used to investigate which
(subsets of) attributes are the most predictive ones
Attribute selection methods contain two parts: A search method: best-first, forward selection,
random, exhaustive, genetic algorithm, ranking
An evaluation method: correlation-based, wrapper, information gain, chi-squared, …
Very flexible: WEKA allows (almost) arbitrary combinations of these two
![Page 59: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/59.jpg)
Machine Learning for Data Mining 59
6/11/2013 University of Waikato 117
6/11/2013 University of Waikato 118
![Page 60: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/60.jpg)
Machine Learning for Data Mining 60
6/11/2013 University of Waikato 119
6/11/2013 University of Waikato 120
![Page 61: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/61.jpg)
Machine Learning for Data Mining 61
6/11/2013 University of Waikato 121
6/11/2013 University of Waikato 122
![Page 62: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/62.jpg)
Machine Learning for Data Mining 62
6/11/2013 University of Waikato 123
6/11/2013 University of Waikato 124
![Page 63: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/63.jpg)
Machine Learning for Data Mining 63
6/11/2013 University of Waikato 125
Explorer: data visualization
Visualization very useful in practice: e.g. helps to determine difficulty of the learning problem
WEKA can visualize single attributes (1-d) and pairs of attributes (2-d) To do: rotating 3-d visualizations (Xgobi-style)
Color-coded class values
“Jitter” option to deal with nominal attributes (and to detect “hidden” data points)
“Zoom-in” function
6/11/2013 University of Waikato 126
![Page 64: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/64.jpg)
Machine Learning for Data Mining 64
6/11/2013 University of Waikato 127
6/11/2013 University of Waikato 128
![Page 65: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/65.jpg)
Machine Learning for Data Mining 65
6/11/2013 University of Waikato 129
6/11/2013 University of Waikato 130
![Page 66: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/66.jpg)
Machine Learning for Data Mining 66
6/11/2013 University of Waikato 131
6/11/2013 University of Waikato 132
![Page 67: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/67.jpg)
Machine Learning for Data Mining 67
6/11/2013 University of Waikato 133
6/11/2013 University of Waikato 134
![Page 68: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/68.jpg)
Machine Learning for Data Mining 68
6/11/2013 University of Waikato 135
6/11/2013 University of Waikato 136
![Page 69: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/69.jpg)
Machine Learning for Data Mining 69
6/11/2013 University of Waikato 137
6/11/2013 University of Waikato 138
Performing experiments Experimenter makes it easy to compare the
performance of different learning schemes
For classification and regression problems
Results can be written into file or database
Evaluation options: cross-validation, learning curve, hold-out
Can also iterate over different parameter settings
Significance-testing built in!
![Page 70: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/70.jpg)
Machine Learning for Data Mining 70
6/11/2013 University of Waikato 139
6/11/2013 University of Waikato 140
![Page 71: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/71.jpg)
Machine Learning for Data Mining 71
6/11/2013 University of Waikato 141
6/11/2013 University of Waikato 142
![Page 72: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/72.jpg)
Machine Learning for Data Mining 72
6/11/2013 University of Waikato 143
6/11/2013 University of Waikato 144
![Page 73: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/73.jpg)
Machine Learning for Data Mining 73
6/11/2013 University of Waikato 145
6/11/2013 University of Waikato 146
![Page 74: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/74.jpg)
Machine Learning for Data Mining 74
6/11/2013 University of Waikato 147
6/11/2013 University of Waikato 148
![Page 75: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/75.jpg)
Machine Learning for Data Mining 75
6/11/2013 University of Waikato 149
6/11/2013 University of Waikato 150
![Page 76: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/76.jpg)
Machine Learning for Data Mining 76
6/11/2013 University of Waikato 151
6/11/2013 University of Waikato 152
The Knowledge Flow GUI New graphical user interface for WEKA
Java-Beans-based interface for setting up and running machine learning experiments
Data sources, classifiers, etc. are beans and can be connected graphically
Data “flows” through components: e.g.,
“data source” -> “filter” -> “classifier” -> “evaluator”
Layouts can be saved and loaded again later
![Page 77: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/77.jpg)
Machine Learning for Data Mining 77
6/11/2013 University of Waikato 153
6/11/2013 University of Waikato 154
![Page 78: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/78.jpg)
Machine Learning for Data Mining 78
6/11/2013 University of Waikato 155
6/11/2013 University of Waikato 156
![Page 79: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/79.jpg)
Machine Learning for Data Mining 79
6/11/2013 University of Waikato 157
6/11/2013 University of Waikato 158
![Page 80: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/80.jpg)
Machine Learning for Data Mining 80
6/11/2013 University of Waikato 159
6/11/2013 University of Waikato 160
![Page 81: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/81.jpg)
Machine Learning for Data Mining 81
6/11/2013 University of Waikato 161
6/11/2013 University of Waikato 162
![Page 82: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/82.jpg)
Machine Learning for Data Mining 82
6/11/2013 University of Waikato 163
6/11/2013 University of Waikato 164
![Page 83: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/83.jpg)
Machine Learning for Data Mining 83
6/11/2013 University of Waikato 165
6/11/2013 University of Waikato 166
![Page 84: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/84.jpg)
Machine Learning for Data Mining 84
6/11/2013 University of Waikato 167
6/11/2013 University of Waikato 168
![Page 85: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/85.jpg)
Machine Learning for Data Mining 85
6/11/2013 University of Waikato 169
6/11/2013 University of Waikato 170
![Page 86: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/86.jpg)
Machine Learning for Data Mining 86
6/11/2013 University of Waikato 171
6/11/2013 University of Waikato 172
![Page 87: WEKA: the bird · Machine Learning for Data Mining 2 6/11/2013 University of Waikato 3 WEKA: the software Machine learning/data mining software written in Java (distributed under](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92be37fe24825bfc7e947a/html5/thumbnails/87.jpg)
Machine Learning for Data Mining 87
6/11/2013 University of Waikato 173
Conclusion: try it yourself!
WEKA is available at
http://www.cs.waikato.ac.nz/ml/weka
Also has a list of projects based on WEKA
WEKA contributors:
Abdelaziz Mahoui, Alexander K. Seewald, Ashraf M. Kibriya, Bernhard Pfahringer , Brent Martin, Peter Flach, Eibe Frank ,Gabi Schmidberger ,Ian H. Witten , J. Lindgren, Janice Boughton, Jason Wells, Len Trigg, Lucio de Souza Coelho, Malcolm Ware, Mark Hall ,Remco Bouckaert , Richard Kirkby, Shane Butler, Shane Legg, Stuart Inglis, Sylvain Roy,
Tony Voyle, Xin Xu, Yong Wang, Zhihai Wang