Download - WEKA Tutorial
![Page 1: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/1.jpg)
Contributed by Yizhou Sun2008
An Introduction to WEKA
![Page 2: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/2.jpg)
ContentWhat is WEKA?The Explorer:
Preprocess dataClassificationClusteringAssociation RulesAttribute SelectionData Visualization
References and Resources
2 04/10/23
![Page 3: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/3.jpg)
What is WEKA?Waikato Environment for Knowledge
AnalysisIt’s a data mining/machine learning tool
developed by Department of Computer Science, University of Waikato, New Zealand.
Weka is also a bird found only on the islands of New Zealand.
3 04/10/23
![Page 4: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/4.jpg)
Download and Install WEKAWebsite: http://
www.cs.waikato.ac.nz/~ml/weka/index.htmlSupport multiple platforms (written in java):
Windows, Mac OS X and Linux
4 04/10/23
![Page 5: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/5.jpg)
Main Features49 data preprocessing tools76 classification/regression algorithms8 clustering algorithms3 algorithms for finding association rules15 attribute/subset evaluators + 10
search algorithms for feature selection
5 04/10/23
![Page 6: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/6.jpg)
Main GUIThree graphical user interfaces
“The Explorer” (exploratory data analysis)
“The Experimenter” (experimental environment)
“The KnowledgeFlow” (new process model inspired interface)
6 04/10/23
![Page 7: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/7.jpg)
ContentWhat is WEKA?The Explorer:
Preprocess dataClassificationClusteringAssociation RulesAttribute SelectionData Visualization
References and Resources
7 04/10/23
![Page 8: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/8.jpg)
04/10/238
Explorer: pre-processing the dataData can be imported from a file in various
formats: ARFF, CSV, C4.5, binaryData can also be read from a URL or from
an SQL database (using JDBC)Pre-processing tools in WEKA are called
“filters”WEKA contains filters for:
Discretization, normalization, resampling, attribute selection, transforming and combining attributes, …
![Page 9: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/9.jpg)
04/10/239
@relation heart-disease-simplified
@attribute age numeric@attribute sex { female, male}@attribute chest_pain_type { typ_angina, asympt, non_anginal,
atyp_angina}@attribute cholesterol numeric@attribute exercise_induced_angina { no, yes}@attribute class { present, not_present}
@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...
WEKA only deals with “flat” files
![Page 10: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/10.jpg)
04/10/2310
@relation heart-disease-simplified
@attribute age numeric@attribute sex { female, male}@attribute chest_pain_type { typ_angina, asympt, non_anginal,
atyp_angina}@attribute cholesterol numeric@attribute exercise_induced_angina { no, yes}@attribute class { present, not_present}
@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...
WEKA only deals with “flat” files
![Page 11: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/11.jpg)
04/10/23University of Waikato11
![Page 12: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/12.jpg)
04/10/23University of Waikato12
![Page 13: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/13.jpg)
04/10/23University of Waikato13
![Page 14: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/14.jpg)
04/10/23University of Waikato14
![Page 15: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/15.jpg)
04/10/23University of Waikato15
![Page 16: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/16.jpg)
04/10/23University of Waikato16
![Page 17: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/17.jpg)
04/10/23University of Waikato17
![Page 18: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/18.jpg)
04/10/23University of Waikato18
![Page 19: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/19.jpg)
04/10/23University of Waikato19
![Page 20: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/20.jpg)
04/10/23University of Waikato20
![Page 21: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/21.jpg)
04/10/23University of Waikato21
![Page 22: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/22.jpg)
04/10/23University of Waikato22
![Page 23: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/23.jpg)
04/10/23University of Waikato23
![Page 24: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/24.jpg)
04/10/23University of Waikato24
![Page 25: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/25.jpg)
04/10/23University of Waikato25
![Page 26: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/26.jpg)
04/10/23University of Waikato26
![Page 27: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/27.jpg)
04/10/23University of Waikato27
![Page 28: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/28.jpg)
04/10/23University of Waikato28
![Page 29: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/29.jpg)
04/10/23University of Waikato29
![Page 30: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/30.jpg)
04/10/23University of Waikato30
![Page 31: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/31.jpg)
04/10/23University of Waikato31
![Page 32: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/32.jpg)
04/10/2332
Explorer: building “classifiers”Classifiers in WEKA are models for
predicting nominal or numeric quantitiesImplemented learning schemes include:
Decision trees and lists, instance-based classifiers, support vector machines, multi-layer perceptrons, logistic regression, Bayes’ nets, …
![Page 33: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/33.jpg)
April 10, 202333
age income student credit_rating buys_computer<=30 high no fair no<=30 high no excellent no31…40 high no fair yes>40 medium no fair yes>40 low yes fair yes>40 low yes excellent no31…40 low yes excellent yes<=30 medium no fair no<=30 low yes fair yes>40 medium yes fair yes<=30 medium yes excellent yes31…40 medium no excellent yes31…40 high yes fair yes>40 medium no excellent no
This follows an example of Quinlan’s ID3 (Playing Tennis)
Decision Tree Induction: Training Dataset
![Page 34: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/34.jpg)
April 10, 202334
age?
overcast
student? credit rating?
<=30 >40
no yes yes
yes
31..40
no
fairexcellentyesno
Output: A Decision Tree for “buys_computer”
![Page 35: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/35.jpg)
04/10/23University of Waikato36
![Page 36: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/36.jpg)
04/10/23University of Waikato37
![Page 37: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/37.jpg)
04/10/23University of Waikato38
![Page 38: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/38.jpg)
04/10/23University of Waikato39
![Page 39: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/39.jpg)
04/10/23University of Waikato40
![Page 40: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/40.jpg)
04/10/23University of Waikato41
![Page 41: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/41.jpg)
04/10/23University of Waikato42
![Page 42: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/42.jpg)
04/10/23University of Waikato43
![Page 43: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/43.jpg)
04/10/23University of Waikato44
![Page 44: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/44.jpg)
04/10/23University of Waikato45
![Page 45: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/45.jpg)
04/10/23University of Waikato46
![Page 46: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/46.jpg)
04/10/23University of Waikato47
![Page 47: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/47.jpg)
04/10/23University of Waikato48
![Page 48: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/48.jpg)
04/10/23University of Waikato49
![Page 49: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/49.jpg)
04/10/23University of Waikato50
![Page 50: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/50.jpg)
04/10/23University of Waikato51
![Page 51: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/51.jpg)
04/10/23University of Waikato52
![Page 52: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/52.jpg)
04/10/23University of Waikato53
![Page 53: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/53.jpg)
04/10/23University of Waikato54
![Page 54: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/54.jpg)
04/10/23University of Waikato55
![Page 55: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/55.jpg)
04/10/23University of Waikato56
![Page 56: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/56.jpg)
04/10/23University of Waikato57
![Page 57: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/57.jpg)
04/10/2361
Explorer: finding associationsWEKA contains an implementation of the
Apriori algorithm for learning association rulesWorks only with discrete data
Can identify statistical dependencies between groups of attributes:milk, butter bread, eggs (with confidence
0.9 and support 2000)Apriori can compute all rules that have a
given minimum support and exceed a given confidence
![Page 58: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/58.jpg)
April 10, 202362
Basic Concepts: Frequent Patterns
itemset: A set of one or more items
k-itemset X = {x1, …, xk}(absolute) support, or, support
count of X: Frequency or occurrence of an itemset X
(relative) support, s, is the fraction of transactions that contains X (i.e., the probability that a transaction contains X)
An itemset X is frequent if X’s support is no less than a minsup threshold
Customerbuys diaper
Customerbuys both
Customerbuys beer
Tid Items bought
10 Beer, Nuts, Diaper
20 Beer, Coffee, Diaper
30 Beer, Diaper, Eggs
40 Nuts, Eggs, Milk
50 Nuts, Coffee, Diaper, Eggs, Milk
![Page 59: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/59.jpg)
April 10, 202363
Basic Concepts: Association Rules
Find all the rules X Y with minimum support and confidence support, s, probability that
a transaction contains X Y
confidence, c, conditional probability that a transaction having X also contains Y
Let minsup = 50%, minconf = 50%
Freq. Pat.: Beer:3, Nuts:3, Diaper:4, Eggs:3, {Beer, Diaper}:3
Customerbuys diaper
Customerbuys both
Customerbuys beer
Nuts, Eggs, Milk40Nuts, Coffee, Diaper, Eggs,
Milk50
Beer, Diaper, Eggs30
Beer, Coffee, Diaper20
Beer, Nuts, Diaper10
Items boughtTid
Association rules: (many more!) Beer Diaper (60%, 100%) Diaper Beer (60%, 75%)
![Page 60: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/60.jpg)
04/10/23University of Waikato64
![Page 61: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/61.jpg)
04/10/23University of Waikato65
![Page 62: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/62.jpg)
04/10/23University of Waikato66
![Page 63: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/63.jpg)
04/10/23University of Waikato67
![Page 64: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/64.jpg)
04/10/23University of Waikato68
![Page 65: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/65.jpg)
04/10/2369
Explorer: attribute selectionPanel that can be used to investigate which
(subsets of) attributes are the most predictive ones
Attribute selection methods contain two parts:A search method: best-first, forward selection,
random, exhaustive, genetic algorithm, rankingAn evaluation method: correlation-based,
wrapper, information gain, chi-squared, …Very flexible: WEKA allows (almost) arbitrary
combinations of these two
![Page 66: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/66.jpg)
04/10/23University of Waikato70
![Page 67: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/67.jpg)
04/10/23University of Waikato71
![Page 68: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/68.jpg)
04/10/23University of Waikato72
![Page 69: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/69.jpg)
04/10/23University of Waikato73
![Page 70: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/70.jpg)
04/10/23University of Waikato74
![Page 71: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/71.jpg)
04/10/23University of Waikato75
![Page 72: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/72.jpg)
04/10/23University of Waikato76
![Page 73: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/73.jpg)
04/10/23University of Waikato77
![Page 74: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/74.jpg)
04/10/2378
Explorer: data visualizationVisualization very useful in practice: e.g.
helps to determine difficulty of the learning problem
WEKA can visualize single attributes (1-d) and pairs of attributes (2-d)To do: rotating 3-d visualizations (Xgobi-style)
Color-coded class values“Jitter” option to deal with nominal
attributes (and to detect “hidden” data points)
“Zoom-in” function
![Page 75: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/75.jpg)
04/10/23University of Waikato79
![Page 76: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/76.jpg)
04/10/23University of Waikato80
![Page 77: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/77.jpg)
04/10/23University of Waikato81
![Page 78: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/78.jpg)
04/10/23University of Waikato82
![Page 79: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/79.jpg)
04/10/23University of Waikato83
![Page 80: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/80.jpg)
04/10/23University of Waikato84
![Page 81: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/81.jpg)
04/10/23University of Waikato85
![Page 82: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/82.jpg)
04/10/23University of Waikato86
![Page 83: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/83.jpg)
04/10/23University of Waikato87
![Page 84: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/84.jpg)
04/10/23University of Waikato88
![Page 85: WEKA Tutorial](https://reader036.vdocuments.net/reader036/viewer/2022081414/54b9c20b4a7959c82c8b456b/html5/thumbnails/85.jpg)
References and ResourcesReferences:
WEKA website: http://www.cs.waikato.ac.nz/~ml/weka/index.html
WEKA Tutorial: Machine Learning with WEKA: A presentation demonstrating all
graphical user interfaces (GUI) in Weka. A presentation which explains how to use Weka for
exploratory data mining. WEKA Data Mining Book:
Ian H. Witten and Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques (Second Edition)
WEKA Wiki: http://weka.sourceforge.net/wiki/index.php/Main_Page
Others: Jiawei Han and Micheline Kamber, Data Mining: Concepts
and Techniques, 2nd ed.