an introduction to weka explorer -...
TRANSCRIPT
![Page 1: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/1.jpg)
In part from: Yizhou Sun 2008
An Introduction to WEKA Explorer
![Page 2: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/2.jpg)
What is WEKA? � Waikato Environment for Knowledge Analysis
� A data mining/machine learning tool developed by Department of Computer Science, University of Waikato, New Zealand.
� Weka is also a bird found only on the islands of New Zealand.
2 05/10/16
![Page 3: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/3.jpg)
How does it works? � First, you select a dataset and a Machine learning algorithm � You can manipulate the dataset in several ways, as we will
see. � When datset is ready, you select a ML algorithm from the
list, and adjust learning parameters, as we will see � When you run a ML algorithm, the system will:
1. Split the data set into training and testing subsets; 2. Learn a classification function C(x) based on examples in the training set; 3. Classify instances x in the test set based on the learned function C(x); 4. Measure the performances by comparing the generated classifications with
the “ground truth” in the test set.
![Page 4: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/4.jpg)
Download and Install WEKA � Website:
http://www.cs.waikato.ac.nz/~ml/weka/index.html � Support multiple platforms (written in java):
� Windows, Mac OS X and Linux
4 05/10/16
![Page 5: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/5.jpg)
Main Features � 49 data preprocessing tools � 76 classification/regression algorithms � 8 clustering algorithms � 3 algorithms for finding association rules � 15 attribute/subset evaluators + 10 search algorithms
for feature selection
5 05/10/16
![Page 6: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/6.jpg)
Main GUI � Three graphical user interfaces
� “The Explorer” (exploratory data analysis) � “The Experimenter” (experimental
environment) � “The KnowledgeFlow” (new process model
inspired interface) � Simple CLI- provides users without a graphic
interface option the ability to execute commands from a terminal window
6 05/10/16
![Page 7: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/7.jpg)
Explorer � The Explorer:
� Preprocess data � Classification � Clustering � Association Rules � Attribute Selection � Data Visualization
� References and Resources
7 05/10/16
![Page 8: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/8.jpg)
05/10/16 8
Explorer: pre-processing the data � Data can be imported from a file in various formats: ARFF,
CSV, C4.5, binary � Data can also be read from a URL or from an SQL database
(using JDBC Java DataBase Connectivity) � Pre-processing tools in WEKA are called “filters” � WEKA contains filters for:
� Discretization, normalization, resampling, attribute selection, transforming and combining attributes, …
![Page 9: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/9.jpg)
05/10/16 9
@relation heart-disease-simplified @attribute age numeric @attribute sex { female, male} @attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina} @attribute cholesterol numeric @attribute exercise_induced_angina { no, yes} @attribute class { present, not_present} @data 63,male,typ_angina,233,no,not_present 67,male,asympt,286,yes,present 67,male,asympt,229,yes,present 38,female,non_anginal,?,no,not_present ...
WEKA only deals with “flat” files
![Page 10: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/10.jpg)
05/10/16 10
@relation heart-disease-simplified @attribute age numeric @attribute sex { female, male} @attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina} @attribute cholesterol numeric @attribute exercise_induced_angina { no, yes} @attribute class { present, not_present} @data 63,male,typ_angina,233,no,not_present 67,male,asympt,286,yes,present 67,male,asympt,229,yes,present 38,female,non_anginal,?,no,not_present ...
WEKA only deals with “flat” files
![Page 11: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/11.jpg)
05/10/16 University of Waikato 11
![Page 12: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/12.jpg)
05/10/16 University of Waikato 12
![Page 13: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/13.jpg)
You can either open arff file or convert from other formats
![Page 14: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/14.jpg)
![Page 15: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/15.jpg)
![Page 16: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/16.jpg)
IRIS dataset � 150 instances of IRIS (a flower) � 5 attributes, one is the classification c(x) � 3 classes: iris setosa, iris versicolor, iris virginica
![Page 17: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/17.jpg)
05/10/16 University of Waikato 17
For any selected attribute you can get statistics
![Page 18: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/18.jpg)
Attribute data � Min, max and average value of attributes � distribution of values :number of items for which: � class: distribution of attribute values in the classes � The class (e.g. C(x), the classification function to be learned)
is by default THE LAST ATTRIBUTE of the list.
ai = v j | ai ∈ A,v j ∈V
![Page 19: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/19.jpg)
![Page 20: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/20.jpg)
05/10/16 University of Waikato 20
![Page 21: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/21.jpg)
05/10/16 University of Waikato 21
![Page 22: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/22.jpg)
05/10/16 University of Waikato 22
![Page 23: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/23.jpg)
05/10/16 University of Waikato 23
Here you can see the complete statistics (distribution of values) for all the 5 attributes
![Page 24: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/24.jpg)
Filtering attributes � Once the initial data has been selected and loaded the user
can select options for refining the experimental data. � The options in the preprocess window include selection of
optional filters to apply and the user can select or remove different attributes of the data set as necessary to identify specific information (or even write a regex in Perl).
� The user can modify the attribute selection and change the relationship among the different attributes by deselecting different choices from the original data set.
� There are many different filtering options available within the preprocessing window and the user can select the different options based on need and type of data present.
![Page 25: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/25.jpg)
05/10/16 University of Waikato 25
![Page 26: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/26.jpg)
05/10/16 University of Waikato 26
![Page 27: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/27.jpg)
05/10/16 University of Waikato 27
![Page 28: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/28.jpg)
05/10/16 University of Waikato 28
![Page 29: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/29.jpg)
05/10/16 University of Waikato 29
![Page 30: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/30.jpg)
05/10/16 University of Waikato 30
![Page 31: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/31.jpg)
05/10/16 University of Waikato 31
![Page 32: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/32.jpg)
05/10/16 University of Waikato 32
![Page 33: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/33.jpg)
05/10/16 University of Waikato 33
Discretizes in 10 bins of equal frequency
![Page 34: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/34.jpg)
05/10/16 University of Waikato 34
Discretizes in 10 bins of equal frequency
![Page 35: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/35.jpg)
05/10/16 University of Waikato 35
Discretizes in 10 bins of equal frequency
![Page 36: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/36.jpg)
05/10/16 University of Waikato 36
![Page 37: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/37.jpg)
05/10/16 University of Waikato 37
![Page 38: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/38.jpg)
05/10/16 University of Waikato 38
![Page 39: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/39.jpg)
WILL SEE MORE ON FILTERING DURING FIRST LAB!!
![Page 40: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/40.jpg)
05/10/16 40
Explorer: building “classifiers” � “Classifiers” in WEKA are machine learning algorithms for
predicting nominal or numeric values of a selected attribute (e.g. the CLASS attribute in the IRIS file)
� Implemented learning algorithms include: � Conjunctive rules, decision trees and lists, instance-based
classifiers, support vector machines, multi-layer perceptrons, logistic regression, Bayes’ nets, …
� Most, but not all, the algorithms that we will present in this course (e.g. no genetic or reinforcement algorithms)
![Page 41: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/41.jpg)
Explore Conjunctive Rules learner
Need a simple dataset with few attributes , let’s select the weather dataset
![Page 42: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/42.jpg)
Select a Classifier
![Page 43: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/43.jpg)
Right-click to select parameters
numAntds= number of antecedents, -1= empty rule e.g. ()èclass If -1 is selected, you obtain the most likely classification in the datsset
![Page 44: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/44.jpg)
Select numAntds=10
![Page 45: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/45.jpg)
Select training method
Even if you do not understand for now, select “Cross validation” with 10 Folds.
![Page 46: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/46.jpg)
Select the right hand side of the rule (the classification function)
![Page 47: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/47.jpg)
Run the algorithm
![Page 48: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/48.jpg)
Performance data
![Page 49: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/49.jpg)
Error measures in WEKA
Where θi is the “true” classification for xi and θi ^ is the classification produced by the ML algorithm (for binary classifiers θ is either 0 or 1 and | θi ^- θi | is either 0 or 1.
![Page 50: An Introduction to WEKA Explorer - uniroma1.ittwiki.di.uniroma1.it/pub/ApprAuto/WebHome/WEKA1_2016.pdf · An Introduction to WEKA Explorer . What is WEKA? ! Waikato Environment for](https://reader030.vdocuments.net/reader030/viewer/2022033123/5ece8ce85a071c1132433411/html5/thumbnails/50.jpg)
Confusion Matrix
System classified as a System classified as b
Truly classified as a # of instances that system classifies a, ground truth is a
# of instances that system classifies b, ground truth is a
Truly classified as b # of instances that system classifies a, ground truth is b
# of instances that system classifies b, ground truth is b
Cells (1,1) and (2,2) represent “good” classifications. The others are wrong. In fact, we are told that there are 5 correctly classified instances and 9 errors.