prof. dr. lambert schomaker shattering two binary dimensions over a number of classes kunstmatige...
Post on 22-Dec-2015
228 views
TRANSCRIPT
![Page 1: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/1.jpg)
prof. dr. Lambert Schomaker
Shattering two binary dimensionsover a number of classes
Kunstmatige Intelligentie / RuG
![Page 2: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/2.jpg)
2
Samples and classes
In order to understand the principle of shattering sample points into classes we will look at the simple case of
two dimensions
of binary value
![Page 3: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/3.jpg)
3
2-D feature space
0
0
1
1
f1
f2
![Page 4: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/4.jpg)
4
2-D feature space, 2 classes
0
0
1
1
f1
f2
![Page 5: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/5.jpg)
5
the other class…
0
0
1
1
f1
f2
![Page 6: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/6.jpg)
6
2 left vs 2 right
0
0
1
1
f1
f2
![Page 7: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/7.jpg)
7
top vs bottom
0
0
1
1
f1
f2
![Page 8: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/8.jpg)
8
right vs left
0
0
1
1
f1
f2
![Page 9: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/9.jpg)
9
bottom vs top
0
0
1
1
f1
f2
![Page 10: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/10.jpg)
10
lower-right outlier
0
0
1
1
f1
f2
![Page 11: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/11.jpg)
11
lower-left outlier
0
0
1
1
f1
f2
![Page 12: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/12.jpg)
12
upper-left outlier
0
0
1
1
f1
f2
![Page 13: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/13.jpg)
13
upper-right outlier
0
0
1
1
f1
f2
![Page 14: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/14.jpg)
14
etc.
0
0
1
1
f1
f2
![Page 15: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/15.jpg)
15
2-D feature space
0
0
1
1
f1
f2
![Page 16: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/16.jpg)
16
2-D feature space
0
0
1
1
f1
f2
![Page 17: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/17.jpg)
17
2-D feature space
0
0
1
1
f1
f2
![Page 18: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/18.jpg)
18
XOR configuration A
0
0
1
1
f1
f2
![Page 19: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/19.jpg)
19
XOR configuration B
0
0
1
1
f1
f2
![Page 20: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/20.jpg)
20
2-D feature space, two classes: 16 hypotheses
f1=0f1=1f2=0f2=1
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
“hypothesis” = possible class partioning of all data samples
![Page 21: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/21.jpg)
21
2-D feature space, two classes, 16 hypotheses
f1=0f1=1f2=0f2=1
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
two XOR class configurations:
2/16 of hypotheses requires a non-linear separatrix
![Page 22: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/22.jpg)
22
XOR, a possible non-linear separation
0
0
1
1
f1
f2
![Page 23: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/23.jpg)
23
XOR, a possible non-linear separation
0
0
1
1
f1
f2
![Page 24: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/24.jpg)
24
2-D feature space, three classes, # hypotheses?
f1=0f1=1f2=0f2=1
0 1 2 3 4 5 6 7 8
…………
![Page 25: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/25.jpg)
25
2-D feature space, three classes, # hypotheses?
f1=0f1=1f2=0f2=1
0 1 2 3 4 5 6 7 8
…………
34 = 81 possible hypotheses
![Page 26: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/26.jpg)
26
Maximum, discrete space
Four classes: 44 = 256 hypotheses Assume that there are no more classes than
discrete cells Nhypmax = ncellsnclasses
![Page 27: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/27.jpg)
27
2-D feature space, three classes…
0
0
1
1
f1
f2
In this example, is linearly separatablefrom the rest, as is .
But is not linearly separatable from the rest of the classes.
![Page 28: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/28.jpg)
28
2-D feature space, four classes…
0
0
1
1
f1
f2 Minsky & Papert:simple tablelookup or logic will do nicely.
![Page 29: Prof. dr. Lambert Schomaker Shattering two binary dimensions over a number of classes Kunstmatige Intelligentie / RuG](https://reader035.vdocuments.net/reader035/viewer/2022062516/56649d805503460f94a653a0/html5/thumbnails/29.jpg)
29
2-D feature space, four classes…
0
0
1
1
f1
f2 Spheres or radial-basisfunctions may offer a compact classencapsulation in case of limited noise andlimited overlap
(but in the end the datawill tell: experimentationrequired!)