lecture 5 fuzzy expert systems - motaz saad · fuzzification of the input variables, ... the last...

51
Negnevitsky, Pearson Education, 2011 Negnevitsky, Pearson Education, 2011 1 Lecture 5 Lecture 5 Fuzzy expert systems: Fuzzy expert systems: Fuzzy inference Fuzzy inference Mamdani fuzzy inference Mamdani fuzzy inference Sugeno Sugeno fuzzy inference fuzzy inference Case study Case study Summary Summary

Upload: others

Post on 19-Nov-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 1

Lecture 5Lecture 5

Fuzzy expert systems:Fuzzy expert systems:

Fuzzy inferenceFuzzy inference

��Mamdani fuzzy inferenceMamdani fuzzy inference

�� SugenoSugeno fuzzy inferencefuzzy inference

�� Case studyCase study

�� SummarySummary

Page 2: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 2

Fuzzy Fuzzy inferenceinference

The most commonly used fuzzy inference technique The most commonly used fuzzy inference technique

is the sois the so--called Mamdani method. In 1975, called Mamdani method. In 1975,

Professor Professor Ebrahim MamdaniEbrahim Mamdani of London University of London University

built one of the first fuzzy systems to control a built one of the first fuzzy systems to control a

steam engine and boiler combination. He applied a steam engine and boiler combination. He applied a

set of fuzzy rules supplied by experienced human set of fuzzy rules supplied by experienced human

operators.operators.

Page 3: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 3

Mamdani fuzzyMamdani fuzzy inferenceinference

�� The MamdaniThe Mamdani--style fuzzy inference process is style fuzzy inference process is

performed in four steps:performed in four steps:

�� fuzzification of the input variables, fuzzification of the input variables,

�� rule evaluation; rule evaluation;

�� aggregation ofaggregation of the rule outputs, and the rule outputs, and finallyfinally

�� defuzzificationdefuzzification..

Page 4: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 4

We examine a simple twoWe examine a simple two--input oneinput one--outputoutput problem that problem that

includes three rules:includes three rules:

Rule: 1Rule: 1 Rule: 1Rule: 1

IFIF xx is is AA33 IFIF projectproject_funding_funding is is adequateadequate

OROR yy is is BB11 OROR projectproject_staffing_staffing is is smallsmall

THEN THEN zz is is CC11 THEN THEN riskrisk is is lowlow

Rule: 2Rule: 2 Rule: 2Rule: 2

IFIF xx is is AA22 IFIF projectproject_funding_funding is is marginalmarginal

AND AND yy is is BB22 ANDAND projectproject_staffing_staffing is is largelarge

THEN THEN zz is is CC22 THEN THEN riskrisk is is normalnormal

Rule: 3Rule: 3 Rule: 3Rule: 3

IFIF xx is is AA11 IFIF projectproject_funding_funding is is inadequateinadequate

THEN THEN zz is is CC33 THEN THEN riskrisk is is highhigh

Page 5: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 5

Step 1: Step 1: FuzzificationFuzzification

TheThe first step is to take the crisp inputs, first step is to take the crisp inputs, xx1 and 1 and yy1 1

((project fundingproject funding and and project staffingproject staffing), and determine ), and determine

the degree to which these inputs belong to each of the the degree to which these inputs belong to each of the

appropriate fuzzy setsappropriate fuzzy sets..

Crisp Input

y1

0.1

0.7

1

0y1

B1 B2

Y

Crisp Input

0.2

0.5

1

0

A1 A2 A3

x1

x1 X

µ (x = A1) = 0.5

µ (x = A2) = 0.2

µ (y = B1) = 0.1

µ (y = B2) = 0.7

Page 6: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 6

Step 2: Rule Step 2: Rule EvaluationEvaluation

TheThe second step is to take thesecond step is to take the fuzzifiedfuzzified inputs, inputs,

µµ((xx==AA1)1) = 0.5, = 0.5, µµ((xx==AA2)2) = 0.2, = 0.2, µµ((yy==BB1)1) = 0.1 and = 0.1 and µµ((yy==BB2)2) = = 0.7, and apply them to the antecedents of the fuzzy 0.7, and apply them to the antecedents of the fuzzy

rules. If a given fuzzy rule has multiple antecedents, rules. If a given fuzzy rule has multiple antecedents,

the fuzzy operator (AND or OR) is used to obtain a the fuzzy operator (AND or OR) is used to obtain a

single number that represents the result of the single number that represents the result of the

antecedent evaluation. This number (the truth value) antecedent evaluation. This number (the truth value)

is then applied to the consequent membership is then applied to the consequent membership

functionfunction..

Page 7: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 7

To evaluate the disjunction of the rule antecedents, To evaluate the disjunction of the rule antecedents,

we use the we use the OR fuzzy operationOR fuzzy operation. Typically, fuzzy . Typically, fuzzy

expert systems make use of the classical fuzzy expert systems make use of the classical fuzzy

operation operation unionunion::

µµµµµµµµAA∪∪∪∪∪∪∪∪BB((xx) = ) = maxmax [[µµµµµµµµAA((xx), ), µµµµµµµµBB((xx)])]

Similarly, in order to evaluate the conjunction of the Similarly, in order to evaluate the conjunction of the

rule antecedents, we apply the rule antecedents, we apply the AND fuzzy operationAND fuzzy operation

intersectionintersection::

µµµµµµµµAA∩∩∩∩∩∩∩∩BB((xx) = ) = minmin [[µµµµµµµµAA((xx), ), µµµµµµµµBB((xx)])]

Page 8: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 8

MamdaniMamdani--style rule evaluationstyle rule evaluation

A3

1

0 X

1

y1 0 Y

0.0

x1 0

0.1 C1

1

C2

Z

1

0 X

0.2

0

0.2 C1

1

C2

Z

A2

x1

Rule 3:

A1 1

0 X 0

1

Z x1

THEN

C1 C2

1

y1

B2

0 Y

0.7

B1 0.1

C3

C3

C3 0.5 0.5

OR (max)

AND (min)

OR THEN Rule 1:

AND THEN Rule 2:

IF x is A3 (0.0) y is B1 (0.1) z is C1 (0.1)

IF x is A2 (0.2) y is B2 (0.7) z is C2 (0.2)

IF x is A1 (0.5) z is C3 (0.5)

Page 9: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 9

Now the result of the antecedent evaluation can be Now the result of the antecedent evaluation can be

applied to the membership function of the applied to the membership function of the

consequent.consequent.

�� The most common method of correlating the rule The most common method of correlating the rule

consequent with the truth value of the rule consequent with the truth value of the rule

antecedent is to antecedent is to cut thecut the consequent membership consequent membership

function at the level of the antecedent truth. This function at the level of the antecedent truth. This

method is called method is called clippingclipping. Since the top of the . Since the top of the

membership function is sliced, the clipped fuzzy set membership function is sliced, the clipped fuzzy set

loses some information. However, clipping is still loses some information. However, clipping is still

often preferred because it involves less complex and often preferred because it involves less complex and

faster mathematics, and generates an aggregated faster mathematics, and generates an aggregated

output surface that is easier tooutput surface that is easier to defuzzifydefuzzify..

Page 10: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 10

�� While clipping is a frequently used method, While clipping is a frequently used method, scalingscaling

offers a better approach for preserving the original offers a better approach for preserving the original

shape of the fuzzy set. The original membership shape of the fuzzy set. The original membership

function of the rule consequent is adjusted by function of the rule consequent is adjusted by

multiplying all its membership degrees by the truth multiplying all its membership degrees by the truth

value of the rule antecedent. This method, which value of the rule antecedent. This method, which

generally loses less information, can be very useful generally loses less information, can be very useful

in fuzzy expert systems.in fuzzy expert systems.

Page 11: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 11

ClippedClipped and scaledand scaled membershipmembership functionsfunctions

Degree ofMembership

1.0

0.0

0.2

Z

Degree ofMembership

Z

C2

1.0

0.0

0.2

C2

Page 12: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 12

Step 3: Aggregation of the rule Step 3: Aggregation of the rule outputsoutputs

AggregationAggregation is the process of unification of the is the process of unification of the

outputs of all rules. outputs of all rules. We take the membershipWe take the membership

functions of all rulefunctions of all rule consequentsconsequents previously clipped or previously clipped or

scaled and combine them into a single fuzzy set. scaled and combine them into a single fuzzy set.

The inputThe input of the aggregation process is the list of of the aggregation process is the list of

clipped or scaled consequent membership functions, clipped or scaled consequent membership functions,

and the output is one fuzzy set for each output and the output is one fuzzy set for each output

variable.variable.

Page 13: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 13

AggregationAggregation of the rule of the rule outputsoutputs

0

0.1

1C1

Cz is 1 (0.1)

C2

0

0.2

1

Cz is 2 (0.2)

0

0.5

1

Cz is 3 (0.5)

ZZZ

0.2

Z0

C30.5

0.1

Page 14: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 14

Step 4: Step 4: DefuzzificationDefuzzification

TheThe last step in the fuzzy inference process islast step in the fuzzy inference process is

defuzzificationdefuzzification. Fuzziness helps us to evaluate the . Fuzziness helps us to evaluate the

rules, but the final output of a fuzzy system has to be rules, but the final output of a fuzzy system has to be

a crisp number. The input for thea crisp number. The input for the defuzzificationdefuzzification

process is the aggregate output fuzzy set and the process is the aggregate output fuzzy set and the

output is a single number.output is a single number.

Page 15: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 15

�� There are severalThere are several defuzzificationdefuzzification methods, but methods, but

probably the most popular one is theprobably the most popular one is the centroidcentroid

techniquetechnique. It finds the point where a vertical line . It finds the point where a vertical line

would slice the aggregate set into two equal masses. would slice the aggregate set into two equal masses.

Mathematically this Mathematically this centre of gravity (COG)centre of gravity (COG) can can

be expressed as:be expressed as:

( )

( )∫

µ

µ

=b

a

A

b

a

A

dxx

dxxx

COG

Page 16: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 16

�� CentroidCentroid defuzzificationdefuzzification method finds a point method finds a point

representing the centre of gravity of the fuzzy set, representing the centre of gravity of the fuzzy set, AA, ,

on the interval, on the interval, abab..

�� A reasonable estimate can be obtained by calculating A reasonable estimate can be obtained by calculating

it over a sample of points.it over a sample of points.

1.0

µ ( x )

0.0

0.2

0.4

0.6

0.8

170 180 190 200

a b

210

A

150

X

Page 17: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 17

Centre of gravity (COG):Centre of gravity (COG):

4.675.05.05.05.02.02.02.02.01.01.01.0

5.0)100908070(2.0)60504030(1.0)20100(=

++++++++++

×++++×++++×++=COG

1.0

0.0

0.2

0.4

0.6

0.8

0 20 30 40 5010 70 80 90 10060

Z

Degree ofMembership

67.4

Page 18: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 18

�� MamdaniMamdani--style inference, as we have just seen, style inference, as we have just seen,

requires us to find therequires us to find the centroidcentroid of a twoof a two--dimensional dimensional

shape by integrating across a continuously varying shape by integrating across a continuously varying

function. In general, this process is not function. In general, this process is not

computationally efficient.computationally efficient.

�� Michio SugenoMichio Sugeno suggested to usesuggested to use a single spike, a a single spike, a

singletonsingleton, as the membership function of the rule , as the membership function of the rule

consequent. consequent. A A singletonsingleton, or more precisely a , or more precisely a fuzzy fuzzy

singletonsingleton, is a fuzzy set with a membership , is a fuzzy set with a membership

functionfunction that is unity at a single particular point on that is unity at a single particular point on

the universe of discourse and zero everywhere else.the universe of discourse and zero everywhere else.

Sugeno fuzzySugeno fuzzy inferenceinference

Page 19: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 19

SugenoSugeno--style fuzzy inference is very similar to the style fuzzy inference is very similar to the

Mamdani method.Mamdani method. SugenoSugeno changed only a rule changed only a rule

consequent. Instead of a fuzzy set, he used a consequent. Instead of a fuzzy set, he used a

mathematical function of the input variable. The mathematical function of the input variable. The

format of theformat of the SugenoSugeno--style fuzzy rulestyle fuzzy rule isis

IFIF xx is is AA

ANDAND yy is is BB

THEN THEN zz is is f f ((x, yx, y))

where where xx, , yy and and zz are linguistic variables; are linguistic variables; AA and and BB are are

fuzzy sets on universe of discourses fuzzy sets on universe of discourses XX and and YY, ,

respectively; and respectively; and f f ((x, yx, y) is a mathematical function.) is a mathematical function.

Page 20: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 20

TheThe most commonly used most commonly used zerozero--orderorder SugenoSugeno fuzzy fuzzy

modelmodel applies fuzzy rules in the following form:applies fuzzy rules in the following form:

IFIF xx is is AA

ANDAND yy is is BB

THEN THEN zz is is kk

where where kk is a constant.is a constant.

In this case, the output of each fuzzy rule is constant. In this case, the output of each fuzzy rule is constant.

All consequent membershipAll consequent membership functions are represented functions are represented

by singleton spikes.by singleton spikes.

Page 21: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 21

A3

1

0 X

1

y10 Y

0.0

x1 0

0.1

1

Z

1

0 X

0.2

0

0.2

1

Z

A2

x1

IF x is A1 (0.5) z is k3 (0.5)Rule 3:

A11

0 X 0

1

Zx1

THEN

1

y1

B2

0 Y

0.7

B10.1

0.5 0.5

OR(max)

AND(min)

OR y is B1 (0.1) THEN z is k1 (0.1)Rule 1:

IF x is A2 (0.2) AND y is B2 (0.7) THEN z is k2 (0.2)Rule 2:

k1

k2

k3

IF x is A3 (0.0)

SugenoSugeno--style rule evaluationstyle rule evaluation

Page 22: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 22

SugenoSugeno--style style aggregation of the rule outputsaggregation of the rule outputs

z is k1 (0.1) z is k2 (0.2) z is k3 (0.5) ∑

0

1

0.1

Z 0

0.5

1

Z 0

0.2

1

Z k1 k2 k3 0

1

0.1

Z k1 k2 k3

0.2 0.5

Page 23: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 23

Weighted average (WA):Weighted average (WA):

655.02.01.0

805.0502.0201.0

)3()2()1(

3)3(2)2(1)1(=

++

×+×+×=

µ+µ+µ

×µ+×µ+×µ=

kkk

kkkkkkWA

0 Z

Crisp Output

z1

z1

SugenoSugeno--style style defuzzificationdefuzzification

Page 24: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 24

How to make a decision on which method How to make a decision on which method

to apply to apply −−−−−−−− Mamdani or Sugeno?Mamdani or Sugeno?

�� Mamdani method is widely accepted for capturing Mamdani method is widely accepted for capturing

expert knowledge. It allows us to describe the expert knowledge. It allows us to describe the

expertise in more intuitive, more humanexpertise in more intuitive, more human--like like

manner. However, Mamdanimanner. However, Mamdani--type fuzzy inference type fuzzy inference

entails a substantial computational burden. entails a substantial computational burden.

�� On the other hand, Sugeno method is On the other hand, Sugeno method is

computationally effective and works well with computationally effective and works well with

optimisation and adaptive techniques, which makes optimisation and adaptive techniques, which makes

it very attractive in control problems, particularly it very attractive in control problems, particularly

for dynamic nonlinear systems.for dynamic nonlinear systems.

Ashraf
Highlight
Ashraf
Highlight
Page 25: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 25

Building a fuzzy expert system: case studyBuilding a fuzzy expert system: case study

�� A service centre keeps spare parts and repairs failed A service centre keeps spare parts and repairs failed

ones. ones.

�� A customer brings a failed item and receives a spare A customer brings a failed item and receives a spare

of the same type. of the same type.

�� Failed parts are repaired, placed on the shelf, and Failed parts are repaired, placed on the shelf, and

thus become spares. thus become spares.

�� The objective here is to advise a manager of the The objective here is to advise a manager of the

service centre on certain decision policies to keep service centre on certain decision policies to keep

the customers satisfied.the customers satisfied.

Page 26: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 26

Process of developing a fuzzy expert systemProcess of developing a fuzzy expert system

1. Specify the problem and define linguistic variables.1. Specify the problem and define linguistic variables.

2. Determine fuzzy sets.2. Determine fuzzy sets.

3. Elicit and construct fuzzy rules.3. Elicit and construct fuzzy rules.

4. Encode the fuzzy sets, fuzzy rules and procedures 4. Encode the fuzzy sets, fuzzy rules and procedures

to perform fuzzy inference into the expert system.to perform fuzzy inference into the expert system.

5. Evaluate and tune the system.5. Evaluate and tune the system.

Page 27: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 27

Step Step 11: Specify the problem and define: Specify the problem and define

linguistic variableslinguistic variables

There are four main linguistic variables: average There are four main linguistic variables: average

waiting time (mean delay) waiting time (mean delay) mm, repair utilisation , repair utilisation

factor of the service centre factor of the service centre ρρ, number of servers , number of servers ss, ,

and initial number of spare parts and initial number of spare parts nn..

Page 28: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 28

Linguistic variables and their rangesLinguistic variables and their rangesLinguistic Variable: Mean Delay, m

Linguistic Value Notation Numerical Range (normalised)

Very Short

Short

Medium

VS

S

M

[0, 0.3]

[0.1, 0.5]

[0.4, 0.7]

Linguistic Variable: Number of Servers, s

Linguistic Value Notation Numerical Range (normalised)

Small

Medium

Large

S

M

L

[0, 0.35]

[0.30, 0.70]

[0.60, 1]

Linguistic Variable: Repair Utilisation Factor, ρLinguistic Value Notation Numerical Range

Low

Medium

High

L

M

H

[0, 0.6]

[0.4, 0.8]

[0.6, 1]

Linguistic Variable: Number of Spares, n

Linguistic Value Notation Numerical Range (normalised)

Very Small

Small

Rather Small

Medium

Rather Large

Large

Very Large

VS

S

RS

M

RL

L

VL

[0, 0.30]

[0, 0.40]

[0.25, 0.45]

[0.30, 0.70]

[0.55, 0.75]

[0.60, 1]

[0.70, 1]

Linguistic Variable: Mean Delay, m

Linguistic Variable: Number of Servers, s

Linguistic Variable: Repair Utilisation Factor, ρ

Linguistic Variable: Number of Spares, n

Page 29: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 29

Step Step 22: Determine fuzzy sets: Determine fuzzy sets

Fuzzy sets can have a variety of shapes. However, Fuzzy sets can have a variety of shapes. However,

a triangle or a trapezoid can often provide an a triangle or a trapezoid can often provide an

adequate representation of the expert knowledge, adequate representation of the expert knowledge,

and at the same time, significantly simplifies the and at the same time, significantly simplifies the

process of computation.process of computation.

Page 30: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 30

Fuzzy sets of Fuzzy sets of Mean Delay mMean Delay m

0.10

1.0

0.0

0.2

0.4

0.6

0.8

0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Mean Delay (normalised)

SVS M

Degree of

Membership

Page 31: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 31

Fuzzy sets of Fuzzy sets of Number of Servers sNumber of Servers s

0.10

1.0

0.0

0.2

0.4

0.6

0.8

0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

M LS

Degree of

Membership

Number of Servers (normalised)

Page 32: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 32

Fuzzy sets of Fuzzy sets of Repair Utilisation Factor Repair Utilisation Factor ρρρρρρρρ

0.10

1.0

0.0

0.2

0.4

0.6

0.8

0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Repair Utilisation Factor

M HL

Degree of

Membership

Page 33: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 33

Fuzzy sets of Fuzzy sets of Number of Spares nNumber of Spares n

0.10

1.0

0.0

0.2

0.4

0.6

0.8

0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

S RSVS M RL L VL

Degree of

Membership

Number of Spares (normalised)

Page 34: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 34

Step Step 33: Elicit and construct fuzzy rules: Elicit and construct fuzzy rules

To accomplish this task, we might ask the expert to To accomplish this task, we might ask the expert to

describe how the problem can be solved using the describe how the problem can be solved using the

fuzzy linguistic variables defined previously.fuzzy linguistic variables defined previously.

Required knowledge also can be collected from Required knowledge also can be collected from

other sources such as books, computer databases, other sources such as books, computer databases,

flow diagrams and observed human behaviour. flow diagrams and observed human behaviour.

Page 35: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 35

The square FAM representationThe square FAM representation

m

s

M

RL

VL

S

RS

L

VS

S

M

VS S M

L

M

S

Page 36: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 36

The rule tableThe rule table

Rule m s ρ n Rule m s ρ n Rule m s ρ n

1 VS S L VS 10 VS S M S 19 VS S H VL

2 S S L VS 11 S S M VS 20 S S H L

3 M S L VS 12 M S M VS 21 M S H M

4 VS M L VS 13 VS M M RS 22 VS M H M

5 S M L VS 14 S M M S 23 S M H M

6 M M L VS 15 M M M VS 24 M M H S

7 VS L L S 16 VS L M M 25 VS L H RL

8 S L L S 17 S L M RS 26 S L H M

9 M L L VS 18 M L M S 27 M L H RS

Page 37: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 37

Rule Base 1Rule Base 1

1. If (utilisation_factor is L) then (number_of_spares is S)

2. If (utilisation_factor is M) then (number_of_spares is M)

3. If (utilisation_factor is H) then (number_of_spares is L)

4. If (mean_delay is VS) and (number_of_servers is S) then (number_of_spares is VL)

5. If (mean_delay is S) and (number_of_servers is S) then (number_of_spares is L)

6. If (mean_delay is M) and (number_of_servers is S) then (number_of_spares is M)

7. If (mean_delay is VS) and (number_of_servers is M) then (number_of_spares is RL)

8. If (mean_delay is S) and (number_of_servers is M) then (number_of_spares is RS)

9. If (mean_delay is M) and (number_of_servers is M) then (number_of_spares is S)

10.If (mean_delay is VS) and (number_of_servers is L) then (number_of_spares is M)

11.If (mean_delay is S) and (number_of_servers is L) then (number_of_spares is S)

12.If (mean_delay is M) and (number_of_servers is L) then (number_of_spares is VS)

Page 38: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 38

Cube FAM of Rule Base 2Cube FAM of Rule Base 2

VS VS VSVS VS VSVS VS VS

VL L M

HS

VS VS VSVS VS VSVS VS VSM

VS VS VSVS VS VSS S VSL

s

LVS S M

m

MH

ρρ

VS VS VS

LVS S M

S

m

VS VS VSM

S S VSL

s

S VS VS

MVS S M

m

VS S M

m

S

RS S VSM

M RS SL

s

S

M M SM

RL M RSL

s

Page 39: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 39

Step Step 44: Encode the fuzzy sets, fuzzy rules: Encode the fuzzy sets, fuzzy rules

and procedures to perform fuzzyand procedures to perform fuzzy

inference into the expert systeminference into the expert system

To accomplish this task, we may choose one of To accomplish this task, we may choose one of

two options: to build our system using a two options: to build our system using a

programming language such as C/C++ or Pascal, programming language such as C/C++ or Pascal,

or to apply a fuzzy logic development tool such as or to apply a fuzzy logic development tool such as

MATLAB Fuzzy Logic Toolbox or Fuzzy MATLAB Fuzzy Logic Toolbox or Fuzzy

Knowledge Builder.Knowledge Builder.

Page 40: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 40

Step Step 55: Evaluate and tune the system: Evaluate and tune the system

The last, and the most laborious, task is to evaluate The last, and the most laborious, task is to evaluate

and tune the system. We want to see whether our and tune the system. We want to see whether our

fuzzy system meets the requirements specified at fuzzy system meets the requirements specified at

the beginning. the beginning.

Several test situations depend on the mean delay, Several test situations depend on the mean delay,

number of servers and repair utilisation factor. number of servers and repair utilisation factor.

The Fuzzy Logic Toolbox can generate surface to The Fuzzy Logic Toolbox can generate surface to

help us analyse the systemhelp us analyse the system’’s performance.s performance.

Page 41: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 41

ThreeThree--dimensional plots for Rule Base 1dimensional plots for Rule Base 1

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.2

0.3

0.4

0.5

0.6

number_of_serversmean_delay

nu

mb

er_

of_

sp

are

s

Page 42: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 42

ThreeThree--dimensional plots for Rule Base 1dimensional plots for Rule Base 1

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.2

0.3

0.4

0.5

0.6

utilisation_factormean_delay

nu

mb

er_

of_

sp

are

s

Page 43: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 43

ThreeThree--dimensional plots for Rule Base 2dimensional plots for Rule Base 2

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.15

0.2

0.25

0.3

0.35

number_of_serversmean_delay

nu

mb

er_

of_

sp

are

s

Page 44: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 44

ThreeThree--dimensional plots for Rule Base 2dimensional plots for Rule Base 2

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.2

0.3

0.4

utilisation_factormean_delay

nu

mb

er_

of_

sp

are

s

0.5

Page 45: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 45

However, even now, the expert might not be However, even now, the expert might not be

satisfied with the system performance. satisfied with the system performance.

To improve the system performance, we may use To improve the system performance, we may use

additional sets additional sets −− Rather SmallRather Small and and Rather LargeRather Large −−on the universe of discourse on the universe of discourse Number of ServersNumber of Servers, ,

and then extend the rule base.and then extend the rule base.

Page 46: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 46

Modified fuzzy sets of Modified fuzzy sets of Number of Servers sNumber of Servers s

0.10

1.0

0.0

0.2

0.4

0.6

0.8

0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Number of Servers (normalised)

RS M RL LS

Degree of

Membership

Page 47: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 47

Cube FAM of Rule Base 3Cube FAM of Rule Base 3

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

VS VS VS

S S VS

S S VS

VL L M

VL RL RS

M M S

RL M RS

L M RS

HS

M

RL

L

RS

s

LVS S M

m

MH

ρρ

VS VS VS

VS VS VS

VS VS VS

S S VS

S S VS

LVS S M

S

M

RL

L

RS

m

s

S VS VS

S VS VS

RS S VS

M RS S

M RS S

MVS S M

m

VS S M

m

S

M

RL

L

RS

s

S

M

RL

L

RS

s

Page 48: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 48

ThreeThree--dimensional plots for Rule Base 3dimensional plots for Rule Base 3

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.15

0.2

0.25

0.3

0.35

number_of_serversmean_delay

nu

mb

er_

of_

sp

are

s

Page 49: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 49

ThreeThree--dimensional plots for Rule Base 3dimensional plots for Rule Base 3

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.2

0.3

0.4

utilisation_factormean_delay

nu

mb

er_

of_

sp

are

s

0.5

Page 50: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 50

Tuning fuzzy systems Tuning fuzzy systems

1.1. Review model input and output variables, and ifReview model input and output variables, and if

required redefine their ranges.required redefine their ranges.

2.2. Review the fuzzy sets, and if required defineReview the fuzzy sets, and if required define

additional sets on the universe of discourse.additional sets on the universe of discourse.

The use of wide fuzzy sets may cause the fuzzyThe use of wide fuzzy sets may cause the fuzzy

system to perform roughly.system to perform roughly.

3.3. Provide sufficient overlap between neighbouring Provide sufficient overlap between neighbouring

sets. It is suggested that trianglesets. It is suggested that triangle--toto--triangle and triangle and

trapezoidtrapezoid--toto--triangle fuzzy sets should overlap triangle fuzzy sets should overlap

between 25% to 50% of their bases.between 25% to 50% of their bases.

Page 51: Lecture 5 Fuzzy expert systems - Motaz Saad · fuzzification of the input variables, ... The last step in the fuzzy inference process is defuzzification . Fuzziness helps us to evaluate

Negnevitsky, Pearson Education, 2011Negnevitsky, Pearson Education, 2011 51

4.4. Review the existing rules, and if required add new Review the existing rules, and if required add new

rules to the rule base.rules to the rule base.

5.5. Examine the rule base for opportunities to write Examine the rule base for opportunities to write

hedge rules to capture the pathological behaviour hedge rules to capture the pathological behaviour

of the system.of the system.

6.6. Adjust the rule execution weights. Most fuzzy Adjust the rule execution weights. Most fuzzy

logic tools allow control of the importance of rules logic tools allow control of the importance of rules

by changing a weight multiplier.by changing a weight multiplier.

7.7. Revise shapes of the fuzzy sets. In most cases, Revise shapes of the fuzzy sets. In most cases,

fuzzy systems are highly tolerant of a shape fuzzy systems are highly tolerant of a shape

approximation.approximation.