introduction metaheuristics: increasingly popular in research and industry mimic natural metaphors...

14
Introduction Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and effective to deliver satisfactory solutions to large and complex problems in a reasonable time some of the most successful metaheuristics: Genetic Algorithms Ant Colony Optimization Generalized Nets, Generalized Nets, Ant Colony Optimization Ant Colony Optimization Algorithms Algorithms and Genetic Algorithms and Genetic Algorithms Vassia Atanassova Vassia Atanassova Stefka Fidanova Stefka Fidanova Ivan Popchev Ivan Popchev Panagiotis Chountas Panagiotis Chountas 8th IMACS Seminar on Monte Carlo Methods August 29–September 2, 2011, Borovets, Bulgaria

Upload: martin-mcgee

Post on 06-Jan-2018

214 views

Category:

Documents


0 download

DESCRIPTION

Parallel global search technique that emulates natural genetic operators GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information Population of individuals (tentative solutions) Fitness function (individual’s suitability to problem) Operators: selection, crossover and mutation Stop criterion (# iterations, finding of individual) Convergence towards a global solution Genetic Algorithms Extension of Petri Nets and their modifications Apparatus for description of parallel processes Static structure: –Transitions –Places Dynamic structure: –Tokens –Predicate index matrices Memory Time Generalized Nets Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and effective to solve large and complex problems allow to tackle large-size problems by delivering satisfactory solutions in a reasonable time some of the most successful metaheuristics: –Genetic Algorithms –Ant Colony Optimization Generalized Nets, ACO Algorithms and Genetic Algorithms Vassia Atanassova Stefka Fidanova Ivan Popchev Panagiotis Chountas 8th IMACS Seminar on Monte Carlo Methods August 29–September 2, 2011, Borovets, Bulgaria

TRANSCRIPT

Page 1: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

IntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to deliver satisfactory

solutions to large and complex problems in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,Ant Colony Optimization Ant Colony Optimization

AlgorithmsAlgorithmsand Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 2: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to deliver satisfactory

solutions to large and complex problems in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 3: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation

•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 4: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation

•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 5: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 6: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• ACO search procedure – in terms of GNs

– A GN was constructed, describing the ACO algorithm.

– On this basis, the opportunity arose for modification and improvement of the ACO algorithm.

– GN models realizing the new modified versions of ACO were built.

– The test samples proved that these modifications, resulting from the application of GNs, yield better results according to time.

GN models of ACOGN models of ACO

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 7: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO search procedure – in terms of GNs

– A GN was constructed, describing the ACO algorithm.

– On this basis, the opportunity arose for modification and improvement of the ACO algorithm.

– GN models realizing the new modified versions of ACO were built.

– The test samples proved that these modifications, resulting from the application of GNs, yield better results according to time.

GN models of ACOGN models of ACO

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 8: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• We describe ACO and GA with GNs (GACO and GGA, respectively) and using them we prepare a GN describing the hybrid ACO/GA algorithm. The problem is coded in Gproc.

• Both GACO and GGA have one input and one output places:

Constructing the GN model Constructing the GN model

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 9: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• Let token of GN Gproc enter place l1 of the GN with initial characteristic “current problem description(graph of the problem, problem constraints, etc.”

whereWGA,2 = “a next iteration is necessary”,WGA,3 = ¬ WGA,2,where ¬ P is the negation of predicate P.

Constructing the GN model Constructing the GN model

• We describe ACO and GA with GNs (GACO and GGA, respectively) and using them we prepare a GN describing the hybrid ACO/GA algorithm. The problem is coded in Gproc.

• Both GACO and GGA have one input and one output places:

Constructing the GN model Constructing the GN model

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 10: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• The -tokens from places l2 or l5 enter place iACO without a new characteristic. It transfers through GN GACO and going out of it (through place oACO) obtains the characteristic

“current solutions of ACO-algorithm”.

Constructing the GN model Constructing the GN model

• Let token of GN Gproc enter place l1 of the GN with initial characteristic “current problem description(graph of the problem, problem constraints, etc.”

whereWGA,2 = “a next iteration is necessary”,WGA,3 = ¬ WGA,2,where ¬ P is the negation of predicate P.

Constructing the GN model Constructing the GN model

• We describe ACO and GA with GNs (GACO and GGA, respectively) and using them we prepare a GN describing the hybrid ACO/GA algorithm. The problem is coded in GPROC.

• Both GACO and GGA have one input and one output places:

Constructing the GN model Constructing the GN model

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 11: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• whereWACO,4 = “The end-condition is satisfied”,WACO,5 = ¬ WACO,5

• When the truth-value of WACO,4 is “true”, token enters place l4 with the characteristic “representation of the current solutions (populations) in appropriate form of the GA”.

• Otherwise, it enters place l5 without a new characteristic.

Constructing the GN model Constructing the GN model

• The -tokens from places l2 or l5 enter place iACO without a new characteristic. It transfers through GN GACO and going out of it (through place oACO) obtains the characteristic

“current solutions of ACO-algorithm”.

Constructing the GN model Constructing the GN model

• Let token of GN Gproc enter place l1 of the GN with initial characteristic “current problem description(graph of the problem, problem constraints, etc.”

whereWGA,2 = “a next iteration is necessary”,WGA,3 = ¬ WGA,2,where ¬ P is the negation of predicate P.

Constructing the GN model Constructing the GN model

• We describe ACO and GA with GNs (GACO and GGA, respectively) and using them we prepare a GN describing the hybrid ACO/GA algorithm. The problem is coded in GPROC.

• Both GACO and GGA have one input and one output places:

Constructing the GN model Constructing the GN model

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 12: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

• Token from place l4 enters place iGA with the characteristic

“current population (solutions) of the GA”.

Constructing the GN model Constructing the GN model

• whereWACO,4 = “The end-condition is satisfied”,WACO,5 = ¬ WACO,5

• When the truth-value of WACO,4 is “true”, token enters place l4 with the characteristic “representation of the current solutions (populations) in appropriate form of the GA”.

• Otherwise, it enters place l5 without a new characteristic.

Constructing the GN model Constructing the GN model

• The -tokens from places l2 or l5 enter place iACO without a new characteristic. It transfers through GN GACO and going out of it (through place oACO) obtains the characteristic

“current solutions of ACO-algorithm (population generations)”.

Constructing the GN model Constructing the GN model

• Let token of GN Gproc enter place l1 of the GN with initial characteristic “current problem description(graph of the problem, problem constraints, etc.”

whereWGA,2 = “a next iteration is necessary”,WGA,3 = ¬ WGA,2,where ¬ P is the negation of predicate P.

Constructing the GN model Constructing the GN model

• We describe ACO and GA with GNs (GACO and GGA, respectively) and using them we prepare a GN describing the hybrid ACO/GA algorithm. The problem is coded in GPROC.

• Both GACO and GGA have one input and one output places:

Constructing the GN model Constructing the GN model

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 13: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

Thank youThank youfor your attention!for your attention!

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

Acknowledgment to Grants DID-02-29 “Modeling Processes with Fixed Development Rules” and DTK-02-44 “Effective Monte Carlo Methods for Large-Scale Scientific Problems” by

National Science Fund of Bulgaria, and Grant JP 100372 by Royal Society, UK

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

• Token from place l4 enters place iGA with the characteristic

“current population (solutions) of the GA”.

Constructing the GN model Constructing the GN model

• whereWACO,4 = “The end-condition is satisfied”,WACO,5 = ¬ WACO,5

• When the truth-value of WACO,4 is “true”, token enters place l4 with the characteristic “representation of the current solutions (populations) in appropriate form of the GA”.

• Otherwise, it enters place l5 without a new characteristic.

Constructing the GN model Constructing the GN model

• The -tokens from places l2 or l5 enter place iACO without a new characteristic. It transfers through GN GACO and going out of it (through place oACO) obtains the characteristic

“current solutions of ACO-algorithm (population generations)”.

Constructing the GN model Constructing the GN model

• Let token of GN Gproc enter place l1 of the GN with initial characteristic “current problem description(graph of the problem, problem constraints, etc.”

whereWGA,2 = “a next iteration is necessary”,WGA,3 = ¬ WGA,2,where ¬ P is the negation of predicate P.

Constructing the GN model Constructing the GN model

• We describe ACO and GA with GNs (GACO and GGA, respectively) and using them we prepare a GN describing the hybrid ACO/GA algorithm. The problem is coded in GPROC.

• Both GACO and GGA have one input and one output places:

Constructing the GN model Constructing the GN model

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

Page 14: Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and

Thank youThank youfor your attention!for your attention!

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

Acknowledgment to Grants DID-02-29 “Modeling Processes with Fixed Development Rules” and DTK-02-44 “Effective Monte Carlo Methods for Large-Scale Scientific Problems” by

National Science Fund of Bulgaria, and Grant JP 100372 by Royal Society, UK

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria

• Token from place l4 enters place iGA with the characteristic

“current population (solutions) of the GA”.

Constructing the GN model Constructing the GN model

• whereWACO,4 = “The end-condition is satisfied”,WACO,5 = ¬ WACO,5

• When the truth-value of WACO,4 is “true”, token enters place l4 with the characteristic “representation of the current solutions (populations) in appropriate form of the GA”.

• Otherwise, it enters place l5 without a new characteristic.

Constructing the GN model Constructing the GN model

• The -tokens from places l2 or l5 enter place iACO without a new characteristic. It transfers through GN GACO and going out of it (through place oACO) obtains the characteristic

“current solutions of ACO-algorithm (population generations)”.

Constructing the GN model Constructing the GN model

• Let token of GN Gproc enter place l1 of the GN with initial characteristic “current problem description(graph of the problem, problem constraints, etc.”

whereWGA,2 = “a next iteration is necessary”,WGA,3 = ¬ WGA,2,where ¬ P is the negation of predicate P.

Constructing the GN model Constructing the GN model

• We describe ACO and GA with GNs (GACO and GGA, respectively) and using them we prepare a GN describing the hybrid ACO/GA algorithm. The problem is coded in GPROC.

• Both GACO and GGA have one input and one output places:

Constructing the GN model Constructing the GN model

• Usually metaheuristics are combined with local search procedure or an exact method. Our idea is to combine two metaheuristics.

– The GA starts with population which is closer to optimal solution. Sometimes after a number of iterations the GA goes to stagnation, the population stop to be improved.

– Next, the GA solutions are provided as input for the ACO algorithm and the pheromone isupdated accordingly.

– ACO with updated pheromone is run and thus a new population for GA is generated

• Any ACO / GA version can be used, depending on the problem solved.

GN for hybrid ACO/GAGN for hybrid ACO/GA

• ACO is a new metaheuristic method inspired by the social behaviour of ants in nature.

• It finds good solutions for optimization problems with restrictive constraints

• Low level interaction between single agents results in a complex behaviour of the whole ant colony

– Shortest path from food source to formicary

– Communication via pheromone (distributed numerical information), which ants use to probabilistically construct solutions

Ant Colony OptimizationAnt Colony Optimization

•1. GA search procedure - in terms of GNs– The GN model simultaneously evaluates several

fitness functions, ranks the individuals per their FF and chooses the best FF regarding the problem

•2. Selection and tuning of GA operators– The GN model has the possibility to test different

groups of the defined genetic algorithm operators and choose the most appropriate combination among them.

– The developed GN executes a genetic algorithm and implements tuning of the genetic operators, as well as the fitness function, regarding to the considered problem

GN models of GAsGN models of GAs

•Parallel global search technique that emulates natural genetic operators

•GAs are stochastic search methods for exploring complex problem space in order to find optimal solutions using minimal information

•Population of individuals (tentative solutions)

•Fitness function (individual’s suitability to problem)

•Operators: selection, crossover and mutation•Stop criterion (# iterations, finding of individual)

•Convergence towards a global solution•No problem-specific info required in GAs,

hence they’re more flexible and adaptable

Genetic AlgorithmsGenetic Algorithms

•Extension of Petri Nets and their modifications

•Apparatus for descriptionof parallel processes

•Static structure:–Transitions–Places

•Dynamic structure:–Tokens–Predicate index matrices

•Memory•Time

Generalized NetsGeneralized NetsIntroductionIntroduction

Metaheuristics:• increasingly popular in research and industry• mimic natural metaphors to solve complex

optimization problems • efficient and effective to solve large and

complex problems• allow to tackle large-size problems by

delivering satisfactory solutions in a reasonable time

• some of the most successful metaheuristics:–Genetic Algorithms–Ant Colony Optimization

Generalized Nets,Generalized Nets,ACO AlgorithmsACO Algorithms

and Genetic Algorithmsand Genetic Algorithms

Vassia AtanassovaVassia AtanassovaStefka FidanovaStefka Fidanova

Ivan PopchevIvan PopchevPanagiotis ChountasPanagiotis Chountas

8th IMACS Seminar on Monte Carlo MethodsAugust 29–September 2, 2011, Borovets, Bulgaria