ant colony optimization presentation
DESCRIPTION
TRANSCRIPT
Ant Colony Optimization
18-02-2014 1Ant Colony Optimization
Ant Colony Optimization
Ant colony optimization is a technique for optimization that was introduced in the early 1990’s.
The inspiring source of ant colony optimization is the foraging behaviour of real ant colonies.
18-02-2014 2Ant Colony Optimization
Swarm IntelligenceCollective system capable of accomplishing
difficult tasks in dynamic and varied environments without any external guidance or control and with no central coordination
Achieving a collective performance which could not normally be achieved by an individual acting alone
Constituting a natural model particularly suited to different kind of problem solving
18-02-2014 3Ant Colony Optimization
Swarm Algorithms
Inspiration from swarm intelligence has led to some highly successful optimization algorithms. One of those algorithms is …..
Ant Colony algorithm – a way to solve optimization problems based on the behaviour of ants searching for food.
18-02-2014 4Ant Colony Optimization
A key concept: Stigmergy
Stigmergy is: indirect coordination between agents or
actions.The principle is that the trace left in
the environment by an action stimulates the performance of a next action, by the same or a different agent.
Individuals leave markers or messages – these don’t solve the problem in themselves, but they affect other individuals in a way that helps them solve the problem18-02-2014 5Ant Colony Optimization
Stigmergy in Ants
Ants are behaviourally unsophisticated, but collectively they can perform complex tasks.
Ants have highly developed sophisticated sign-based stigmergy
They communicate using pheromones
They lay trails of pheromone that can be followed by other ants.
18-02-2014 6Ant Colony Optimization
Pheromone TrailsOne ant tends to follow strong concentrationsof pheromone caused by repeated passes of ants; apheromone trail is then formed from nest to food source,so in intersections between several trails an ant moveswith high probability following the highest pheromone level.
18-02-2014 7Ant Colony Optimization
Pheromone Trails continuedIndividual ants lay pheromone trails while
travelling from the nest, to the nest or possibly in both directions.
The pheromone trail gradually evaporates over time.…But pheromone trail strength accumulate with multiple ants using path.
18-02-2014 8Ant Colony Optimization
Pheromone Trails: Example
18-02-2014 9Ant Colony Optimization
Ant Colony Optimization Algorithms: Basic Ideas
Ants are agents that:
Move along between nodes in a graph.
They choose where to go based on pheromone strength (and maybe other things)
An ant’s path represents a specific candidate solution.
When an ant has finished a solution, pheromone is laid on its path,
according to quality of solution.
This pheromone trail affects behaviour of other ants by `stigmergy’ …
18-02-2014 10Ant Colony Optimization
Travelling Salesman Problem (TSP)
Given a list of cities and the distances between each pair of cities, what is the shortest possible route that visits each city exactly once and returns to the origin city?
18-02-2014 11Ant Colony Optimization
12
ACO for the Traveling Salesman Problem
18-02-2014 Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD: 30, BC: 40, CD: 20
Initially, random levels of pheromone are scattered on the edges
18-02-2014 13Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD: 30, BC: 40, CD: 20
An ant is placed at a random node
18-02-2014 14Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD: 30, BC: 40, CD: 20
The ant decides where to go from that node,based on probabilitiescalculated from: - pheromone strengths, - next-hop distances.
Suppose this one chooses BC
18-02-2014 15Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD, 30, BC: 40, CD: 20
The ant is now at C, and has a ‘tour memory’ = {B, C} – so he cannot visit B or C again. Again, he decides next hop(from those allowed) basedon pheromone strengthand distance;suppose he choosesCD
18-02-2014 16Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD, 30, BC: 40, CD: 20
The ant is now at D, and has a `tour memory’ = {B, C, D}There is only one place he can go now:
18-02-2014 17Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD, 30, BC: 40, CD: 20
So, he has nearly finished his tour, having gone over the links:BC, CD, and DA.
18-02-2014 18Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD, 30, BC: 40, CD: 20
So, he has nearly finished his tour, having gone over the links:BC, CD, and DA. AB is added to complete the round trip.
Now, pheromone on the touris increased, in line with the fitness of that tour.
18-02-2014 19Ant Colony Optimization
E.g. A 4-city TSP
A B
C DPheromone
AntAB: 10, AC: 10, AD, 30, BC: 40, CD: 20
Next, pheromone everywhereis decreased a little, to modeldecay of trail strength overtime
18-02-2014 20Ant Colony Optimization
E.g. A 4-city TSP
B
C DPheromone
AntAB: 10, AC: 10, AD, 30, BC: 40, CD: 20
We start again, with another ant in a random position.
Where will he go?
Next , the actual algorithm and variants.
A
18-02-2014 21Ant Colony Optimization
The ACO algorithm for the TSP[a simplified version with all essential details]
We have a TSP, with n cities. 1. We place some ants at each city. Each ant then
does this: It makes a complete tour of the cities, coming back to its
starting city, using a transition rule to decide which links to follow. By this rule, it chooses each next-city at random, but biased partly by the pheromone levels existing at each path, and biased partly by heuristic information.
2. When all ants have completed their tours. Global Pheromone Updating occurs.
The current pheromone levels on all links are reduced (I.e. pheromone levels decay over time).
Pheromone is laid (belatedly) by each ant as follows: it places pheromone on all links of its tour, with strength depending on how good the tour was.
Then we go back to 1 and repeat the whole process many times, until we reach a termination criterion.18-02-2014 22Ant Colony Optimization
The transition ruleT(r,s) is the amount of pheromone currently on the path that goes directly from city r to city s.H(r,s) is the heuristic value of this link – in the classic TSP application, this is chosen to be 1/distance(r,s) -- I.e. the shorter the distance, the higher the heuristic value.
is the probability that ant k will choose the link that goes from r to s is a parameter that we can call the heuristic strength
),( srpk
The rule is:
Where our ant is at city r, and s is a city as yet unvisited on itstour, and the summation is over all of k’s unvisited cities
c
k crHcrT
srHsrTsrp
cities unvisited
),(),(
),(),(),(
18-02-2014 24Ant Colony Optimization
Global pheromone updateAk(r,s) is amount of pheromone added to the (r, s) link by ant k.
m is the number of ants
is a parameter called the pheromone decay rate.
Lk is the length of the tour completed by ant k
T(r, s) at the next iteration becomes:
Where
m
k
k srAsrT
1
),(),(
kk LsrA /1),(
18-02-2014 25Ant Colony Optimization
Not just for TSP of course
ACO is naturally applicable to any sequencing problem, or indeed any problem
All you need is some way to represent solutions to the problem as paths in a network.
18-02-2014 26Ant Colony Optimization
Other Application of ACO
Quadratic Assignment Problem Network Model Problem Vehicle routing Feature Selection Scheduling Problem Vehicle Routing Problem
18-02-2014 27Ant Colony Optimization
Some inherent advantagesPositive Feedback accounts for rapid
discovery of good solutionsDistributed computation avoids premature
convergenceThe greedy heuristic helps find acceptable
solution in the early solution in the early stages of the search process.
The collective interaction of a population of agents.
18-02-2014 28Ant Colony Optimization
DisadvantagesSlower convergence than other HeuristicsPerformed poorly for TSP problems larger
than 75 cities.No centralized processor to guide the system
towards good solutions
18-02-2014 29Ant Colony Optimization
ConclusionACO is a thriving and maturing research area –
it has its own conferences. It gets very good results on some difficult problems.
ACO research and practice tends to concentrate on: hybridisation with other methods; e.g. it is common to improve an individual ant’s solution by local search, and then lay pheromone. New and adaptive ways to control the relative influence of heuristics, pheromone strength and pheromone decay.
18-02-2014 30Ant Colony Optimization
Referenceshttps://www.ics.uci.edu/~welling/teaching/271fall09/
antcolonyopt.pdf rain.ifmo.ru/~chivdan/presentationswww.macs.hw.ac.uk/~dwcorne/Teaching Dorigo M, Optimization, learning and natural algorithms.
PhD thesis, Dipartimento di Elettronica, Politecnico di Milano, Italy, 1992 [in Italian]
Wikipediahttps://www.ics.uci.edu/~welling/teaching/271fall09code.ulb.ac.be/dbfiles/Ant Colony Optimization for Feature Selection in Software
Product Lines by WANG Ying-lin1,2, PANG Jin-wei2mitpress.mit.edu/books/ant-colony-optimization
18-02-2014 31Ant Colony Optimization
18-02-2014 32Ant Colony Optimization