the pagerank computation in google, randomized algorithms ... · search engines (pagerank...
TRANSCRIPT
![Page 1: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/1.jpg)
IEIIT-CNR
The PageRank Computation in Google,Randomized Algorithms and Consensus of
Multi-Agent Systems
UAE University ©RT 2009
Roberto Tempo
IEIIT-CNRPolitecnico di Torino
![Page 2: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/2.jpg)
IEIIT-CNR
This talk
The objective of this talk is to discuss three apparentlyunrelated topics
Search engines (PageRank computation in Google)
UAE University ©RT 2009
Randomized algorithms (Las Vegas type) Consensus of multi-agent systems
![Page 3: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/3.jpg)
IEIIT-CNR
This talk
The objective of this talk is to discuss three apparentlyunrelated topics
Search engines (PageRank computation in Google)
UAE University ©RT 2009
Randomized algorithms (Las Vegas type) Consensus of multi-agent systems
The math behind: theory of positive matrices
![Page 4: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/4.jpg)
IEIIT-CNR
This talk
The objective of this talk is to discuss three apparentlyunrelated topics
Search engines (PageRank computation in Google)
UAE University ©RT 2009
Randomized algorithms (Las Vegas type) Consensus of multi-agent systems
Multiple web page updates, web page aggregation,robustness for fragile links, web semantics
![Page 5: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/5.jpg)
IEIIT-CNR
The PageRank Problem in Google
UAE University ©RT 2009
The PageRank Problem in Google
![Page 6: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/6.jpg)
IEIIT-CNR
UAE University
UAE University ©RT 2009
![Page 7: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/7.jpg)
IEIIT-CNR
UAE University
UAE University ©RT 2009
![Page 8: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/8.jpg)
IEIIT-CNR
PageRank for UAE University
“PageRank is Google’s view ofthe importance of this page
UAE University ©RT 2009
the importance of this page(7/10)”
![Page 9: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/9.jpg)
IEIIT-CNR
PageRank for UAE University
“PageRank is Google’s view ofthe importance of this page
UAE University ©RT 2009
the importance of this page(7/10)”
PageRank is a numerical value in the interval [0,1] whichindicates the importance of the page you are visiting
![Page 10: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/10.jpg)
IEIIT-CNR
Random Surfer Model
Web surfer moves along randomly following thehyperlink structure
When arriving at a page with several outgoing links, oneis chosen at random, then the random surfer moves to a
UAE University ©RT 2009
new page, and so on…
![Page 11: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/11.jpg)
IEIIT-CNR
Random Surfer Model
Web representation with incoming and outgoing links
UAE University ©RT 2009
![Page 12: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/12.jpg)
IEIIT-CNR
Random Surfer Model
UAE University ©RT 2009
![Page 13: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/13.jpg)
IEIIT-CNR
Random Surfer Model
Pick an outgoing link at random
UAE University ©RT 2009
![Page 14: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/14.jpg)
IEIIT-CNR
Random Surfer Model
Arriving at a new web page
UAE University ©RT 2009
![Page 15: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/15.jpg)
IEIIT-CNR
Random Surfer Model
Pick another outgoing link at random
UAE University ©RT 2009
![Page 16: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/16.jpg)
IEIIT-CNR
Random Surfer Model
UAE University ©RT 2009
![Page 17: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/17.jpg)
IEIIT-CNR
Random Surfer Model
UAE University ©RT 2009
![Page 18: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/18.jpg)
IEIIT-CNR
Random Surfer Model
UAE University ©RT 2009
![Page 19: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/19.jpg)
IEIIT-CNR
Random Surfer Model
If a page is “important” then it is visited more often... The time the random surfer spends on a page is a
measure of the importance of the page If important pages point to your page, then your page
UAE University ©RT 2009
po p ges po o you p ge, e you p gebecomes important (because it is often visited)
For facilitating the web search we need to rank the pages We assign a numerical value to each page
![Page 20: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/20.jpg)
IEIIT-CNR
Graph Representation
1 2
Directed graph with nodes (pages) and links representing the web
Graph is not necessarily
UAE University ©RT 2009
3 4
5
Graph is not necessarily strongly connected
Graph is constructed using crawlers and spiders which move continuously along the web
![Page 21: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/21.jpg)
IEIIT-CNR
For each node we count the number of outgoing links and normalize them to 1
Hyperlink Matrix
1 2
UAE University ©RT 2009
Hyperlink matrix is a nonnegative (column) substochastic matrix3 4
5
![Page 22: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/22.jpg)
IEIIT-CNR
Hyperlink Matrix
1 20 1 0 0 0
1 / 3 0 0 1 / 2 0
UAE University ©RT 2009
3 4
5
1 / 3 0 0 1 / 2 01 / 3 0 0 1 / 2 01 / 3 0 0 0 0
0 0 1 0 0
A
![Page 23: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/23.jpg)
IEIIT-CNR
PageRank: Bringing Order to the Web[1,2]
Need to rank pages in order of importance The PageRank x* is defined as
x*=Ax* where x* [0,1]n and ∑i xi* = 1 x* is a nonnegative unit eigenvector corresponding to the
UAE University ©RT 2009
x is a nonnegative unit eigenvector corresponding to theeigenvalue 1 for the hyperlink matrix A
The question is when x* exists and it is unique
[1] S. Brin, L. Page (1998)[2] S. Brin, L. Page, R. Motwani, T. Winograd (1999)
![Page 24: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/24.jpg)
IEIIT-CNR
Issue of Dangling Nodes
First issue: We have dangling nodes Random surfer gets “stuck” when visiting a pdf file In this case the “back button” of the browser is used Mathematically the hyperlink matrix is nonnegative and
UAE University ©RT 2009
Mathematically, the hyperlink matrix is nonnegative and(column) substochastic
Easy fix: Add artificial links to make the matrixstochastic
![Page 25: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/25.jpg)
IEIIT-CNR
Page 5 is a Dangling Node
1 20 1 0 0 0
1 / 3 0 0 1 / 2 0
UAE University ©RT 2009
3 4
5
1 / 3 0 0 1 / 2 01 / 3 0 0 1 / 2 01 / 3 0 0 0 0
0 0 1 0 0
A
![Page 26: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/26.jpg)
IEIIT-CNR
Easy Fix
1 2
We add an outgoing link topage 5
0 1 0 0 0
UAE University ©RT 2009
3 4
5
1/ 3 0 0 1/ 2 01/ 3 0 0 1/ 2 11/ 3 0 0 0 0
0 0 1 0 0
A
![Page 27: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/27.jpg)
IEIIT-CNR
But in General the Fix is not so Easy…
Page 5 has two incominglinks
1 2
UAE University ©RT 2009
3 4
5
![Page 28: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/28.jpg)
IEIIT-CNR
But in General the Fix is not so Easy…
We add an outgoing linkfrom 5 to 3…
1 2
0 1 0 0 0
UAE University ©RT 2009
3 4
5
1/ 3 0 0 1/ 3 01/ 3 0 0 1/ 3 11/ 3 0 0 0 0
0 0 1 1/ 3 0
A
![Page 29: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/29.jpg)
IEIIT-CNR
But in General the Fix is not so Easy…
… or we add an outgoinglink from 5 to 4?
1 2
0 1 0 0 0
UAE University ©RT 2009
3 4
5
1/ 3 0 0 1/ 3 01/ 3 0 0 1/ 3 01/ 3 0 0 0 1
0 0 1 1/ 3 0
A
![Page 30: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/30.jpg)
IEIIT-CNR
Modified Hyperlink Matrix
A solution may be tobreak page 5 into twopages 5a and 5b
This artificially changesth b f ( t
1 2
UAE University ©RT 2009
the number of pages (notonly the number of links)and the topology of thenetwork
3 4
5b5a
![Page 31: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/31.jpg)
IEIIT-CNR
Modified Hyperlink Matrix
1 2 0 1 0 0 0 01 / 3 0 0 1 / 3 0 0
UAE University ©RT 2009
3 4
5b5a
1 / 3 0 0 1 / 3 1 01 / 3 0 0 0 0 1
0 0 1 0 0 00 0 0 1 / 3 0 0
A
![Page 32: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/32.jpg)
IEIIT-CNR
Assumption: No Dangling Nodes
We assume that there are no dangling nodes This implies that A is a nonnegative stochastic matrix
(instead of substochastic) having at least one eigenvalueequal to one
UAE University ©RT 2009
Second issue: This eigenvalue is not necessarily unique
![Page 33: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/33.jpg)
IEIIT-CNR
Teleportation Matrix
The random surfer may get bored after a while, anddecides to “jump” to another page not directly connectedto that currently visited
UAE University ©RT 2009
![Page 34: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/34.jpg)
IEIIT-CNR
Recall the Random Surfer Model
Web representation with incoming and outgoing links
UAE University ©RT 2009
![Page 35: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/35.jpg)
IEIIT-CNR
Recall the Random Surfer Model
UAE University ©RT 2009
![Page 36: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/36.jpg)
IEIIT-CNR
Recall the Random Surfer Model
UAE University ©RT 2009
![Page 37: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/37.jpg)
IEIIT-CNR
Recall the Random Surfer Model
UAE University ©RT 2009
![Page 38: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/38.jpg)
IEIIT-CNR
Recall the Random Surfer Model
UAE University ©RT 2009
![Page 39: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/39.jpg)
IEIIT-CNR
Teleportation Model
We are “teleported” to a web page located far away
UAE University ©RT 2009
![Page 40: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/40.jpg)
IEIIT-CNR
Random Surfer Model Again
Pick another outgoing link at random
UAE University ©RT 2009
![Page 41: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/41.jpg)
IEIIT-CNR
Random Surfer Model Again
Pick another outgoing link at random
UAE University ©RT 2009
![Page 42: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/42.jpg)
IEIIT-CNR
Teleportation Model Again
We are teleported to another web page located far away
UAE University ©RT 2009
![Page 43: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/43.jpg)
IEIIT-CNR
Convex Combination of Matrices
Teleported model is represented as a convexcombination of matrices
Instead of A we consider a matrix M defined asM = (1 - m) A + m/n S m (0,1)
UAE University ©RT 2009
( ) / S ( , )where S is a matrix with all entries equal to 1 and n is thenumber of pages
The value m = 0.15 is proposed and used at Google[1]
[1] S. Brin, L. Page (1998)
![Page 44: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/44.jpg)
IEIIT-CNR
Matrix M
M is positive stochastic (convex combination of twostochastic matrices and m (0,1))
UAE University ©RT 2009
![Page 45: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/45.jpg)
IEIIT-CNR
Matrix M and Perron Theorem
The matrix M is primitive (Mk is positive for some k) M is irreducible and the corresponding graph is strongly
connected (every page is connected to every page) The eigenvalue 1 is simple and it is the unique
UAE University ©RT 2009
e e ge v ue s s p e d s e u queeigenvalue of maximum modulus
The corresponding eigenvector is positive
![Page 46: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/46.jpg)
IEIIT-CNR
PageRank Computation
UAE University ©RT 2009
PageRank Computation
![Page 47: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/47.jpg)
IEIIT-CNR
PageRank Computation
PageRank is computed with the power methodx(k+1) =M x(k)
Convergence of this recursion is guaranteed by PerronTheorem becauseM is a primitive matrix
UAE University ©RT 2009
eo e bec use s p vex(k) x* for k
provided that ∑i xi(0) = 1 Remark: PageRank computation can be interpreted as
finding the stationary distribution of a Markov Chain
![Page 48: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/48.jpg)
IEIIT-CNR
PageRank Computation with Power Method
1 4
0 0 0 1/ 31 0 1/ 2 1/ 30 1/ 2 0 1/ 30 1/ 2 1/ 2 0
A
0.15m
UAE University ©RT 2009
2 3
0.038 0.037 0.037 0.3210.887 0.037 0.462 0.3210.037 0.462 0.037 0.3210.037 0.462 0.462 0.037
M
T* 0.12 0.33 0.26 0.29x
![Page 49: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/49.jpg)
IEIIT-CNR
Convergence Properties
Asymptotic rate of convergence of power method isexponential and depends on the ratio
| 2(M) / 1(M) | We have
UAE University ©RT 2009
We have1(M) = 1 2(M) ≤ 1 - m = 0.85
![Page 50: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/50.jpg)
IEIIT-CNR
Size of the Web
The size of M is 8 billion! The PageRank computation requires 50-100 iterations This takes about a week and it is performed centrally at
Google once a month
UAE University ©RT 2009
Goog e o ce o More and more computing power is needed…
![Page 51: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/51.jpg)
IEIIT-CNR
Columbia River, The Dalles, Oregon
UAE University ©RT 2009
![Page 52: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/52.jpg)
IEIIT-CNR
Randomized Decentralized Algorithms
UAE University ©RT 2009
Randomized Decentralized Algorithms
![Page 53: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/53.jpg)
IEIIT-CNR
Randomized Algorithm (RA)
Randomized Algorithm (RA): An algorithm that makesrandom choices during its execution to produce a result
UAE University ©RT 2009
![Page 54: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/54.jpg)
IEIIT-CNR
Randomized Algorithm (RA)
Randomized Algorithm (RA): An algorithm that makesrandom choices during its execution to produce a result
Example of a “random choice” is a coin toss
UAE University ©RT 2009
heads or tails
![Page 55: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/55.jpg)
IEIIT-CNR
Monte Carlo and Las Vegas Randomized Algorithms
Monte Carlo was invented by Metropolis, Ulam, vonNeumann, Fermi, … (Manhattan project)
Las Vegas first appeared in computer science in the lateseventies
UAE University ©RT 2009
Successful applications of randomized algorithms inseveral areas, e.g. robotics, computer science, finance,bioinformatics, communication and networking, systemsand control, …
![Page 56: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/56.jpg)
IEIIT-CNR
Randomized Decentralized Approach[1]
Main idea: Develop a randomized decentralizedapproach for computing PageRank
Key difference with a centralized approach (i.e. powermethod) which involves the entire web
UAE University ©RT 2009
Randomized algorithm is of Las Vegas type
[1] H. Ishii, R. Tempo (2008)
![Page 57: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/57.jpg)
IEIIT-CNR
Basic Communication Protocol
1 4
Basic communication protocol:at time k the randomly selectedpage i initiates the PageRankupdate as follows:
UAE University ©RT 2009
2 3
![Page 58: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/58.jpg)
IEIIT-CNR
Basic Communication Protocol
1 4
Basic communication protocol:at time k the randomly selectedpage i initiates the PageRankupdate as follows:
UAE University ©RT 2009
2 3
![Page 59: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/59.jpg)
IEIIT-CNR
Basic Communication Protocol
1 4
Basic communication protocol:at time k the randomly selectedpage i initiates the PageRankupdate as follows:
UAE University ©RT 2009
2 3
1. by sending the value of pagei to the outgoing pages that arelinked to i
![Page 60: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/60.jpg)
IEIIT-CNR
Basic Communication Protocol
1 4
Basic communication protocol:at time k the randomly selectedpage i initiates the PageRankupdate as follows:
UAE University ©RT 2009
2 3
1. by sending the value of pagei to the outgoing pages that arelinked to i2. by requesting their valuesfrom the incoming pages thatare linked to page i
![Page 61: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/61.jpg)
IEIIT-CNR
Las Vegas Randomized Approach
The pages taking action are determined via a randomprocess θ(k) {1, …, n}
If at time k θ(k) = i then page i initiates PageRank update θ(k) is assumed to be i.i.d. with uniform probability
UAE University ©RT 2009
θ( ) s ssu ed o be . .d. w u o p ob b y
Prob{θ(k)=i} = 1/n
![Page 62: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/62.jpg)
IEIIT-CNR
Distributed Randomized Update Scheme
We consider the randomized update schemex(k+1) = Aθ(k) x(k)
where Aθ(k) are the distributed link matrices (examplenext)
UAE University ©RT 2009
e ) Consider the time average
y(k) =1/(k+1) ∑i x (i)
![Page 63: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/63.jpg)
IEIIT-CNR
Distributed Link Matrices - 1
0 0 0 1/ 31 0 1/ 2 1/ 30 1/ 2 0 1/ 30 1/ 2 1/ 2 0
A
UAE University ©RT 2009
0 1/ 2 1/ 2 0
4
1/ 31/ 31/ 3
0 1/ 2 1/ 2 0
A
![Page 64: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/64.jpg)
IEIIT-CNR
Distributed Link Matrices - 2
0 0 0 1/ 31 0 1/ 2 1/ 30 1/ 2 0 1/ 30 1/ 2 1/ 2 0
A
UAE University ©RT 2009
0 1/ 2 1/ 2 0
4
0 0 1/ 30 0 1/ 30 0 1/ 30 1/ 2 1/ 2 0
A
![Page 65: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/65.jpg)
IEIIT-CNR
Distributed Link Matrices - 3
0 0 0 1/ 31 0 1/ 2 1/ 30 1/ 2 0 1/ 30 1/ 2 1/ 2 0
A
UAE University ©RT 2009
0 1/ 2 1/ 2 0
4
1 0 0 1/ 30 1/ 2 0 1/ 30 0 1/ 2 1/ 30 1/ 2 1/ 2 0
A
![Page 66: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/66.jpg)
IEIIT-CNR
Distributed Link Matrices - 4
0 0 0 1/ 31 0 1/ 2 1/ 30 1/ 2 0 1/ 30 1/ 2 1/ 2 0
A
3
1 0 0 00 1/ 2 1/ 2 00 1/ 2 0 1/ 30 0 1/ 2 2 / 3
A
UAE University ©RT 2009
0 1/ 2 1/ 2 0
4
1 0 0 1/ 30 1/ 2 0 1/ 30 0 1/ 2 1/ 30 1/ 2 1/ 2 0
A
0 0 1/ 2 2 / 3
![Page 67: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/67.jpg)
IEIIT-CNR
Distributed Link Matrices - 5
0 0 0 1/ 31 0 1/ 2 1/ 30 1/ 2 0 1/ 30 1/ 2 1/ 2 0
A
1
0 0 0 1/ 31 1 0 00 0 1 00 0 0 2 / 3
A
UAE University ©RT 2009
0 1/ 2 1/ 2 0 0 0 0 2 / 3
2
0 0 0 01 0 1/ 2 1/ 30 1/ 2 1/ 2 00 1/ 2 0 2 / 3
A
![Page 68: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/68.jpg)
IEIIT-CNR
Average Matrix A
The average matrix A = E[ Aθ(k) ] Since we take uniform distribution in the random processθ(k) we have
A = 1/n ∑i Ai
UAE University ©RT 2009
/ ∑i i
Lemma:(i) A = 2/n A + (1-2/n) I(ii) The matrices A and A have the same eigenvectorcorresponding to the eigenvalue 1
![Page 69: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/69.jpg)
IEIIT-CNR
Modified Distributed Update Scheme
Recall that we need to work with positive stochasticmatrices
We consider the modified distributed update schemex(k+1) = Mθ(k) x(k)
UAE University ©RT 2009
( ) θ(k) ( )where Mθ(k) are the modified distributed link matricescomputed as
Mi = (1- r) Ai + r/n S i = 1, 2, …, nand r (0,1) is a design parameter (defined next)
![Page 70: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/70.jpg)
IEIIT-CNR
Average Matrix M
The average matrix M = E[ Mθ(k) ]
Define r = 2m/(n – mn + 2m)
Lemma:(i) (0 1) d 0 1
UAE University ©RT 2009
(i) r (0,1) and r < m =0.15(ii) M = r/m M + (1-r/m) I(iii) For M the eigenvalue 1 is simple and it is the uniqueeigenvalue of maximum modulus. The PageRank is thecorresponding eigenvector
![Page 71: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/71.jpg)
IEIIT-CNR
Theorem[1]
Theorem: Using the modified distributed update scheme the
PageRank is obtained through the time average yE[ ||y(k) - x*||2 ] 0 for k
UAE University ©RT 2009
[ ||y( ) || ] o
provided that ∑i xi(0) = 1
Proof: Based on the theory of ergodic matrices Remark: The algorithm is a LVRA
[1] H. Ishii, R. Tempo (2008)
![Page 72: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/72.jpg)
IEIIT-CNR
Comments
The average y(k) can be computed recursively in termsof y(k-1)
Sparsity of the matrix Ai can be preserved becausex(k+1) =Mi x(k) = (1- r) Ai x(k) + r/n 1
UAE University ©RT 2009
( ) i ( ) ( ) i ( ) /where 1 is a vector with all entries equal to one
Convergence rate is 1/k Stopping criteria to compute approximately PageRank Different update schemes based only on outgoing links
(not incoming): similar convergence results
![Page 73: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/73.jpg)
IEIIT-CNR
Extensions: Simultaneous Updates
UAE University ©RT 2009
Extensions: Simultaneous Updates
![Page 74: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/74.jpg)
IEIIT-CNR
Recall the Random Surfer Model
Web representation with incoming and outgoing links
UAE University ©RT 2009
![Page 75: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/75.jpg)
IEIIT-CNR
Random Update of One Page
Random update of one page
UAE University ©RT 2009
![Page 76: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/76.jpg)
IEIIT-CNR
Simultaneous Random Updates of Multiple Pages
Simultaneous random update of multiple webpages
UAE University ©RT 2009
![Page 77: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/77.jpg)
IEIIT-CNR
Convergence Results
Simultaneous random updates of multiple pages requiresdefining Bernoulli processes instead of i.i.d. processes
The math is more involved Similar convergence results for multiple updates can be
UAE University ©RT 2009
S co ve ge ce esu s o u p e upd es c beobtained…
[1] H. Ishii, R. Tempo (2008)
![Page 78: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/78.jpg)
IEIIT-CNR
Consensus and PageRank Problems
UAE University ©RT 2009
Consensus and PageRank Problems
![Page 79: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/79.jpg)
IEIIT-CNR
UAV
Unmanned Aerial Vehicle (UAV) for fire detection inSicily
On-board equipment:
UAE University ©RT 2009
various sensors, twocameras (color andinfrared) , GPS, ...
DC motor Remote piloting and
autonomous flight Flight endurance of about 40 min
![Page 80: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/80.jpg)
IEIIT-CNR
UAV1 UAV2
Several UAVs (Agents) Reaching a Target
UAE University ©RT 2009
UAV3
target
UAV4
![Page 81: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/81.jpg)
IEIIT-CNR
UAV1 UAV2
Several UAVs (Agents)Reaching a Target
obstacleswaypoints
UAE University ©RT 2009
UAV3
target
UAV4
![Page 82: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/82.jpg)
IEIIT-CNR
Graph of Agents
We consider a graph of agents which communicate usinga random protocol
The value (e.g. position) of agent i at time k is xi Values of agents are updated using a random scheme
UAE University ©RT 2009
V ues o ge s e upd ed us g do sc e ex(k+1) = Aθ(k) x(k)
Communication pattern (i.e. Aθ(k) ) is similar to that usedfor PageRank (with some technical differences)
![Page 83: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/83.jpg)
IEIIT-CNR
Consensus
We say that consensus (i.e reaching the target) isachieved if for any initial condition x(0) we have
| xi (k) - xj(k) | 0 for k
with probability one for all i, j
UAE University ©RT 2009
w p ob b y o e o , j
![Page 84: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/84.jpg)
IEIIT-CNR
Consensus
Lemma: Assume that the graph is strongly connected.Then, the scheme
x(k+1) = Aθ(k) x(k)achieves consensus
UAE University ©RT 2009
c eves co se sus| xi (k) - xj(k) | 0 for k
with probability one for all i, j and for any initialcondition x(0)
![Page 85: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/85.jpg)
IEIIT-CNR
PageRank and Consensus
Consensus PageRankAll agent values become equal Page values converge to constant
Graph is strongly connected Web is not strongly connected
UAE University ©RT 2009
p g y g y
Convergence w.p.1 for all xi, xj|xi(k) – xj(k)| 0, k
MSE convergence for yE[ ||y(k) - x*||2 ] 0, k
Average is not necessary Average crucial for convergence
Matrices Ai are row stochastic MatricesMi are column stochastic
![Page 86: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/86.jpg)
IEIIT-CNR
Research Directions
Various research directions can be explored:- robustness for fragile, time-varying and broken links- aggregation and clustering of webpages- web semantics
UAE University ©RT 2009
- web semantics
![Page 87: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/87.jpg)
IEIIT-CNR
Fragile, Time-Varying and Broken Links[1]
UAE University ©RT 2009
[1] H. Ishii, R. Tempo (2009)
![Page 88: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/88.jpg)
IEIIT-CNR
Webpage Aggregation and Clustering[1]
original web
UAE University ©RT 2009
original web
aggregated web
[1] H. Ishii, R. Tempo (2009)
![Page 89: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/89.jpg)
IEIIT-CNR
Web Semantics
Why the result of the web search is different if you type“roberto tempo” or “tempo roberto”?
If you type “Boston Hotel” are you looking for an hotelin the city of Boston or are you looking for an hotel with
UAE University ©RT 2009
the name “Boston”?
![Page 90: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/90.jpg)
IEIIT-CNR
References and Software
- “A Distributed Randomized Approach for the PageRankComputation,” H. Ishii and R. Tempo, Technical Report2009
- “Randomized Algorithms for Analysis and Control ofU t i S t ” R T G C l fi d F
UAE University ©RT 2009
Uncertain Systems”, R. Tempo, G. Calafiore and F.Dabbene, Springer-Verlag, 2005
- “RACT: Randomized Algorithms Control Toolbox”
http://staff.polito.it/roberto.tempo/
![Page 91: The PageRank Computation in Google, Randomized Algorithms ... · Search engines (PageRank computation in Google) UAE University ©RT 2009 Randomized algorithms (Las Vegas type) Consensus](https://reader030.vdocuments.net/reader030/viewer/2022041106/5f0946fd7e708231d4260dfe/html5/thumbnails/91.jpg)
IEIIT-CNR
Acknowledgment
Acknowledgment: Research on PageRank is jointwork with Hideaki Ishii
UAE University ©RT 2009