![Page 1: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/1.jpg)
Random Matrix Theory in a nutshelland applications
Manuela Girotti
IFT 6085, February 27th, 2020
1 / 14
![Page 2: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/2.jpg)
Random Matrix Theory
Consider a matrix A:
A =
a11 a12 a13 . . . . . . a1N
a21 a22 a23 . . . a2N
a31 . . ..........
aM1 aN2 . . . aMN
2 / 14
![Page 3: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/3.jpg)
where the entries are random numbers:
A =
∗ ∗ ∗ . . . . . . ∗∗ ∗ ∗ . . . ∗∗ . . ..........∗ ∗ . . . ∗
where ∗ =
(Gaussian distribution, e.g.)
3 / 14
![Page 4: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/4.jpg)
A few questions:
What about the eigenvalues?
x_1 x_nx_2 x_3 ...
Their (probable) positions will depend upon the probabilitydistribution of the entries of the matrix in a non-trivial way. There aredifferent statistical quantities that one may study (-discrete- spectraldensity, gap probability, spacing, etc.)
4 / 14
![Page 5: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/5.jpg)
What if we consider BIG matrices, possibly of ∞ dimension(appropriately rescaled)?
Figure: Realization of the eigenvalues of a GUE matrix of dimensionn = 20, 50, 100.
5 / 14
![Page 6: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/6.jpg)
Figure: Histograms of the eigenvalues of GUE matrices as the size of the matrixincreases.
6 / 14
![Page 7: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/7.jpg)
Figure: Histograms of the eigenvalues of GUE matrices as the size of the matrixincreases.
7 / 14
![Page 8: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/8.jpg)
Figure: Histogram of the eigenvalues of Wishart matrices as the size of the matrixincreases (here c = p/n).
8 / 14
![Page 9: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/9.jpg)
Applications
Nuclear Physics (distribution of the energy levels of highly excitedstates of heavy nuclei, say uranium 92U)
9 / 14
![Page 10: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/10.jpg)
Applications
Wireless communications
10 / 14
![Page 11: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/11.jpg)
Applications
Finance (stock markets, investment strategies)
11 / 14
![Page 12: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/12.jpg)
Applications
Very helpful in ML!
Figure: The histogram of the eigenvalues of the gradient covariance matrix1n
∑∇Li∇LT
i for a Resnet-32 with (left) and without (right) BN after 9k
training steps. (from Ghorbani et al., 2019)
12 / 14
![Page 13: Random Matrix Theory in a nutshell and applications · Random Matrix Theory in a nutshell and applications Manuela Girotti IFT 6085, February 27th, 2020 1 / 14. Random Matrix Theory](https://reader034.vdocuments.net/reader034/viewer/2022042403/5f15625d98905813b035e97b/html5/thumbnails/13.jpg)
Thanks for your attention!
“Unfortunately, no one can be told what the Matrix is.You have to see it for yourself.”
(Morpheus, “The Matrix” movie)
13 / 14