![Page 1: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/1.jpg)
Fisher metric, support stability and optimal number of measurements in
compressive off-the-grid recovery
Nicolas KerivenEcole Normale Supérieure (Paris)
CFM-ENS chair in Data Science
Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyré (ENS)
![Page 2: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/2.jpg)
Discrete compressive sensing
1/14
![Page 3: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/3.jpg)
Discrete compressive sensing
1/14
![Page 4: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/4.jpg)
Discrete compressive sensing
1/14
![Page 5: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/5.jpg)
• Signal: vector
Discrete compressive sensing
1/14
![Page 6: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/6.jpg)
• Signal: vector• Sparsity: few non-zeros coefficients
Discrete compressive sensing
1/14
![Page 7: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/7.jpg)
• Signal: vector• Sparsity: few non-zeros coefficients• Dimensionality reduction (often random matrix)
Discrete compressive sensing
1/14
![Page 8: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/8.jpg)
• Signal: vector• Sparsity: few non-zeros coefficients• Dimensionality reduction (often random matrix)• Recovery: convex relaxation LASSO
Discrete compressive sensing
1/14
![Page 9: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/9.jpg)
Continuous sparsity ?
2/14
![Page 10: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/10.jpg)
Continuous sparsity ?
2/14
![Page 11: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/11.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
2/14
![Page 12: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/12.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
2/14
![Page 13: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/13.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
• Signal: Radon measure
2/14
![Page 14: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/14.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
• Signal: Radon measure• Sparsity:
2/14
![Page 15: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/15.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
• Signal: Radon measure• Sparsity:• Dimensionality reduction (e.g. first Fourier coefficients)
2/14
![Page 16: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/16.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
• Signal: Radon measure• Sparsity:• Dimensionality reduction (e.g. first Fourier coefficients)• Recovery: convex relaxation?
See Keriven 2017, Gribonval 2017
2/14
![Page 17: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/17.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
• Signal: Radon measure• Sparsity:• Dimensionality reduction (e.g. first Fourier coefficients)• Recovery: convex relaxation? BLASSO [De Castro, Gamboa 2012]
See Keriven 2017, Gribonval 2017
2/14
![Page 18: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/18.jpg)
- Fourier coeff- Convolution
Continuous sparsity ?
• Signal: Radon measure• Sparsity:• Dimensionality reduction (e.g. first Fourier coefficients)• Recovery: convex relaxation? BLASSO [De Castro, Gamboa 2012]
Other approaches: « Prony-like » ESPRIT, MUSIC… (but only 1d noiseless Fourier)
See Keriven 2017, Gribonval 2017
2/14
![Page 19: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/19.jpg)
Example of applications
Fluorescence microscopy (3D) PALM, STORM… [Betzig 2006]
3/14
![Page 20: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/20.jpg)
Example of applications
Fluorescence microscopy (3D) PALM, STORM… [Betzig 2006]
Astronomy (2D)[Puschmann 2017]
3/14
![Page 21: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/21.jpg)
Example of applications
Fluorescence microscopy (3D) PALM, STORM… [Betzig 2006]
Compressive mixture model learning(many D)[Keriven 2017]
Astronomy (2D)[Puschmann 2017]
3/14
![Page 22: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/22.jpg)
Example of applications
Fluorescence microscopy (3D) PALM, STORM… [Betzig 2006]
Compressive mixture model learning(many D)[Keriven 2017]
Astronomy (2D)[Puschmann 2017]
• Neuro-imaging with EEG (3D) [Gramfort 2013]
• 1-layer neural network (many D) [Bach 2017]
• Radar• Geophysics• …
3/14
![Page 23: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/23.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
4/14
![Page 24: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/24.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
First Fourier coefficients
4/14
![Page 25: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/25.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
First Fourier coefficients
Inverse Fourier
4/14
![Page 26: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/26.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
First Fourier coefficients
Inverse Fourier
BLASSO
4/14
![Page 27: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/27.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
First Fourier coefficients
• Regular Fourier on the Torus
• Minimal separation
Inverse Fourier
BLASSO
4/14
![Page 28: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/28.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
First Fourier coefficients
• Regular Fourier on the Torus
• Minimal separation
• Reconstruction: formulated as SDP (other: Frank-Wolfe,
greedy, Prony-like…)
Inverse Fourier
BLASSO
4/14
![Page 29: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/29.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
First Fourier coefficients
• Regular Fourier on the Torus
• Minimal separation
• Reconstruction: formulated as SDP (other: Frank-Wolfe,
greedy, Prony-like…)
• Noise: weak convergence (mass of concentrated
around true Diracs)
Inverse Fourier
BLASSO
4/14
![Page 30: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/30.jpg)
A seminal result [Candès, Fernandez-Granda 2012]
First Fourier coefficients
• Regular Fourier on the Torus
• Minimal separation
• Reconstruction: formulated as SDP (other: Frank-Wolfe,
greedy, Prony-like…)
• Noise: weak convergence (mass of concentrated
around true Diracs)
Inverse Fourier
BLASSO
4/14
Many extensions since…
![Page 31: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/31.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient
![Page 32: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/32.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
![Page 33: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/33.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
• [Bendory et al. 2016]: extension to other measurement operators
![Page 34: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/34.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
• [Bendory et al. 2016]: extension to other measurement operators• Minimal separation does not take into account geometry of the meas. operator
![Page 35: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/35.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
• [Bendory et al. 2016]: extension to other measurement operators• Minimal separation does not take into account geometry of the meas. operator
• [Duval, Peyré 2015]: In some cases, support stability in the small noise regime
![Page 36: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/36.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
• [Bendory et al. 2016]: extension to other measurement operators• Minimal separation does not take into account geometry of the meas. operator
• [Duval, Peyré 2015]: In some cases, support stability in the small noise regime• Noise level under which support stability is achieved?
![Page 37: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/37.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
• [Bendory et al. 2016]: extension to other measurement operators• Minimal separation does not take into account geometry of the meas. operator
• [Duval, Peyré 2015]: In some cases, support stability in the small noise regime• Noise level under which support stability is achieved?
Contributions:
• Generalize to many multi-d measurement operators, express the minimal separation as a geometry-aware Fisher metric
![Page 38: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/38.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
• [Bendory et al. 2016]: extension to other measurement operators• Minimal separation does not take into account geometry of the meas. operator
• [Duval, Peyré 2015]: In some cases, support stability in the small noise regime• Noise level under which support stability is achieved?
Contributions:
• Generalize to many multi-d measurement operators, express the minimal separation as a geometry-aware Fisher metric
• 1: Remove the random sign assumption (weak convergence)
![Page 39: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/39.jpg)
Previous work, contribution
5/14
Relevant previous works:
• [Tang, Recht 2013]: random Fourier coefficients are sufficient• Random signs assumption• 1D discrete Fourier
• [Bendory et al. 2016]: extension to other measurement operators• Minimal separation does not take into account geometry of the meas. operator
• [Duval, Peyré 2015]: In some cases, support stability in the small noise regime• Noise level under which support stability is achieved?
Contributions:
• Generalize to many multi-d measurement operators, express the minimal separation as a geometry-aware Fisher metric
• 1: Remove the random sign assumption (weak convergence)
• 2: Prove support stability when (with random signs)
![Page 40: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/40.jpg)
Outline
Background on dual certificates
Minimal separation and Fisher metric
Conclusion, outlooks
Main results, applications
![Page 41: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/41.jpg)
Dual certificates
6/14
Random linear operator:
![Page 42: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/42.jpg)
Dual certificates
6/14
Noisy measurement:Random linear operator:
![Page 43: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/43.jpg)
Dual certificates
6/14
The BLASSO problem:
Noisy measurement:Random linear operator:
![Page 44: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/44.jpg)
Dual certificates
First-order conditions
solution ofBLASSO
6/14
The BLASSO problem:
Noisy measurement:Random linear operator:
![Page 45: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/45.jpg)
solution of
Dual certificates
First-order conditions
Dual certificate (noiseless case)
solution ofBLASSO
6/14
The BLASSO problem:
Noisy measurement:Random linear operator:
![Page 46: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/46.jpg)
What is a dual certificate ?
What does it look like ?
7/14
![Page 47: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/47.jpg)
What is a dual certificate ?
What does it look like ?
7/14
![Page 48: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/48.jpg)
Case :
What is a dual certificate ?
What does it look like ?
7/14
![Page 49: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/49.jpg)
Case :
What is a dual certificate ?
What does it look like ?
7/14
![Page 50: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/50.jpg)
Case :
What is a dual certificate ?
What does it look like ?
7/14
Ensures uniqueness and robustness…
Non-degenerate dual certif.
![Page 51: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/51.jpg)
Case :
What is a dual certificate ?
What does it look like ?
7/14
Ensures uniqueness and robustness…
Non-degenerate dual certif.
Intuitively:
Larger -> easierinterpolation
![Page 52: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/52.jpg)
Proof strategy
8/14
Step 1: Study the limit case to derive an appropriate notion of minimal separation
![Page 53: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/53.jpg)
Proof strategy
8/14
Step 1: Study the limit case to derive an appropriate notion of minimal separation
Step 2: bound the deviation for finite number of measurements
![Page 54: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/54.jpg)
Proof strategy
8/14
Step 1: Study the limit case to derive an appropriate notion of minimal separation
Step 2: bound the deviation for finite number of measurements
![Page 55: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/55.jpg)
Proof strategy
m=10
8/14
Step 1: Study the limit case to derive an appropriate notion of minimal separation
Step 2: bound the deviation for finite number of measurements
![Page 56: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/56.jpg)
Proof strategy
m=10 m=50
8/14
Step 1: Study the limit case to derive an appropriate notion of minimal separation
Step 2: bound the deviation for finite number of measurements
![Page 57: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/57.jpg)
Proof strategy
m=500m=10 m=50
8/14
Step 1: Study the limit case to derive an appropriate notion of minimal separation
Step 2: bound the deviation for finite number of measurements
![Page 58: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/58.jpg)
Proof strategy
m=500m=10 m=50
8/14
Step 1: Study the limit case to derive an appropriate notion of minimal separation
Step 2: bound the deviation for finite number of measurements
Step 3: recovery• Adaptation of [Azaïs 2015] for weak convergence• Quantitative Implicit Function Theorem [Denoyelle 2015] for support stability
![Page 59: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/59.jpg)
Outline
Background on dual certificates
Minimal separation and Fisher metric
Conclusion, outlooks
Main results, applications
![Page 60: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/60.jpg)
Limit covariance kernels
9/14
How to construct a certificate ?Study limit covariance kernel when :
![Page 61: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/61.jpg)
Limit covariance kernels
9/14
How to construct a certificate ?Study limit covariance kernel when :
Sub-sampled version:
![Page 62: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/62.jpg)
Limit covariance kernels
9/14
How to construct a certificate ?Study limit covariance kernel when :
Strategy under minimal separation
Sub-sampled version:
![Page 63: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/63.jpg)
Limit covariance kernels
9/14
How to construct a certificate ?Study limit covariance kernel when :
Strategy under minimal separation
Sub-sampled version:
![Page 64: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/64.jpg)
Limit covariance kernels
Min. Separation
9/14
How to construct a certificate ?Study limit covariance kernel when :
Strategy under minimal separation
Sub-sampled version:
![Page 65: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/65.jpg)
Limit covariance kernels
Min. Separation
1: kernel at each saturation point
9/14
How to construct a certificate ?Study limit covariance kernel when :
Strategy under minimal separation
Sub-sampled version:
![Page 66: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/66.jpg)
Limit covariance kernels
Min. Separation
2: Small adjustements(minimal separation)
1: kernel at each saturation point
9/14
How to construct a certificate ?Study limit covariance kernel when :
Strategy under minimal separation
Sub-sampled version:
![Page 67: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/67.jpg)
Minimal separation and Fisher metric
10/14
Which metric for separation ?
![Page 68: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/68.jpg)
Minimal separation and Fisher metric
10/14
Which metric for separation ?
Classical case: translation-invariant kernel
![Page 69: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/69.jpg)
Minimal separation and Fisher metric
10/14
Which metric for separation ?
Classical case: translation-invariant kernel
natural
![Page 70: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/70.jpg)
Minimal separation and Fisher metric
10/14
Which metric for separation ?
Classical case: translation-invariant kernel Non translation-inv. ?
Kernel for microscopynatural
![Page 71: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/71.jpg)
Minimal separation and Fisher metric
10/14
Which metric for separation ?
Classical case: translation-invariant kernel Non translation-inv. ?
Kernel for microscopy
Riemannian metric associated to a kernel [Amari 99]:
: metric tensor : geodesic distance
natural
![Page 72: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/72.jpg)
Minimal separation and Fisher metric
10/14
Which metric for separation ?
Classical case: translation-invariant kernel Non translation-inv. ?
Kernel for microscopy
Riemannian metric associated to a kernel [Amari 99]:
: metric tensor : geodesic distance
Thm: under some hypothesis, for , there exists non-degenerate
natural
![Page 73: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/73.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Kernel
11/14
![Page 74: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/74.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Kernel
11/14
![Page 75: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/75.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Kernel
11/14
![Page 76: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/76.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Kernel
11/14
![Page 77: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/77.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Continuous Gaussian Fourier:Gaussian kernel
Kernel
11/14
![Page 78: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/78.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Continuous Gaussian Fourier:Gaussian kernel
Kernel
11/14
![Page 79: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/79.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Continuous Gaussian Fourier:Gaussian kernel
Kernel
11/14
![Page 80: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/80.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Continuous Gaussian Fourier:Gaussian kernel
Microscopy (Laplace transform):
Kernel
11/14
![Page 81: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/81.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Continuous Gaussian Fourier:Gaussian kernel
Microscopy (Laplace transform):
Kernel
11/14
![Page 82: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/82.jpg)
Examples
16/04/2018
Features
Fisher metric and minimal separation
Discrete Fourier on Torus:Féjer kernel
Continuous Gaussian Fourier:Gaussian kernel
Microscopy (Laplace transform):
Kernel
11/14
![Page 83: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/83.jpg)
Outline
Background on dual certificates
Minimal separation and Fisher metric
Conclusion, outlooks
Main results, applications
![Page 84: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/84.jpg)
Main results
Thm: Eliminating the random signs
12/14
![Page 85: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/85.jpg)
Main results
Thm: Eliminating the random signs
Depend on kernel
12/14
![Page 86: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/86.jpg)
Main results
Thm: Eliminating the random signs
• The recovered measure concentrate around true Diracs
Depend on kernel
12/14
![Page 87: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/87.jpg)
Main results
Thm: Eliminating the random signs
• The recovered measure concentrate around true Diracs
• Proof: golfing scheme [Gross 2009, Candès Plan 2011]
Depend on kernel
12/14
![Page 88: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/88.jpg)
Main results
Thm: Eliminating the random signs
• The recovered measure concentrate around true Diracs
• Proof: golfing scheme [Gross 2009, Candès Plan 2011]
Thm: Support stability
Depend on kernel
12/14
![Page 89: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/89.jpg)
Main results
Thm: Eliminating the random signs
• The recovered measure concentrate around true Diracs
• Proof: golfing scheme [Gross 2009, Candès Plan 2011]
Thm: Support stability
Depend on kernel
With random signs Without random signs
12/14
![Page 90: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/90.jpg)
Main results
Thm: Eliminating the random signs
• The recovered measure concentrate around true Diracs
• Proof: golfing scheme [Gross 2009, Candès Plan 2011]
Thm: Support stability
Depend on kernel
With random signs Without random signs
12/14
• Quantified small noise : if , then:
![Page 91: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/91.jpg)
Main results
Thm: Eliminating the random signs
• The recovered measure concentrate around true Diracs
• Proof: golfing scheme [Gross 2009, Candès Plan 2011]
Thm: Support stability
Depend on kernel
With random signs Without random signs
12/14
• Quantified small noise : if , then:
• The recovered measure is formed of exactly Diracs
![Page 92: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/92.jpg)
Applications
16/04/2018
• Féjer kernel (discrete Fourier):
13/14
![Page 93: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/93.jpg)
Applications
16/04/2018
• Féjer kernel (discrete Fourier):
• Microscopy with Laplace transform:
13/14
![Page 94: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/94.jpg)
Applications
16/04/2018
• Féjer kernel (discrete Fourier):
• Microscopy with Laplace transform:
• Application: Gaussian Mixture Model learning
13/14
![Page 95: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/95.jpg)
Applications
16/04/2018
• Féjer kernel (discrete Fourier):
• Microscopy with Laplace transform:
• Application: Gaussian Mixture Model learning
• Given
13/14
![Page 96: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/96.jpg)
Applications
16/04/2018
• Féjer kernel (discrete Fourier):
• Microscopy with Laplace transform:
• Application: Gaussian Mixture Model learning
• Given
• Compute with Gaussian
13/14
(streaming, distributed)
![Page 97: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/97.jpg)
Applications
16/04/2018
• Féjer kernel (discrete Fourier):
• Microscopy with Laplace transform:
• Application: Gaussian Mixture Model learning
• Given
• Compute with Gaussian
• Solve the BLASSO with as characteristic function of a Gaussian
13/14
(streaming, distributed)
![Page 98: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/98.jpg)
Applications
16/04/2018
• Féjer kernel (discrete Fourier):
• Microscopy with Laplace transform:
• Application: Gaussian Mixture Model learning
• Given
• Compute with Gaussian
• Solve the BLASSO with as characteristic function of a Gaussian
Then: if
The BLASSO yields exactly s Diracs: non-asymptotic model selection !
13/14
(streaming, distributed)
![Page 99: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/99.jpg)
Outline
Background on dual certificates
Minimal separation and Fisher metric
Conclusion, outlooks
Main results, applications
![Page 100: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/100.jpg)
Summary, outlooks
• Summary: generalization of existing results on super-resolutionwith random measurements (and minimal separation)
• Introduction of the kernel Fisher metric to measure minimal separation• Application in particular to a non-translation-invariant example for microscopy
• No need of random signs for weak convergence (golfing scheme)• Quantitative support stability
14/14
![Page 101: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/101.jpg)
Summary, outlooks
• Summary: generalization of existing results on super-resolutionwith random measurements (and minimal separation)
• Introduction of the kernel Fisher metric to measure minimal separation• Application in particular to a non-translation-invariant example for microscopy
• No need of random signs for weak convergence (golfing scheme)• Quantitative support stability
14/14
• Outlooks• Implication of support stability for algorithms ? (active field)• Better characterization of the « universality » of the geodesic distance• More quantified treatment of dimension• Other practical applications (eg 1-layer neural networks with continuum of
neurons [Bach 2017])
![Page 102: Fisher metric, support stability and optimal number of ... · Joint work with Clarice Poon (Cambridge Uni.), Gabriel Peyr é (ENS) Discrete compressive sensing 1/14. Discrete compressive](https://reader034.vdocuments.net/reader034/viewer/2022052008/601d095a4ba59c3bd1725bbd/html5/thumbnails/102.jpg)
Poon, Keriven, Peyré. A Dual Certificates Analysis of Compressive Off-the-Grid Recovery. Preprint arxiv:1802.08464
Poon, Keriven, Peyré. Support Localization and the Fisher Metric for off-the-grid Sparse Regularization. Preprint arxiv:1810.03340
Thank you !
14/14
data-ens.github.ioEnter the data challenges!Come to the colloquium!Come to the Laplace seminars!