phase retrieval - dsrg.stuorg.iastate.edu"efficient compressive phase retrieval with...
TRANSCRIPT
![Page 1: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/1.jpg)
Phase Retrieval
Gauri Jagatap
Electrical and Computer Engineering
Iowa State University
![Page 2: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/2.jpg)
Motivation
• Signal • Magnitude
• Phase
• Fourier measurements
![Page 3: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/3.jpg)
Magnitude |𝐹(𝑋)|
Phase ∠𝐹(𝑋)
That actress from every 90s rom-com Voldemort
![Page 4: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/4.jpg)
Magnitude-only reconstruction Phase-only reconstruction
![Page 5: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/5.jpg)
![Page 6: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/6.jpg)
• Typically phase has more information about the signal than magnitude.
• What if you lose phase information?
Use phase retrieval
• NP-hard
![Page 7: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/7.jpg)
Phase retrieval using Alternating Minimization
• Work by Praneeth Netrapalli, Prateek Jain and Sujay Sanghavi.
• Use random matrices for sensing signals.
• Requires 𝒪(𝑛 𝑙𝑜𝑔3𝑛) measurements for successful recovery.
• Two main features • Initialization
• Convergence
![Page 8: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/8.jpg)
Measurement model • Signal 𝒙∗∈ ℝ𝑛
• Measurement vectors 𝑎𝑖 ∈ ℝ
𝑛 ,𝒩 0,1
• Measurements 𝑦𝑖, 𝑖 ∈ {1 …𝑚}
• Introduce diagonal phase matrix 𝐂∗ = 𝑑𝑖𝑎𝑔 𝐀T𝑥∗ which is the true phase of the measurements.
![Page 9: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/9.jpg)
Signal recovery
• Non-convex optimization problem
• Not convex because entries of 𝐂 are restricted to be diagonal with ‘phases’ of form 𝑒𝑖𝜃 and hence magnitude 1.
Alternatively update 𝐂 and 𝒙
![Page 10: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/10.jpg)
![Page 11: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/11.jpg)
How to initialize?
• Random?
• Zeros?
oGets stuck in local optimum
![Page 12: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/12.jpg)
• Take advantage of randomness of measurement vectors 𝑎𝑖
Ε1
𝑚 𝑦𝑖
2𝑎𝑖𝑎𝑖𝑇
𝑚
𝑖=1
= 𝕀 + 2𝑥∗𝑥∗𝑇
Top singular vector of bracketed term is a good initial estimate of 𝑥
![Page 13: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/13.jpg)
![Page 14: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/14.jpg)
n = 500, m = 500
![Page 15: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/15.jpg)
n = 500, m = 500
![Page 16: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/16.jpg)
n = 500, m = 1000
![Page 17: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/17.jpg)
n = 500, m = 1000
![Page 18: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/18.jpg)
n = 500, m = 2000
![Page 19: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/19.jpg)
n = 500, m = 2000
![Page 20: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/20.jpg)
n = 500, m = 2500
![Page 21: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/21.jpg)
n = 500, m = 2500
![Page 22: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/22.jpg)
Phase transition
![Page 23: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/23.jpg)
PhaseLift (Overview)
Trace-norm relaxation
𝒜:
𝒜−1:
𝑿 = 𝒙𝒙∗ ( 𝑿 = rank 1, 𝒙 = original signal) Measurement:
Measurement operation:
Adjoint operation:
• Signal recovery from phase-less measurements: (requires 𝑚 = 𝒪(𝑛 log𝑛))
• Signal and measurement model:
Lifting up the problem of vector recovery from quadratic constraints into that of recovering a rank-one matrix from affine constraints via semidefinite programming.
![Page 24: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/24.jpg)
Scalability Issues
• Dependence of 𝑚 on 𝑛 when 𝑛 is large ~104
𝑛 log 𝑛~105 , 𝑛 (log 𝑛)3~107
• Use signal’s structure to reduce the number of measurements
Compressive phase retrieval 𝑚 = 𝒪( 𝑘 log
𝑛
𝑘 ) where 𝑘 is the sparsity of signal
If 𝑛~104, 𝑘~102 then 𝑘 log𝑛
𝑘 ~102
![Page 25: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/25.jpg)
Efficient Compressive Phase Retrieval with Constrained Sensing Vectors
• Work by Sohail Bahmani, Justin Romberg
• Combines two key points of discussion so far • Lifting
• Sparsity
![Page 26: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/26.jpg)
Measurement model
![Page 27: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/27.jpg)
![Page 28: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/28.jpg)
n = 500, m = 100
![Page 29: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/29.jpg)
Comparison
Method Sample complexity (m)*
AltMinPhase 𝑛 log3 𝑛
PhaseLift 𝑛 log 𝑛
Efficient CPR 𝑘 log𝑛
𝑘
*for n-length k-sparse signal
![Page 30: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint](https://reader033.vdocuments.net/reader033/viewer/2022051921/600ecda9cf5e5f78be4841da/html5/thumbnails/30.jpg)
References
• Netrapalli, Praneeth, Prateek Jain, and Sujay Sanghavi. "Phase retrieval
using alternating minimization." Advances in Neural Information Processing Systems. 2013.
• Candes, Emmanuel J., Thomas Strohmer, and Vladislav Voroninski. "Phaselift: Exact and stable signal recovery from magnitude measurements via convex programming." Communications on Pure and Applied Mathematics 66.8 (2013): 1241-1274.
• Bahmani, Sohail, and Justin Romberg. "Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015.