locally correctable codes from lifting alan guo mit csail joint work with swastik kopparty (rutgers)...
TRANSCRIPT
![Page 1: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/1.jpg)
Locally correctable codesfrom lifting
Alan GuoMIT CSAIL
Joint work withSwastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)
![Page 2: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/2.jpg)
Talk outline
• Error correcting codes• Locally correctable codes• Our contributions– New high rate LCCs– General framework of “lifting” codes– New lower bounds for Nikodym sets
![Page 3: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/3.jpg)
Talk outline
• Error correcting codes• Locally correctable codes• Our contributions– New high rate LCCs– General framework of “lifting” codes– New lower bounds for Nikodym sets
![Page 4: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/4.jpg)
Error correcting codes
• Encoding , Code • Rate = • Distance = minimum pairwise Hamming
distance between codewords• Example: Reed-Solomon code– Message: polynomial of degree – Encoding: evaluations at distinct points
![Page 5: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/5.jpg)
Talk outline
• Error correcting codes• Locally correctable codes• Our contributions– New high rate LCCs– General framework for “lifting” codes– New lower bounds for Nikodym sets
![Page 6: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/6.jpg)
Locality
• Would like to do certain tasks while making sublinear number of queries to symbols of received word
• Testing: decide if or if is far from • Decoding: recover a particular symbol of
message corresponding to nearest codeword• Correcting: recover a particular symbol of the
nearest codeword
![Page 7: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/7.jpg)
Bivariate polynomial codes
• Message: bivariate polynomial of degree
• Encoding: Evaluations on every point on plane
• Schwartz-Zippel Lemma
• ; worse than RS! Why bother?• Advantage: locality - queries to correct a
symbol
![Page 8: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/8.jpg)
Local correctability
![Page 9: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/9.jpg)
A brief history of LCCs
• Want high rate with sublinear query complexity for constant fraction errors
• Bivariate polynomial codes– queries, but rate – More generally, -variate polynomial codes get us
queries, but rate • Multiplicity codes (Kopparty, Saraf, Yekhanin 2010)– Encode polynomial evaluations as well as derivatives– Can achieve queries with rate close to 1
![Page 10: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/10.jpg)
Talk outline
• Error correcting codes• Locally correctable codes• Our contributions– New high rate LCCs– General framework for “lifting” codes– New lower bounds for Nikodym sets
![Page 11: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/11.jpg)
Our contributions
• New codes with queries and rate close to 1• General study of “lifted codes”• New lower bounds for Nikodym sets
![Page 12: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/12.jpg)
Talk outline
• Error correcting codes• Locally correctable codes• Our contributions– New high rate LCCs– General framework for “lifting” codes– New lower bounds for Nikodym sets
![Page 13: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/13.jpg)
Main idea
• New code (lifted RS code)– Codewords = {bivariate polynomials whose
restrictions to lines are polynomials of deg }– Contains bivariate polynomials of deg , but
sometimes many more codewords• Code has basis of monomials • Characterize which belong in code• Lower bound rate of code by lower bounding
number of such
![Page 14: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/14.jpg)
Main idea
• Example:, has degree but on each line looks like degree
because in , i.e. polynomials are only distinguishable modulo by looking at evaluations in
![Page 15: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/15.jpg)
Main idea
• New code (lifted RS code)– Codewords = {bivariate polynomials whose
restrictions to lines are polynomials of deg }– Contains bivariate polynomials of deg , but
sometimes many more codewords• Code has basis of monomials • Characterize which belong in code• Lower bound rate of code by lower bounding
number of such
![Page 16: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/16.jpg)
Dimension of lifted RS code
• Shadows, and Lucas’ Theorem– Let denote base expansion– Shadow: if for every – Lucas’ Theorem only if which implies
![Page 17: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/17.jpg)
Dimension of lifted RS code
• Example:
– Over field of characteristic 2,
![Page 18: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/18.jpg)
Dimension of lifted RS code
• When is in lifted code?• Expand:
• So is in lift iff for every and , where
![Page 19: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/19.jpg)
Dimension of lifted RS code
• ,
Reed-Muller Lifted Reed-Solomon
𝑖 𝑖
𝑗 𝑗
![Page 20: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/20.jpg)
Dimension of lifted RS code
• ,
Reed-Muller Lifted Reed-Solomon
𝑖 𝑖
𝑗 𝑗
![Page 21: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/21.jpg)
Dimension of lifted RS code
• ,
Reed-Muller Lifted Reed-Solomon
𝑖 𝑖
𝑗 𝑗
![Page 22: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/22.jpg)
Dimension of lifted RS code
• ,
Reed-Muller Lifted Reed-Solomon
𝑖 𝑖
𝑗 𝑗
![Page 23: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/23.jpg)
Talk outline
• Error correcting codes• Locally correctable codes• Our contributions– New high rate LCCs– General framework for “lifting” codes– New lower bounds for Nikodym sets
![Page 24: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/24.jpg)
General results
• Affine-invariant codes– for affine permutation
• Lifts– Restrictions to low-dim affine subspaces are
codewords in “base code”– Good distance– Good locality– Only need to analyze dimension
![Page 25: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/25.jpg)
Talk outline
• Error correcting codes• Locally correctable codes• Our contributions– New high rate LCCs– General framework for “lifting” codes– New lower bounds for Nikodym sets
![Page 26: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/26.jpg)
Application to Nikodym sets
• Multivariate polynomials outside of coding theory• Polynomial method (Dvir’s analysis of Kakeya sets)• Nikodym set
– For every point , there is a line through which is contained in the set, except possibly
– Can get lower bound of using polynomial method– Using multiplicity codes, can get bound – Using lifted codes, can get bound
![Page 27: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/27.jpg)
Application to Nikodym sets
• Polynomial method– Assume dimension of
{-variate polynomial code of deg }– Exists nonzero vanishing identically on – actually vanishes everywhere!• Let • Exists line through that intersects in points• vanishes at points, but has deg • , so
![Page 28: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/28.jpg)
Application to Nikodym sets
• Improved polynomial method– Assume dimension of
{lifted RS code of deg }– Exists nonzero vanishing identically on – actually vanishes everywhere!• Let • Exists line through that intersects in points• vanishes at points, but has deg • , so
![Page 29: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/29.jpg)
Summary
• Lifting– Natural operation– Build longer codes from short ones– Preserve distance– Gain locality– Can get high rate
• Applications outside of coding theory– Improve polynomial method (e.g. Nikodym sets)
![Page 30: Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)](https://reader033.vdocuments.net/reader033/viewer/2022052820/5516351d550346b2068b4e59/html5/thumbnails/30.jpg)
Thank you!