non-adaptive probabilistic group testing with noisy measurements: near-optimal bounds with efficient...

47
Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan , Pak Hou Che and Sidharth Jaggi The Chinese University of Hong Kong Venkatesh Saligrama Boston University

Post on 22-Dec-2015

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

Non-adaptive probabilistic group testing with noisy measurements: Near-optimal

bounds with efficient algorithmsChun Lam Chan, Pak Hou Che and Sidharth Jaggi

The Chinese University of Hong Kong

Venkatesh Saligrama

Boston University

Page 2: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

Non-adaptive probabilistic group testing with noisy measurements: Near-optimal

bounds with efficient algorithmsChun Lam Chan, Pak Hou Che and Sidharth Jaggi

The Chinese University of Hong Kong

Venkatesh Saligrama

Boston University

n-dd

Page 3: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

Non-adaptive probabilistic group testing with noisy measurements: Near-optimal

bounds with efficient algorithmsChun Lam Chan, Pak Hou Che and Sidharth Jaggi

The Chinese University of Hong Kong

Venkatesh Saligrama

Boston University

n-dd

Page 4: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

4

Literature No error: [DR82], [DRR89] With small error ϵ:

Upper bound: [AS09], [SJ10]

Page 5: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

5

Literature No error: [DR82], [DRR89] With small error ϵ:

Upper bound: [AS09], [SJ10]

Lower bound: [Folklore]

Page 6: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

Non-adaptive probabilistic group testing with noisy measurements: Near-optimal

bounds with efficient algorithms

Page 7: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

7

Algorithms motivated by Compressive Sensing Combinatorial Basis Pursuit (CBP) Combinatorial Orthogonal Matching Pursuit

(COMP)

Page 8: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

8

Noiseless CBP

n-dd

Page 9: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

9

Noiseless CBP

n-dd

Discard

Page 10: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

10

Noiseless CBP Sample g times to form a

group

n-dd

Page 11: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

11

Noiseless CBP Sample g times to form a

group

n-dd

Page 12: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

12

Noiseless CBP Sample g times to form a

group

n-dd

Page 13: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

13

Noiseless CBP Sample g times to form a

group

n-dd

Page 14: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

14

Noiseless CBP Sample g times to form a

group

Total non-defective items drawn:

n-dd

Page 15: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

15

Noiseless CBP Sample g times to form a

group

Total non-defective items drawn:

Coupon collection:

n-dd

Page 16: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

16

Noiseless CBP Sample g times to form a

group

Total non-defective items drawn:

Coupon collection:

Conclusion:

n-dd

Page 17: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

17

Noisy CBP

n-dd

Page 18: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

18

Noisy CBP

n-dd

Page 19: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

19

Noisy CBP

n-dd

Page 20: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

20

Noisy CBP

n-dd

Page 21: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

21

Noiseless COMP

Page 22: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

22

Noiseless COMP

Page 23: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

23

Noiseless COMP

Page 24: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

24

Noiseless COMP

Page 25: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

25

Noiseless COMP

Page 26: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

26

Noisy COMP

Page 27: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

27

Noisy COMP

Page 28: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

28

Noisy COMP

 

Page 29: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

29

Noisy COMP

Page 30: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

30

Noisy COMP

Page 31: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

31

Noisy COMP

Page 32: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

32

Noisy COMP

Page 33: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

33

Simulations

0 100 200 300 400 500 600 700 8000

1

Experimental; q=0

Theoretical-lower; q=0

Theoretical-upper;q=0

number of tests (T)

succ

ess

rate

Page 34: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

34

Simulations

0 500 1000 1500 2000 2500 30000

1

Experimental; q=0

Experimental; q=0.1

Experimental; q=0.2

Theoretical-lower; q=0

Theoretical-lowerl; q=0.1

Theoretical-lower; q=0.2

Theoretical-upper;q=0

Theoretical-lower; q=0.1

Theoretical-lower; q=0.2

number of tests (T)

succ

ess

rate

Page 35: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

35

Summary

CBP COMP

Noiseless

Noisy

With small error ,

Page 36: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

36

End

Thanks

Page 37: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

37

Noiseless COMP

x 0 0 1 0 0 0 1 0 0

M y

0 1 1 1 0 0 0 0 0 10 0 0 1 0 0 1 0 0 10 1 0 0 0 0 0 0 1 01 1 1 0 0 0 1 1 0 10 0 1 1 0 1 1 0 0 10 0 0 0 1 0 0 1 1 0

0 0 1 1 0 1 1 0 0 1

Page 38: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

38

x 0 0 1 0 0 0 1 0 0

M y

0 1 1 1 0 0 0 0 0 10 0 0 1 0 0 1 0 0 10 1 0 0 0 0 0 0 1 01 1 1 0 0 0 1 1 0 10 0 1 1 0 1 1 0 0 10 0 0 0 1 0 0 1 1 0

0 0 1 1 0 1 1 0 0 1

0 10 11 0 x90 1 → 00 11 00 1

Noiseless COMP

Page 39: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

39

Noiseless COMP

x 0 0 1 0 0 0 1 0 0

M y

0 1 1 1 0 0 0 0 0 10 0 0 1 0 0 1 0 0 10 1 0 0 0 0 0 0 1 01 1 1 0 0 0 1 1 0 10 0 1 1 0 1 1 0 0 10 0 0 0 1 0 0 1 1 0

0 0 1 1 0 1 1 0 0 1

0 01 10 0 x71 1 → 11 10 01 1

Page 40: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

40

Noiseless COMP

x 0 0 1 0 0 0 1 0 0

M y

0 1 1 1 0 0 0 0 0 10 0 0 1 0 0 1 0 0 10 1 0 0 0 0 0 0 1 01 1 1 0 0 0 1 1 0 10 0 1 1 0 1 1 0 0 10 0 0 0 1 0 0 1 1 0

0 0 1 1 0 1 1 0 0 1

1 11 10 0 x40 1 → 11 10 01 1

Page 41: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

41

Noiseless COMP

x 0 0 1 0 0 0 1 0 0

M y0 1 1 1 0 0 0 0 0 10 0 0 1 0 0 1 0 0 10 1 0 0 0 0 0 0 1 01 1 1 0 0 0 1 1 0 10 0 1 1 0 1 1 0 0 10 0 0 0 1 0 0 1 1 00 0 1 1 0 1 1 0 0 1

1 1 0 0 0 11 1 1 1 0 10 0 x4 0 0 x7 1 0 x9

(a) 0 1 → 1 (b) 1 1 → 1 (c) 0 1 → 01 1 1 1 0 10 0 0 0 1 01 1 1 1 0 1

Page 42: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

42

Noisy COMPx 0 0 1 0 0 0 1 0 0

    M y ν ŷ0 1 0 1 0 0 0 0 0 0 0 00 0 0 1 0 0 1 0 0 1 1 00 1 0 0 0 0 0 0 1 0 1 11 1 1 0 0 0 1 1 1 1 + 1 → 00 1 1 1 0 1 0 0 0 1 0 10 0 0 0 1 0 0 1 1 0 0 00 0 1 1 0 1 1 0 0 1 0 1

0 00 00 11 01 10 01 1

Page 43: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

43

Noisy COMPx 0 0 1 0 0 0 1 0 0

    M y ν ŷ0 1 0 1 0 0 0 0 0 0 0 00 0 0 1 0 0 1 0 0 1 1 00 1 0 0 0 0 0 0 1 0 1 11 1 1 0 0 0 1 1 1 1 + 1 → 00 1 1 1 0 1 0 0 0 1 0 10 0 0 0 1 0 0 1 1 0 0 00 0 1 1 0 1 1 0 0 1 0 1

0 00 00 1 x31 0 → 11 10 01 1

If then =1 else =0

Page 44: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

44

Noisy COMPx 0 0 1 0 0 0 1 0 0

    M y ν ŷ0 1 0 1 0 0 0 0 0 0 0 00 0 0 1 0 0 1 0 0 1 1 00 1 0 0 0 0 0 0 1 0 1 11 1 1 0 0 0 1 1 1 1 + 1 → 00 1 1 1 0 1 0 0 0 1 0 10 0 0 0 1 0 0 1 1 0 0 00 0 1 1 0 1 1 0 0 1 0 1

1 00 01 1 x2

1 0 → 1

1 10 00 1

Page 45: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

45

Noisy COMPx 0 0 1 0 0 0 1 0 0

    M y ν ŷ0 1 0 1 0 0 0 0 0 0 0 00 0 0 1 0 0 1 0 0 1 1 00 1 0 0 0 0 0 0 1 0 1 11 1 1 0 0 0 1 1 1 1 + 1 → 00 1 1 1 0 1 0 0 0 1 0 10 0 0 0 1 0 0 1 1 0 0 00 0 1 1 0 1 1 0 0 1 0 1

0 01 00 1 x71 0 → 00 10 01 1

Page 46: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

46

Noisy COMP

x 0 0 1 0 0 0 1 0 0

    M y ν ŷ0 1 0 1 0 0 0 0 0 0 0 00 0 0 1 0 0 1 0 0 1 1 00 1 0 0 0 0 0 0 1 0 1 11 1 1 0 0 0 1 1 1 1 + 1 → 00 1 1 1 0 1 0 0 0 1 0 10 0 0 0 1 0 0 1 1 0 0 00 0 1 1 0 1 1 0 0 1 0 1

1 0 0 0 0 00 0 0 0 1 01 1 x2 0 1 x3 0 1 x7

(a) 1 0 → 1 (b) 1 0 → 1 (c) 1 0 → 01 1 1 1 0 10 0 0 0 0 00 1 1 1 1 1

Page 47: Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth

47

Noisy COMP

x 0 0 1 0 0 0 1 0 0

    M y ν ŷ0 1 0 1 0 0 0 0 0 0 0 00 0 0 1 0 0 1 0 0 1 1 00 1 0 0 0 0 0 0 1 0 1 11 1 1 0 0 0 1 1 1 1 + 1 → 00 1 1 1 0 1 0 0 0 1 0 10 0 0 0 1 0 0 1 1 0 0 00 0 1 1 0 1 1 0 0 1 0 1

1 0 0 0 0 00 0 0 0 1 01 1 x2 0 1 x3 0 1 x7

(a) 1 0 → 1 (b) 1 0 → 1 (c) 1 0 → 01 1 1 1 0 10 0 0 0 0 00 1 1 1 1 1