comb, needle, and haystacks: balancing push and pull for information discovery

28
Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery Xin Liu Computer Science Dept. University of California, Davis Collaborators: Qingfeng Huang & Ying Zhang, PARC

Upload: ira

Post on 05-Jan-2016

26 views

Category:

Documents


0 download

DESCRIPTION

Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery. Xin Liu Computer Science Dept. University of California, Davis Collaborators: Qingfeng Huang & Ying Zhang , PARC. Objective. Simple, reliable, and efficient on-demand information discovery mechanisms. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

Comb, Needle, and Haystacks:Balancing Push and Pull for Information Discovery

Xin LiuComputer Science Dept.

University of California, Davis

Collaborators: Qingfeng Huang & Ying Zhang, PARC

Page 2: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 2

Objective

Simple, reliable, and efficient on-demand information discovery mechanisms

Page 3: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 3

Where are the tanks?

Page 4: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 4

Pull-based Strategy

Page 5: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 5

Pull-based Cont’d

Page 6: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 6

Push-based Strategy

Page 7: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 7

Comb-Needle Structure

Page 8: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 8

Related Work

D. Braginsky and D. Estrin, “Rumor routing algorithm for sensor networks”, WSNA, 2002.

J. Heidemann, F. Silva, and D. Estrin, “Matching data dissemination algorithms to application requirements”, SENSYS 2003.

ACQUIRE, IDSQ, SRT, GHT, DIMENSIONS, DIM, GRAB, gossip, flooding-based, agent-based, geo-routing, …

Page 9: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 9

Application Scenarios

On-demand information query Any node can be the query entry node Queries may be generated at anytime Events can happen anywhere and anytime Examples:

Firefighters query information in the field Surveillance

Sensor nodes know their locations

Page 10: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 10

When an Event Happens

Event

Page 11: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 11

When a Query is Generated

Event

Query

Event

Page 12: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 12

Tuning Comb-Needle

Page 13: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 13

The Spectrum of Push and Pull

Pull Push

Global pull +Local push

Global push +Local pull

Push & Pull

Inter-spike spacing increases

Reverse comb

Relative query frequency increases

Page 14: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 14

Reverse Comb

Query

Event

When query frequency > event frequency

Page 15: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 15

Mid-term Review

Basic idea: balancing push and pull

Preview: Reliability Random network An adaptive scheme

Page 16: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 16

Strategies for Improving Reliability

Local enhancement Interleaved mesh Routing update

Spatial diversity Correlated failures Enhance and balance query success rate at

different geo-locations

Page 17: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 17

Spatial Diversity

Query

xEvent

Page 18: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 18

Random Network

Constrained geographical flooding Needles and combs have certain widths

Page 19: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 19

Simulation

Simulator: Prowler

Page 20: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 20

Page 21: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 21

Page 22: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 22

Adaptive Scheme

Comb granularity depends on the query and event frequencies

Nodes estimate the query and event frequencies Important to match needle length and inter-spike

spacing Comb rotates

Load balancing Broadcast information of current inter-spike spacing

Page 23: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 23

Simulation

Regular grid Communication cost: hop counts No node failure Adaptive scheme

Page 24: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 24

Event & Query Frequencies

Page 25: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 25

Tracking the Ideal Inter-Spike Spacing

Page 26: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 26

Simulation Results

Gain depends on the query and event frequencies Even if needle length < inter-spike spacing, there is a

chance of success. Tradeoff between success ratio and cost

99.33% success ratio and 99.64% power consumption compared to the ideal case

Page 27: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 27

Summary

Adapt to system changes Can be applied in hierarchical structures

Pull Push

Global pull +Local push

Global push +Local pull

Push & Pull

Relative query frequency increases

Page 28: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery

11/4/2004 ACM Sensys 28

Future work

Further study on random networks Building a “comb-needle-like” structure

without location information Integrated with data aggregation and

compression Comprehensive models for communication

costs