human-assisted graph search: it’s okay to ask questions reported by qi liu

33
Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Upload: kaylie-wilkey

Post on 15-Jan-2016

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Human-Assisted Graph Search: It’s Okay to Ask Questions

Reported by Qi Liu

Page 2: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Scenes

• Human Computation• Crowding-sourcing service(Amazon’s

Mechanical Turk)

Page 3: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

An example

• Image classification

Page 4: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Terminology of the Problem

• HumanGS: abbreviation for human-assisted graph search

• Taxonomy: DAG(directed acyclic graph)• Category: Node• Question: Reachability• Tricks: Not leaves, Not root, Just middle!• Challenge: High Latency

Page 5: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

More Applications

• Manual Curation(insert a web into web-graph)• Question: Is the item a kind of x?

Page 6: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Apps(cont.)

• Debugging of Workflows• Question: Is the outputfragment at point x wrong?

Page 7: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Apps(cont.)

• Filter Synthesis• Question: Do youwant all data items satisfying conditionx to be part of theresult?

Page 8: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Apps(cont.)

• Interactive Search• Question: Do you want more results like

concept x?

Page 9: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Dimensions of the problem

• Single/Multi (target set)• Bounded/Unlimited (question set)• DAG/Downward-Forest/Upward-Forest

Page 10: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Define the Problem

Page 11: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

DAG property

Page 12: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Candidate Set

Page 13: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

An Example

Q(nissan,maxima)=yes=>

Cand(nissan,maxima)={nissan,maxima,sentra}Q(mercedes,maxima)=no

=>Cand(mercedes,maxima)=V/{mercedes}

Q(car,maxima)=yes=>

Cand(car,maxima)=V/{vehicle}

Page 14: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Extending to|N|> 1

Page 15: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Goal: Picking N set

Page 16: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single Target Node

Page 17: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single-Bounded

Page 18: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single-Bounded: DAG

Conclusion: A NP-hard max-cover problem

Page 19: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single-Bounded: Downward-Forest

Page 20: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Equivalence to the Partition Problem

Page 21: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Show the equivalence

Page 22: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

An example

Page 23: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Candidate Set : Partition

Page 24: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Induction and Conclusion

• Minimum wcase(N) => the size of the largest partition that can be induced by N.

• Solved in PTIME!

Page 25: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single-Bounded: Upward-Forest

Page 26: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single-Unlimited

• For DAG, the question numbers vary from O(log n) to O(n)

Page 27: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single-Unlimited: Downward-Forest

Page 28: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Single-Unlimited: Upward-Forest

Page 29: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Multiple Target Nodes

• Multi-Bounded: DAG• Lower-bound: NP-hard in n and k• Upper-bound: • Multi-Bounded: Downward/Upward-Forest– DP algorithm: O(k^2*n*6)

Page 30: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

Experiments

Page 31: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu
Page 32: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu
Page 33: Human-Assisted Graph Search: It’s Okay to Ask Questions Reported by Qi Liu

The End