PowerPoint Presentation

, . , .

1

? ? ? ? ? ?

~ . .2

()

: ?

. .3

?

:

. .

. ?5

:

!

. .6

( )

,

.7

(2) , (: )

, ? ., .8

?

.9

: / : : :

. ~( )10

: : : + + : Slate / Quora .

- Julie Zhuo, Product Design VP at Facebook

. ~ 11

: : + : + :

.12

?

A B

. . !13

?

14

?

() ? ?

? ?

? ? !

? crowdsourcing ?

Q: ?

No ground for comparison / What if the judge doesnt understand the intent?17

? .

.

.

.

(2) crowdsourcing ?

Q: ?

No ground for comparison / What if the judge doesnt understand the intent?19

(3)

Q: ?

Q: ?

Should we use about the same vs. the same??20

? ?

?

?

?

,

: / /

?

SIGIR2015 Tutorial on Offline Search Evaluation

?

26

/

?