advanced lecture on dependency parsing: dynamic oracles and miryam/papers/5ln455-f10.pdf¢ ...

Download Advanced Lecture on Dependency Parsing: Dynamic Oracles and miryam/papers/5LN455-F10.pdf¢  Miryam de

Post on 12-Aug-2020

0 views

Category:

Documents

0 download

Embed Size (px)

TRANSCRIPT

  • Advanced Lecture on Dependency Parsing: Dynamic Oracles and Online Reordering

    Miryam de Lhoneux

    14 December 2017

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 1

  • Outline

    1 Arc-Hybrid

    2 Dynamic Oracles

    3 Reordering

    4 Dynamic Oracles and Reordering

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 2

  • Outline for section 1

    1 Arc-Hybrid

    2 Dynamic Oracles

    3 Reordering

    4 Dynamic Oracles and Reordering

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 3

  • Transition-Based Parsing with Arc-Hybrid

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    RIGHT−ARC

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    RIGHT−ARC

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    RIGHT−ARC

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    SHIFT

    RIGHT−ARC

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Transition-Based Parsing with Arc-Hybrid

    SHIFT

    RIGHT−ARC

    LEFT−ARC

    STACK BUFFER

    Configuration:

    friend home rootDrive your

    Transitions:

    Kuhlmann et al. (2011)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 4

  • Training a Transition-Based Parser

    Figure : Figure taken from Goldberg and Nivre (2012)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 5

  • Training a Transition-Based Parser

    Figure : Figure taken from Goldberg and Nivre (2012)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 5

  • Static Oracle for Arc-Hybrid

    Drive your friend home **root**

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    Drive your friend home **root**

    [ ] [Drive your friend home **root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    SHIFT

    Drive your friend home **root**

    [ Drive ] [your friend home **root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    SHIFT

    Drive your friend home **root**

    [ Drive your ] [friend home **root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    LEFT-ARC

    Drive your friend home **root**

    [ Drive ] [friend home **root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    SHIFT

    Drive your friend home **root**

    [ Drive friend] [home **root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    RIGHT-ARC

    Drive your friend home **root**

    [ Drive ] [home **root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    SHIFT

    Drive your friend home **root**

    [ Drive home] [**root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    RIGHT-ARC

    Drive your friend home **root**

    [ Drive ] [**root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Static Oracle for Arc-Hybrid

    LEFT-ARC

    Drive your friend home **root**

    [ ] [**root**]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 6

  • Exercise!

    Write the transition sequence for this tree:

    I love parsing so much ! *root*

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 7

  • Outline for section 2

    1 Arc-Hybrid

    2 Dynamic Oracles

    3 Reordering

    4 Dynamic Oracles and Reordering

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 8

  • Static Oracle: problem 1

    Figure : Figure taken from Goldberg and Nivre (2012)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 9

  • Static Oracle: problem 1

    Figure : Figure taken from Goldberg and Nivre (2012)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 9

  • Spurious ambiguity

    Send him a flower

    [ Send him ] [ a flower ]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 10

  • Spurious ambiguity

    RIGHT-ARC

    Send him a flower

    [ Send ] [ a flower ]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 10

  • Spurious ambiguity

    Send him a flower

    [ Send him ] [ a flower ]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 10

  • Spurious ambiguity

    SHIFT

    Send him a flower

    [ Send him a ] [ flower ]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 10

  • Spurious ambiguity

    LEFT-ARC

    Send him a flower

    [ Send him ] [ flower ]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 10

  • Spurious ambiguity

    RIGHT-ARC

    Send him a flower

    [ Send ] [ flower ]

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 10

  • Static Oracle: problem 2

    Figure : Figure taken from Goldberg and Nivre (2012)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 11

  • Static Oracle: problem 2

    Figure : Figure taken from Goldberg and Nivre (2012)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 11

  • Training with a Dynamic Oracle

    Figure : Figure taken from Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 12

  • Training with a Dynamic Oracle

    Figure : Figure taken from Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 12

  • Training with a Dynamic Oracle

    Figure : Figure taken from Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 12

  • Dynamic Oracle for Arc-Hybrid

    Drive your friend home **root**

    [ Drive your ] [ friend home **root**]

    Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 13

  • Dynamic Oracle for Arc-Hybrid

    RIGHT-ARC

    Drive your friend home **root**

    [ Drive your ] [ friend home **root**]

    Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 13

  • Dynamic Oracle for Arc-Hybrid

    RIGHT-ARC

    Drive your friend home **root**

    [ Drive ] [ friend home **root**]

    Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 13

  • Dynamic Oracle for Arc-Hybrid

    RIGHT-ARC

    Drive your friend home **root**

    cost+=1

    [ Drive ] [ friend home **root**]

    Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 13

  • Dynamic Oracle for Arc-Hybrid

    SHIFT

    Drive your friend home **root**

    [ Drive your ] [ friend home **root**]

    Goldberg and Nivre (2013)

    Miryam de Lhoneux Advanced Lecture on Dependency Parsing 13

  • Dynamic Oracle for Arc-Hybrid

    SHIFT