Proceedings chapter
OA Policy
English

Incremental Recurrent Neural Network Dependency Parser with Search-based Discriminative Training

Presented at

Beijing, China, July 30-31, 2015

Publication date

2015

Abstract

We propose a discriminatively trained recurrent neural network (RNN) that predicts the actions for a fast and accurate shift-reduce dependency parser. The RNN uses its output-dependent model structure to compute hidden vectors that encode the preceding partial parse, and uses them to estimate probabilities of parser actions. Unlike a similar previous generative model (Henderson and Titov, 2010), the RNN is trained discriminatively to optimize a fast beam search. This beam search prunes after each shift action, so we add a correctness probability to each shift action and train this score to discriminate between correct and incorrect sequences of parser actions. We also speed up parsing time by caching computations for frequent feature combinations, including during training, giving us both faster training and a form of backoff smoothing. The resulting parser is over 35 times faster than its generative counterpart with nearly the same accuracy, producing state-of-art dependency parsing results while requiring minimal feature engineering.

Citation (ISO format)

YAZDANI, Majid, HENDERSON, James. Incremental Recurrent Neural Network Dependency Parser with Search-based Discriminative Training. In: Proceedings of the 19th Conference on Computational Language Learning. Beijing, China. [s.l.] : [s.n.], 2015. p. 142–152. doi: 10.18653/v1/k15-1015

Main files (1)

Proceedings chapter (Published version)

Identifiers

796views
639downloads

Technical informations

Creation

19/08/2015 13:17:00

First validation

19/08/2015 13:17:00

Update

23/01/2026 08:39:22

Status update

23/01/2026 08:39:22

Last indexation

23/01/2026 08:40:50
All rights reserved by Archive ouverte UNIGE and the University of Geneva
OpenAIRE Indexed & Validated