AAAI Publications, Twenty-First International Joint Conference on Artificial Intelligence

Font Size: 
Latent Variable Perceptron Algorithm for Structured Classification
Xu Sun, Takuya Matsuzaki, Daisuke Okanohara, Jun'ichi Tsujii

Last modified: 2009-06-26


We propose a perceptron-style algorithm for fast discriminative training of structured latent variable model. This method extends the perceptron algorithm for the learning with latent dependencies, as an alternative to existing probabilistic latent variable models. It relies on Viterbi decoding over latent variables, combined with simple additive updates. Its training cost is significantly lower than that of probabilistic latent variable models, while it gives comparable or even superior classification accuracy on our tasks. Experiments on natural language processing problems demonstrate that its results are among those good reports on corresponding data sets.


machine learning; online learning; latent variable model; perceptron; natural language processing

Full Text: PDF