Selective Algorithms for Large-Scale Classification and Structured Learning

Kai-Wei Chang, in UIUC Phd Thesis, 2015.

Download the full text

Abstract

The desired output in many machine learning tasks is a structured object, such as tree, clustering, or sequence. Learning accurate prediction models for such problems requires training on large amounts of data, making use of expressive features and performing global inference that simultaneously assigns values to all interrelated nodes in the structure. All these contribute to significant scalability problems. In this thesis, we describe a collection of results that address several aspects of these problems - by carefully selecting and caching samples, structures, or latent items. Our results lead to entryfficient learning algorithms for large-scale binary classification models, structured prediction models and for online clustering models which, in turn, support reduction in problem size, improvements in training and evaluation speed and improved performance. We have used our algorithms to learn expressive models from large amounts of annotated data and achieve state-of-the art performance on several natural language processing tasks.

Bib Entry

@inproceedings{chang2015thesis,
  author = {Chang, Kai-Wei},
  title = {Selective Algorithms for Large-Scale Classification and Structured Learning},
  booktitle = {UIUC Phd Thesis},
  year = {2015}
}