This paper introduces two new frameworks, Doubly Supervised Latent Dirichlet Allocation (DSLDA) and its non-parametric variation (NP-DSLDA), that integrate two different types of supervision: topic labels and category labels. This approach is particularly useful for multitask learning, in which both latent and supervised topics are shared between multiple categories. Experimental results on both document and image classification show that both types of supervision improve the performance of both DSLDA and NP-DSLDA and that sharing both latent and supervised topics allows for better multitask learning.

PDF

In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), pp. 369--384, Prague, Czech Republic, September 2013.

@inproceedings{acharya:ecml13, title={Using Both Latent and Supervised Shared Topics for Multitask Learning}, author={Ayan Acharya and Aditya Rawal and Raymond J. Mooney and Eduardo R. Hruschka}, booktitle={Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD)}, month={September}, address={Prague, Czech Republic}, pages={369--384}, url="http://www.cs.utexas.edu/users/ai-lab?acharya:ecml13", year={2013} }

Slides (PDF)