Markov logic networks (MLNs) are an expressive representation for statistical relational learning that generalizes both first-order logic and graphical models. Existing discriminative weight learning methods for MLNs all try to learn weights that optimize the Conditional Log Likelihood (CLL) of the training examples. In this work, we present a new discriminative weight learning method for MLNs based on a max-margin framework. This results in a new model, Max-Margin Markov Logic Networks (M3LNs), that combines the expressiveness of MLNs with the predictive accuracy of structural Support Vector Machines (SVMs). To train the proposed model, we design a new approximation algorithm for loss-augmented inference in MLNs based on Linear Programming (LP). The experimental result shows that the proposed approach generally achieves higher F1 scores than the current best discriminative weight learner for MLNs.

PDF

In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD), Part 1, pp. 564--579, Bled, Slovenia, September 2009.

@inproceedings{huynh:ecml-pkdd09, title={Max-Margin Weight Learning for Markov Logic Networks}, author={Tuyen N. Huynh and Raymond J. Mooney}, booktitle={Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD), Part 1}, month={September}, address={Bled, Slovenia}, pages={564--579}, url="http://www.cs.utexas.edu/users/ai-lab?huynh:ecml-pkdd09", year={2009} }

Slides (PPT)