Publications: Advice-taking Learners
Adaptive systems learn in dynamic environments by repeatedly sensing the world,
performing an action, and receiving feedback from the environment. The area of
reinforcement learning concerns agents that learn
sequential behaviors from experience; however, learning in complex domains is
excruciatingly slow. We are developing reinforcement learning methods that can
be guided
both by reinforcements provided by the environment
and abstract advice provided by a human teacher. In particular, we are
developing methods in which advice is given in ordinary natural language (which
is translated into formal advice using a
learned semantic
parser). By taking advantage of general advice on actions to perform in
certain situations, the agent's learning rate can be greatly accelerated. This
work is related to our work on
theory refinement
and
natural language learning.
Learning from natural-language advice and reinforcements is the topic of the PILLAR research project.
- Learning a Compositional Semantic Parser using an Existing Syntactic Parser
[Details] [PDF] [Slides (PPT)]
Ruifang Ge and Raymond J. Mooney
In Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP 2009), 611--619, Suntec, Singapore, August 2009.
- Learning for Semantic Parsing with Kernels under Various Forms of Supervision
[Details] [PDF] [Slides (PPT)]
Rohit J. Kate
PhD Thesis, Department of Computer Sciences, University of Texas at Austin, Austin, TX, August 2007. 159 pages.
- Learning for Semantic Parsing and Natural Language Generation Using Statistical Machine Translation Techniques
[Details] [PDF]
Yuk Wah Wong
PhD Thesis, Department of Computer Sciences, University of Texas at Austin, Austin, TX, August 2007. 188 pages. Also appears as Technical Report AI07-343, Artificial Intelligence Lab, University of Texas at Austin, August 2007.
- Learning Language Semantics from Ambiguous Supervision
[Details] [PDF]
Rohit J. Kate and Raymond J. Mooney
In Proceedings of the 22nd Conference on Artificial Intelligence (AAAI-07), 895-900, Vancouver, Canada, July 2007.
- Learning Synchronous Grammars for Semantic Parsing with Lambda Calculus
[Details] [PDF]
Yuk Wah Wong and Raymond J. Mooney
In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics (ACL-2007), Prague, Czech Republic, June 2007.
- Semi-Supervised Learning for Semantic Parsing using Support Vector Machines
[Details] [PDF] [Slides (PPT)]
Rohit J. Kate and Raymond J. Mooney
In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, Short Papers (NAACL/HLT-2007), 81--84, Rochester, NY, April 2007.
- Generation by Inverting a Semantic Parser That Uses Statistical Machine Translation
[Details] [PDF]
Yuk Wah Wong and Raymond J. Mooney
In Proceedings of Human Language Technologies: The Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT-07), 172-179, Rochester, NY, 2007.
- Learning for Semantic Parsing
[Details] [PDF]
Raymond J. Mooney
In A. Gelbukh, editors, Computational Linguistics and Intelligent Text Processing: Proceedings of the 8th International Conference (CICLing 2007), 311--324, Mexico City, Mexico, February 2007. Springer: Berlin, Germany. Invited paper.
- Using String-Kernels for Learning Semantic Parsers
[Details] [PDF] [Slides (PPT)]
Rohit J. Kate and Raymond J. Mooney
In ACL 2006: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL, 913-920, Morristown, NJ, USA, 2006. Association for Computational Linguistics.
- Discriminative Reranking for Semantic Parsing
[Details] [PDF]
Ruifang Ge and Raymond J. Mooney
In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING/ACL-06), Sydney, Australia, July 2006.
- Learning for Semantic Parsing with Statistical Machine Translation
[Details] [PDF]
Yuk Wah Wong and Raymond J. Mooney
In Proceedings of Human Language Technology Conference / North American Chapter of the Association for Computational Linguistics Annual Meeting (HLT-NAACL-06), 439-446, New York City, NY, 2006.
- Learning Semantic Parsers Using Statistical Syntactic Parsing Techniques
[Details] [PDF]
Ruifang Ge
2006. Doctoral Dissertation Proposal, University of Texas at Austin" , year="2006.
- Using Active Relocation to Aid Reinforcement Learning
[Details] [PDF]
Lilyana Mihalkova and Raymond Mooney
In Prodeedings of the 19th International FLAIRS Conference (FLAIRS-2006), 580-585, Melbourne Beach, FL, May 2006.
- A Kernel-based Approach to Learning Semantic Parsers
[Details] [PDF] [Slides (PPT)]
Rohit J. Kate
2005. Doctoral Dissertation Proposal, University of Texas at Austin.
- Learning for Semantic Parsing Using Statistical Machine Translation Techniques
[Details] [PDF]
Yuk Wah Wong
2005. Doctoral Dissertation Proposal, University of Texas at Austin.
- A Statistical Semantic Parser that Integrates Syntax and Semantics
[Details] [PDF]
Ruifang Ge and Raymond J. Mooney
In Proceedings of CoNLL-2005, Ann Arbor, Michigan, June 2005.
- Learning to Transform Natural to Formal Languages
[Details] [PDF] [Slides (PPT)]
Rohit J. Kate, Yuk Wah Wong and Raymond J. Mooney
In Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI-05), 1062-1068, Pittsburgh, PA, July 2005.
- Guiding a Reinforcement Learner with Natural Language Advice: Initial Results in RoboCup Soccer
[Details] [PDF]
Gregory Kuhlmann, Peter Stone, Raymond J. Mooney, and Jude W. Shavlik
In The AAAI-2004 Workshop on Supervisory Control of Learning and Adaptive Systems, July 2004.
- Learning Transformation Rules for Semantic Parsing
[Details] [PDF]
Rohit J. Kate, Yuk Wah Wong, Ruifang Ge, and Raymond J. Mooney
April 2004. Unpublished Technical Report.
