Awards


    Ro-Man CoTeSys Cognitive Robotics Best Paper Nomination, 2012

    AAMAS Pragnesh Jay Modi Best Student Paper Award, 2010

    NSF Graduate Research Fellowship, 2008 - 2011

    David Bruton, Jr. Graduate School Fellowship 2008, 2009, 2010



Internships and Extended Visits


    MIT Media Lab, Cynthia Breazeal’s Personal Robots Group, Visiting Scholar, 2011

    Apple Inc., Data Mining Lab, Intern, 2010

    NASA Ames, Intelligent Systems Division, Intern, 2008



Research Competitions


    Robocup @Home League (home assistant robotics)

    2007: 2nd place -- Austin Villa @Home Website


    Robocup Coach League (opponent modeling)

    2006: 2nd place

    2005: Champion -- Austin Villa 2005 Coach Website



Selected Publications

W. Bradley Knox and Peter Stone. Reinforcement Learning from Human Reward: Discounting in Episodic Tasks. In Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication (Ro-Man). September 2012.

Nominated for CoTeSys Cognitive Robotics Best Paper award

[pdf] (2.1 MB)

Ro-Man 2012


W. Bradley Knox, Brian D. Glass, Bradley C. Love, W. Todd Maddox, and Peter Stone. How Humans Teach Agents: A New Experimental Perspective. International Journal of Social Robotics. Published online, print forthcoming. July 2012.

[pdf] (2.7 MB)

The final publication is available here at www.springerlink.com.


W. Bradley Knox and Peter Stone. Reinforcement Learning from Simultaneous Human and MDP Reward. In Proceedings of the Eleventh International Conference on Autonomous Agents and Multiagent Systems. June 2012.

[pdf] (930 kB)

AAMAS 2012


W. Bradley Knox, A. Ross Otto, Peter Stone, and Bradley C. Love. The Nature of Belief-Directed Exploratory Choice in Human Decision-making. Frontiers in Psychology, 2, 398. 2012.

[pdf] (1497kB)

Frontiers in Psychology article page


W. Bradley Knox, Cynthia Breazeal, and Peter Stone. Learning from feedback on actions past and intended. In Proceedings of 7th ACM/IEEE International Conference on Human-Robot Interaction, Late-Breaking Reports Session. March 2012.

[pdf] (458kB)

HRI 2012


W. Bradley Knox, Matthew Taylor, and Peter Stone. Understanding Human Teaching Modalities in Reinforcement Learning Environments: A Preliminary Report. In 2011 IJCAI Workshop on Agents Learning Interactively from Human Teachers (ALIHT), July 2011.

[pdf] (381kB)

2011 IJCAI Workshop on Agents Learning Interactively from Human Teachers (ALIHT)


W. Bradley Knox and Peter Stone. Combining Manual Feedback with Subsequent MDP Reward Signals for Reinforcement Learning. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems. May 2010.

Pragnesh Jay Modi Best Student Paper Award

[pdf] (433kB)

Poster: [pdf] (2.9 MB)

AAMAS 2010


W. Bradley Knox and Peter Stone. Interactively Shaping Agents via Human Reinforcement: The TAMER Framework. In Proceedings of The Fifth International Conference on Knowledge Capture. September 2009.

[pdf] (638kB)

Supplemental site

K-CAP09


W. Bradley Knox and Ole Mengshoel. Diagnosis and Reconfiguration using Bayesian Networks: An Electrical Power System Case Study. In IJCAI 2009 Workshop on

Self-* and Autonomous Systems. July 2009.

[pdf] (838kB)

IJCAI09-SAS


W. Bradley Knox, Ian Fasel, and Peter Stone. Design Principles for Creating Human-Shapable Agents. In AAAI Spring 2009 Symposium on Agents that Learn from Human Teachers, March 2009.

[pdf] (400.8kB)

AAAI Spring 2009 Symposium: Agents that Learn from Human Teachers


Juhyun Lee, W. Bradley Knox, and Peter Stone. Inter-Classifier Feedback for Human-Robot Interaction in a Domestic Setting. Journal of Physical Agents, 2(2):41–50, July 2008. Special Issue on Human Interaction with Domestic Robots

[pdf] (2.4MB)


Gregory Kuhlmann, William B. Knox, and Peter Stone. Know Thine Enemy: A Champion RoboCup Coach Agent. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pp. 1463–68, July 2006.

[pdf] (126.0kB)

AAAI 2006



Full Curriculum Vitae

 

Latest

TAMER+RL paper