The Role of Problem Classification in Online Meta-cognition
Pages 218 - 225
Abstract
Agents operating in open environments must be able to adapt their processing to available resources, deadlines, their goal criteria, and their current problem solving contexts. This paper describes the role of meta-cognition in this process; in particular, we define a meta-cognition framework that uses Naive Bayesian classification of the agent's current context in order to represent the meta-level control problem as a Markov Decision Process.
References
[1]
{1} D. P. Bertsekas and J. N. Tsitsiklis. Neuro-Dynamic Programming . Athena Scientific, Belmont, MA, 1996.
[2]
{2} K. Decker and A. Garvey. Scenario generation: Automatically generating domain-independent coordination scenarios. Unpublished, 2005.
[3]
{3} K. S. Decker and V. R. Lesser. Quantitative modeling of complex environments. International Journal of Intelligent Systems in Accounting, Finance, and Management, 2(4):215-234, Dec. 1993.
[4]
{4} R. Goldman, D. Musliner, and K. Krebsbach. Managing online self-adaptation in real-time environments. In Lecture Notes in Computer Science, volume 2614, pages 6-23. Springer-Verlag, 2003.
[5]
{5} E. Horvitz. Rational metareasoning and compilation for optimizing decisions under bounded resources. In Proceedings of Computational Intelligence, Milan, Italy, 1989.
[6]
{6} T. M. Mitchell. Machine Learning. WCB/McGraw-Hill, 1997.
[7]
{7} D. J. Musliner, E. H. Durfee, J. Wu, D. A. Dolgov, R. P. Goldman, and M. S. Boddy. Coordinated plan management using multiagent MDPs. In Working Notes of the AAAI 2006 Spring Symposium on Distributed Plan and Schedule Management , pages 73-80, March 2006.
[8]
{8} J. Phelps and J. Rye. GPGP - a domain-independent implementation. In Working Notes of the AAAI 2006 Spring Symposium on Distributed Plan and Schedule Management, pages 81-88, March 2006.
[9]
{9} M. L. Puterman. Markov decision processes - discrete stochastic dynamic programming. Games as a Framework for Multi-Agent Reinforcement Learning. John Wiley and Sons, Inc., New York, 1994.
[10]
{10} J. R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., 1993.
[11]
{11} A. Raja and V. Lesser. Meta-level Reasoning in Deliberative Agents. Proceedings of the International Conference on Intelligent Agent Technology (IAT 2004), pages 141-147, September 2004.
[12]
{12} A. Raja, V. Lesser, and T. Wagner. Toward Robust Agent Control in Open Environments. In Proceedings of the Fourth International Conference on Autonomous Agents, pages 84- 91, Barcelona, Catalonia, Spain, July, 2000. ACM Press.
[13]
{13} S. Russell and E. Wefald. Principles of metareasoning. In Proceedings of the First International Conference on Principles of Knowledge Representation and Reasoning, pages 400-411, 1989.
[14]
{14} S. J. Russell, D. Subramanian, and R. Parr. Provably bounded optimal agents. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence (IJCAI-93), pages 338-345, 1993.
[15]
{15} M. Schut and M. Wooldridge. The control of reasoning in resource-bounded agents. The Knowledge Engineering Review , 16(3):215-240, 2001.
[16]
{16} R. Sutton and A. Barto. Reinforcement Learning. MIT Press, 1998.
Index Terms
- The Role of Problem Classification in Online Meta-cognition
Recommendations
Reification method to encourage the learning communication on meta-cognition
KES'07/WIRN'07: Proceedings of the 11th international conference, KES 2007 and XVII Italian workshop on neural networks conference on Knowledge-based intelligent information and engineering systems: Part IIIMeta-cognition plays an important role in acquiring expertise and transferring it. We recognize the necessity of building a learning scheme for developing meta-cognitive skills but much knowledge for it has not been acquired. The reason is that it is ...
Meta-context: putting context-awareness into context
KES'11: Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part IIContext-awareness advances have evidenced novel challenges related to context management and context-awareness usability. Most of these problems can be supported through general context attributes, i.e. properties that describe issues of the context ...
Evolving agent cognition with netlogo levelspace
WSC '15: Proceedings of the 2015 Winter Simulation ConferenceAny agent-based model (ABM) involving agents that think or make decisions must inevitably have some model of agent cognition. Often, this cognitive model is incredibly simple, such as choosing actions at random or based on simple conditionals. In ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2006
742 pages
ISBN:0769527485
Sponsors
Publisher
IEEE Computer Society
United States
Publication History
Published: 18 December 2006
Check for updates
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 44Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 24 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in