1 / 6

Extending the Soar Cognitive Architecture

Extending the Soar Cognitive Architecture. John E. Laird University of Michigan AGI Conference March 1, 2008. http://sitemaker.umich.edu/soar/home. Extending Soar. Symbolic Long-Term Memories. Learn from internal rewards Reinforcement learning Learn facts What you know Semantic memory

sanjuana
Télécharger la présentation

Extending the Soar Cognitive Architecture

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Extending the Soar Cognitive Architecture John E. Laird University of Michigan AGI Conference March 1, 2008 http://sitemaker.umich.edu/soar/home

  2. Extending Soar Symbolic Long-Term Memories • Learn from internal rewards • Reinforcement learning • Learn facts • What you know • Semantic memory • Learn events and situtations • What you remember • Episodic memory • Basic drives and … • Emotions, feelings, mood • Non-symbolic reasoning • Mental imagery • Learn from regularities • Spatial and temporal clusters Procedural Episodic Episodic Semantic Semantic Chunking Semantic Learning Semantic Learning Episodic Learning Episodic Learning Reinforcement Learning Reinforcement Learning Symbolic Short-Term Memory Decision Procedure Appraisal Detector Appraisal Detector Perception Action Visual Imagery Visual Imagery Clustering Clustering Body

  3. Select Operator Apply Operator Elaborate State Elaborate Operator Input Apply Output Propose Operators Evaluate Operators Soar Processing Cycle Decide Manipulate Visual Imagery Create Motor Commands Query Semantic, Episodic Memory, Visual Imagery Perception Rules Impasse Subgoal

  4. Theoretical Commitments Stayed the Same Changed Multiple long-term memories Multiple learning mechanisms Modality-specific representations & processing Non-symbolic processing Symbol generation (clustering) Control (numeric preferences) Learning Control (reinforcement learning) Intrinsic reward (appraisals) Aid memory retrieval (WM activation) Non-symbolic reasoning (visual imagery) • Problem Space Computational Model • Long-term & short-term memories • Associative procedural knowledge • Fixed decision procedure • Impasse-driven reasoning • Incremental, experience-driven learning • No task-specific modules

  5. Upcoming Challenges • Continued refinement and integration • Integrate with complex perception and motor systems • Adding/learning lots of world knowledge • Language, Spatial, Temporal Reasoning, … • Scaling up to large bodies of knowledge

  6. Thanks to Funding Agencies: NSF, DARPA, ONR Ph.D. students: Nate Derbinsky, Nicholas Gorski, Scott Lathrop, Robert Marinier, Andrew Nuxoll, Yongjia Wang, Samuel Wintermute, Joseph Xu Research Programmers: Karen Coulter, Jonathan Voigt Continued inspiration: Allen Newell

More Related