Evaluating Architectures for Intelligence

A workshop affiliated with the 22nd Conference on Artificial Intelligence (AAAI-2007)

July 22-23, 2007 Vancouver, British Columbia, Canada

Hyatt Regency Vancouver Cypress Room, 34th floor


Day 1 (Sunday July 22, 2007)

Time

Title

People

09:00

09:30

Opening Remarks, Goals and Format

Burghart and Kaminka


09:30

10:30

Reflections on the AMBR project

Gluck

10:30

11:00

Break

11:00

13:00

Benchmarks and Challenges

11:00

11:30

Developing and Evaluating Cognitive Architectures with Behavioral Tests

Lane and Gobet

11:30

12:00

Benchmarks for Human-Robot Interaction (HRI) in humanoid robots

Burghart

12:00

12:30

A Gauntlet for Evaluating Cognitive Architectures

Pickett, Miner and Oates

12:30

13:00

Mid-Day Summary Discussion

13:00

14:00

1-hour Lunch

14:00

18:00

Competitions and Test-Beds

14:00

14:30

The TIELT Project

Aha

14:30

15:00

Reflections on RoboCup and Science in Competitions

Kaminka

15:00

15:30

Intelligently Engineering AI Engineering: The Cognitive Architectures Competition

Diaper, Huyck, Amavasai, Cheng, and Oussalah

15:30

16:00

Break

16:00

16:30

Evaluating Agent Architectures Using Simulation

Logan

16:30

17:00

A Testbed for Evaluation of Architectures for Physical Agents

Choi, Morgan, Park and Langley

17:00

18:00

End-of-Day Summary Discussion

18:00


Dinner


Day 2 (Monday July 23, 2007)

Time

Title

People

09:00

11:30

Philosophy

09:00

10:00

Toward a Formal Philosophy of Evaluating Architectures for Intelligence

Bringsjord

10:00

10:30

Evaluating Cognitive Models and Architectures

Halbrugge

10:30

11:00

Break

11:00

11:30

Cognitive Architectures as Revolutionary Science

Cassimatis and Bello

11:30

13:00

Metrics and Formal Methods

11:30

12:00

Formal Evaluation of Agent Architectures

Alechina and Logan

12:00

12:30

Towards an Empirical Exploration of Design Space

Hawes

12:30

13:00

Mid-Day Summary Discussion

13:00

14:00

1-hour Lunch

14:00

18:00

Metrics and Formal Methods (continued)

14:00

14:30

Architectural Factors for Intelligence

Lopez, Sanz & Hernández

14:30

15:00

Incrementality and Adaptivity Metrics for Cognitive Architectures Evaluation

Wray and Labiere

15:00

15:30

Developmental Cost for Models of Intelligence

Beal

15:30

16:00

Break


16:00

17:30

Software Engineering Methods

16:00

16:30

Evaluation of Cognitive Architectures: A Software Evaluation Perspective

Say

16:30

17:00

Evaluating Cognitive Architecutres for Unmanned Autonomous Vehicles

Hanford and Long

17:00

18:00

End-of-Day Summary Discussion

18:00


Dinner