Advances in Sketch Understanding: Exploring Cognitive Science and AI in Design and Recognition
The AAAI Spring Symposium on Sketch Understanding delves into the intersection of cognitive science, computer vision, and human-computer interaction (HCI) in sketch recognition and applications. The workshop focuses on understanding how people utilize sketches, the nuances of recognizing detailed versus messy drawings, and leveraging AI to infer user intent. It discusses the tools, techniques, and issues involved in seamless sketch interfaces and the architectural frameworks required for effective sketch processing. Presentations will feature insights from leading researchers in the field, offering a comprehensive view of current research trends.
Advances in Sketch Understanding: Exploring Cognitive Science and AI in Design and Recognition
E N D
Presentation Transcript
Applications Architectural design Mechanical design GUI design Animators Maps & geographical information Software engineering (UML) Note-taking Sketching devices Digitizing tablet (Wacom) PDA Tablet PC Board + ultrasonic emitters Phantom AAAI Spring Symposium: Sketch Understanding Workshop • Topics • Early stages • Applications • Recognition • Tools • Cognitive issues
Current Research Issues • Cognitive Science – How do people use sketches • What do people extract from sketches • When to recognize precisely; when to be approximate • Computer Vision – Sketch capture • Better recognition, segmentation, focus of attention • Recognizing crisp sketches vs. messy sketches • AI – How to infer & represent the user’s intent • Representation, semantics, reasoning • HCI • Building a seamless interface, Combining multi-modal inputs • Creating, editing & communicating sketches • Software Architecture • Low level processing vs. domain-specific plug-ins • Common toolkits, Building an infrastructure
Best Work • Ellen Do – Architecture; Univ. of Washington http://dmg.caup.washington.edu • Fonseca et al. – Trainable recognizer; Tech. U. of Lisbon http://immi.inesc-id.pt/cali/ • Randy Davis – Simulate a mechanical sketch; MIT • James Landay – GUI Design; UC Berkeley • Mahoney & Saund – Graph representation; PARC • Ken Forbus & Ron Ferguson – Maps; Northwestern • Barbara Tversky – Cognitive issues (maps); Stanford • Phil Cohen & Sharon Oviatt – QuickSet (maps); OGI http://www.cse.ogi.edu/CHCC/Personnel/pcohen.html