330 likes | 336 Vues
Resolving Ambiguities to Create a Natural Sketching Environment. Christine Alvarado and Randall Davis MIT AI Laboratory. Our Model. The Designer Sketches with Pen and Paper The Observer Interprets the Sketch The Observer and Designer Interact. Sketch Interpretation. Accuracy vs. Freedom.
E N D
Resolving Ambiguities to Create a Natural Sketching Environment Christine Alvarado and Randall Davis MIT AI Laboratory
Our Model • The Designer Sketches with Pen and Paper • The Observer Interprets the Sketch • The Observer and Designer Interact Christine Alvarado
Sketch Interpretation Christine Alvarado
Accuracy vs. Freedom Free Sketch ASSIST Single Stroke Recognition Recognition Difficulty “Put That There” Menu Drawing Freedom Christine Alvarado
Smarter interpretation increases accuracy Better interaction design increases perceived freedom Accuracy and Freedom Christine Alvarado
Levels of Interpretation Fluid Interpretation Commitment to an Interpretation Resolving Ambiguities Christine Alvarado
3 Stages of Interpretation • Recognition • Reasoning • Resolution Christine Alvarado
Generate All Possible Interpretations: Circle Circular Body Pin Joint Recognition Christine Alvarado
Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback Reasoning: Heuristics Christine Alvarado
Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback Reasoning: Heuristics Christine Alvarado
Temporal Evidence Simpler Is Better Context Domain Knowledge User Feedback Reasoning: Heuristics 1 arrow or 3 rods? Christine Alvarado
Reasoning: Heuristics • Temporal Evidence • Simpler Is Better • Context • Domain Knowledge • User Feedback Christine Alvarado
Reasoning: Heuristics • Temporal Evidence • Simpler Is Better • Context • Domain Knowledge • User Feedback Christine Alvarado
Reasoning: Heuristics • Temporal Evidence • Simpler Is Better • Context • Domain Knowledge • User Feedback Christine Alvarado
Reasoning: Heuristics • Temporal Evidence • Simpler Is Better • Context • Domain Knowledge • User Feedback Total Score Christine Alvarado
Resolution Christine Alvarado
Resolution 0 6 3 Christine Alvarado
Resolution 0 6 3 Christine Alvarado
Resolution 0 0 10 10 5 5 Christine Alvarado
Resolution 0 0 10 10 5 5 Christine Alvarado
Resolution 0 0 0 0 6 6 6 6 3 3 3 3 Christine Alvarado 10
Resolution 0 0 0 0 6 6 6 6 3 3 3 3 Christine Alvarado 10
Resolution 0 0 0 0 0 6 6 6 6 6 3 3 3 3 3 8 Christine Alvarado 10
Resolution 0 0 0 0 0 6 6 6 6 6 3 3 3 3 3 8 Christine Alvarado 10
Resolution 0 0 0 0 0 6 6 6 6 6 3 3 3 3 3 8 Christine Alvarado 10
??? line line line Limitations • Relies heavily on bottom-up recognition Line + Line + Line + ??? ??? Christine Alvarado
Limitations • Relies heavily on bottom-up recognition • Heuristics all weighted equally H1: Prefer interpretations resulting in fewer objects H2: Prefer objects drawn with contiguous strokes Christine Alvarado
Limitations • Relies heavily on bottom-up recognition • Heuristics all weighted equally H1: Prefer interpretations resulting in fewer objects H2: Prefer objects drawn with contiguous strokes Christine Alvarado
Limitations • Relies heavily on bottom-up recognition • Heuristics all weighted equally H1: Prefer interpretations resulting in fewer objects H2: Prefer objects drawn with contiguous strokes Christine Alvarado
Structured Application of Context • Blackboard recognition architecture • Heuristics applied probabilistically Christine Alvarado
Body(b1) Polygon(p1) Connects(l5, l6) Connects(l6, l7) Line(l6) Recognition Blackboard Blackboard Forces push bodies Force(f1) Sketch Arrow(a1) Connects(l1, l2) Connects(l4, l5) Connects(l1, l2) Connects(l7, l4) Connects(l1, l2) Line(l1) Line(l2) Line(l3) Line(l4) Line(l5) Line(l7) Stroke(s1) Stroke(s2) Stroke(s3) Stroke(s4) Stroke(s5) Stroke(s6) Stroke(s7) Christine Alvarado
Bayesian Network Structure Heuristics influence prior … Property1 Property2 Line1 Line2 Line3 … Low-level information influences recognition Christine Alvarado
Related Work • Gross and Do (1996) • Landay and Meyers (2001) • Stahovich (1998) • Matsakis (1999) Christine Alvarado