290 likes | 409 Vues
This paper discusses a novel approach to evaluate visualization algorithms using purpose-driven games as tools for human computation. It emphasizes the importance of human perception in interpreting visual data, which outpaces computer capabilities. Through a game-based evaluation method, the authors aim to collect vast amounts of perception data efficiently and robustly. With insights derived from player interactions, the findings inform algorithm optimizations and future designs, paving the way for enhanced visualization techniques that align with human cognitive abilities.
E N D
HUMAN COMPUTATIONIN VISUALIZATION:USING PURPOSE DRIVEN GAMESFOR ROBUST EVALUATION OF VISUALIZATION ALGORITHMS NAFEES AHMED, ZIYI ZHENG, KLAUS MUELLER VISUAL ANALYTICS AND IMAGING LAB DEPT OF COMPUTER SCIENCE
HUMAN COMPUTATION • Relevance in visualization • AN Example: Disguise • Findings • Future thoughts
human Computation WHAT & WHY?
? Crowd sourcing VizWiz Soylent
? PURPOSE DRIVEN games ESP Game Tag a tune verbosity fold.it Ete-RNA Phylo Eye-wire
HUMAN COMPUTERSin VISUALIZATION WHY DOES IT MAKE SENSE?
VISUALIZATION Creates Understandable and Meaningful pictures from data Human brain and vision In analyzing pictures and patterns still far better than any computers
VISUALIZATION rendering RAWData PreparedData FocusData GeometricData ImageData DataAnalysis Filtering Mapping Rendering VISUALIZATION DESIGN Image Data RAWData Design/SelectCandidate Visualize Data Finalized Method Not Satisfactory Evaluate Satisfactory
Evaluation of visualization • User evaluation • controlled environment • Cost • Small number of samples • Crowd sourced • Noisy data • Cost
evaluation:using an online game Design, implementation and findings
problem Disc A has color Disc B has color When A is on top of B we perceive a blend Transparency perception ability to perceive the ordering given the blended color Evaluate blending algorithm In terms of transparency perception
Algorithms Porter & Duff Hue Preserving Local blending with blurring Local blending [Wang 09] [Porter 84] [Chuang 09]
correctness SCORE SCORE INTRUDER OVER COLLECTOR HITINTRUDER NO ACTION INTRUDER EXPLODES ANY STATE HEALTH HEALTH SCORE SCORE COLLECTOROVER INTRUDER HITINTRUDER CLICK EMPTY SPACE ANY STATE HEALTH HEALTH SCORE ANY STATE HITCOLLECTOR HEALTH
correctness • PLAYERS try to Optimize score • Score only improves with correct guessing of order • Each click gives us feedback about human perception of transparency ordering
observations Playabilitywithin 15 days of launch…261 players30,000+ data-points generated.
observations Data collection speed14.6 clicks per minute1000 players x 24hr playtime= 21 million data points!
observations costonce developed and deployedalmost FREE!
observations Data qualityProvides much less noisy data thanother web-based methods. trying to optimize score, not earning! Extent of data-points collected
observations limitationsTIME TO DEVELOPensuring correctness and funMAKING IT POPULAR
Future thoughts Ideas, motivations
Future thoughts INTEGRATION WITH A LEARNING AGENT FOR ADAPTIVE DESIGN OF NEW ALGORITHMS
Future thoughts OPTIMIZATION OF VISUALIZATION PARAMETERS (transfer functions/ view angles)
http://vail.cewit.stonybrook.edu/Projects/HPU/Disguise THANK you Ziyizhengzizhen@cs.stonybrook.edu www.cs.sunysb.edu/~zizhen/ NAFEES AHMEDnuahmed@cs.stonybrook.eduwww.kuntal.name Klaus muellermueller@cs.stonybrook.edu www.cs.sunysb.edu/~mueller/ VISUAL ANALYTICS AND IMAGING LAB DEPT OF COMPUTER SCIENCE