110 likes | 212 Vues
Explore the potential of improving Whole Slide Imaging (WSI) user interface for better ergonomics and efficiency with multitouch technology. Discover challenges, testing results, and future steps in revolutionizing WSI UI design.
E N D
Mousing Around… Michael Feldman, MD, PhD feldmanm@mail.med.upenn.edu
Goal • Is there a better UI than mouse for WSI ?
Microscope • Retain ergonomics of microscope • Small motions that move mountains of data • Other hand is useful… • Focusing • Changing magnification • Fast • 400 slides per day in 10 hr day • Eyes on diagnosis field
Challenge • WSI systems today ≠ microscope • Limitations to full clinical use WSI • Total system throughput too slow • One component is UI • Validation image quality • Workflow challenges • IT integration • Storage • Streaming pixels
Multitouch screen… • DLP display • Interface - Frustrated Total Internal Reflection (FTIR) • Software • Aperio image library • Interface code (C++) • Tracking code (C++)
Multi-touch Technology • Users can directly interact with objects through touch and simple gestures. • Gestures can be used to pan and scale an image. • This creates a highly intuitive and interactive image environment.
Multi-touch Application Framework Tracking Component Interface Component Application Component (x1,y1) (x2,y2) (x3,y3) (X,Y) (L,W) (Zoom) Image Libraries
Testing • Create basic platform • Test (not rigorous) • Image quality • UI • How does it feel • Ergonomics • Simple Gestures: Pan, zoom, tap box, locate small, load work • Show movies
Results • Image quality – biggest limitation DLP • At 40-50 inches, DLP is too low resolution • UI – a lot to like • Using both your hands feels “correct” • Gestures easy to get used to • Sensitivity not there yet in our models • No haptic feedback • No variable ratio viewing yet
Next Steps • Other touch interfaces • One or two touch pads (conductive technology) • Gaming haptics • Display • Look into HD DLP but likely still not adequte • One or two large LCD’s • Software • More gestures will be needed • Variable ratio movement • More fluid touch sensitivity
Team • Drexel • Dr. Youngmoo E. Kim • Matthew Prockup • Aperio • Ole Eichorn • Pathologists • Mike Feldman – Penn • Alex Judkins – CHOP