200 likes | 355 Vues
The role of context in. Dag Elgesem & Dept. of Information Science and Media. in image interpretation. & Joan Nordbotten Media Science, University of Bergen. 1. Mobile Phone Visual Queries. Image + GPS + time. 3. Resolving Ambiguity. Our approach: based on: Object identification
E N D
The role of context in Dag Elgesem & Dept. of Information Science and Media
in image interpretation & Joan Nordbotten Media Science, University of Bergen
1 Mobile Phone Visual Queries Image + GPS + time
3 Resolving Ambiguity Our approach: based on: • Object identification • Location information • Intention probabilities
5 CONTEXT The information that must be common knowledge between user and system for communication to succeed.
Events, history Probalilities 7 MMIR:Mobile Multi-modal Information Retrieval Known objects MMIR ..... ......
2 But, what is the question? • Foreground/background: • The sailboat? Statsraad Lemkul • The wharf? Bryggen i Bergen • Whole/component: • The cathedral? Nidaros Domkirken • The statues?
4 Visual query interpretation MMIR Decision Tree p1 Statsraad Lemkul ... Bryggen ... p2 p3 Other
6 Elements of common knowledge • Object representation • Image structures –> real world objects • Interpretation options • Option probilities
8 Summary Given • A set of non-ambigous images with • Location(s) for source photos and • An effort value for each location Than • Map query object(s) to stored images • Determine probability of intended query
Context Aware Image management VERDIKT: pr.nr.