270 likes | 390 Vues
This research discusses a method for assessing vast amounts of user-generated geospatial narratives, particularly travel blogs and diaries. It outlines a multi-step process utilizing geocoding, opinion coding, and visualization techniques to create geospatial opinion maps. The process involves web crawling for data collection, linguistic preprocessing, and sentiment analysis to correlate user opinions with specific locations. By aggregating sentiments from over 150,000 travel-related articles, this approach provides a new way to visualize the emotional landscape of travel narratives, aiding both researchers and travelers.
E N D
Opinion Mapping Travelblogs EfthymiosDrymonas AlexandrosEfentakis Dieter Pfoser Research Center Athena Institute for the Management of Information Systems Athens, Greece http://www.imis.athena-innovation.gr
Introduction Users create vast amounts of “geospatial” narratives …travel diaries, travel blogs… How to quickly assess them?
Motivation • Simple assessment of user-generated geospatial content • Visualization • Geospatial opinion maps
Opinion Mapping generating steps • Relating text to location – Geocoding • Relating user sentiment to text – Opinion Coding • Relating opinions to location – Opinion Mapping
1. Relating text to location – Geocoding • Web crawling • Geoparsing • Geocoding
1a. Web Crawling • Crawled for travel blog articles • Parsed ~ 150k HTML documents
1b. Geoparsing -Processing Pipeline Overview • GATE • Cafetiere IE system • YAHOO! API • Placemaker • Placefinder
1b. Linguistic Preprocessing • Tokeniser & Orthographic Analyser • Sentence Splitter • POS Tagger • Morphological Analysis, WordNet • Ex. “went south”, “goes south” = “go south”
1b. Semantic Analysis: i. Ontology Lookup Ontology access to retrieve potential semantic class information
1b. Semantic Analysis: ii. Feature Extraction (IE engine) • Compilation of semantic analysis rules • IE engine uses all previous info • Linguistic information (POS tags, orthographic info etc.) • Semantic and context information • Extraction of spatial objects
1c. PostProcessor - Geocoding • Collecting semantic analysis results and annotating them to the original text • Preparing the input to the geocoder module
1c. Geocoding • Place name info from semantic analysis transformed to coordinates • YAHOO! Placemaker for disambiguation • YAHOO! Placefindergeocoder
output XML file • From plain text to structured information • Also global document info extracted
2. Relating user sentiment to text– Opinion Coding 1/2 • OpinionFinder tool • Annotates text with positive or negative sentiments • Retain paragraphs only containing spatial info • Total positive and negative sentiments for each paragraph
2. Relating user sentiment to text– Opinion Coding 2/2 • Score for this paragraph : +2
3. Mapping opinions to location -Opinion Mapping Scoring method Spatial grid Aggregation method
Opinion Mapping (Scoring) • Each paragraph is characterized by a MBR • Visualized paragraph’s MBR do not exceed 0.5º x 0.5º • Each paragraph’s MBR is mapped to a sentiment color according to users’ opinions
Opinion Mapping (Issues) Problem: • Multiple paragraphs may partially target the same area (overlapping areas) • How to visualize partially overlapping MBRs of different paragraphs and sentiments
Opinion Mapping (Spatial grid) Solution: • We split earth into small tiles of 0.0045º x 0.0045º (~500m x 500m) • Each paragraph’s MBR consists of several such small tiles
Opinion Mapping (Aggregation Method) 1/2 • Partially overlapping paragraph MBRs translated to a set of overlapping tiles • Sentiment aggregation per tile (for drawing purposes) • Instead of sentiment aggregation per MBR
Opinion Mapping (Aggregation Method) 2/2 An example: • For one cell/tile there are four scores: -1, -2, 1, 0 • Resulting score is their sum: -2
Opinion Mapping examples Original MBRs of paragraphs
Opinion Mapping examples Paragraph MBRs divided in tiles – Aggregation per tile
Opinion Mapping examples Final result
Conclusions • Aggregating opinions is important for utilizing and assessing user-generated content • Total of more than 150k web pages/articles were processed • Sentiment information from various articles is aggregated and visualized • Relate portions of texts to locations • Geospatial opinion-map based on user-contributed information
Future Work • Better approach on sentiment analysis • More in-depth analysis of the results • Examine micro blogging content streams • Live updated sentiment information