1 / 12

Sentiment analysis on social media

Sentiment analysis on social media. ASDARS. ASDARS. ASDARS Big Data Sentiment Analysis. Big data. High Volume Hadoop. twitter. Data filters Hashtags Metadata Influencers Bad data 2016 Presidential Campaign

philippa
Télécharger la présentation

Sentiment analysis on social media

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Sentiment analysis on social media ASDARS

  2. ASDARS • ASDARS • Big Data • SentimentAnalysis

  3. Big data • High Volume • Hadoop

  4. twitter • Data filters • Hashtags • Metadata • Influencers • Bad data • 2016 PresidentialCampaign • Cynk (How a company with one employee, no assets, and $0.00 revenue, got a $6 billion market value and blew up) • BotOrNot

  5. asdars

  6. BiG data pipeline, v1 • Flume: Sources, Sinks, Channels • Oozie: Job Scheduler • Hive: DistributedStorage, SQL

  7. Machine learning • Classification Algorithms: polarity detection • Naive Bayes, SVM, SGD, Random Forests • Labeled datasets

  8. training • Clean Up: remove html characters; remove stopwords • Word Stemming • Unigrams and Bigrams • Bag of Words/TF-IDF

  9. Evaluation, train/test 80/20 ROC Curve ConfusionMatrix

  10. Results

  11. Model update OOV Hive Classify New Data Label Train Evaluate Update

  12. Next steps Bag of Words – Word Embeddings

More Related