Internet Thoughts (Sentiment Analytics)

Sophisticated sentiment analysis of people's messages and comments on major social media platforms

Comment

Internet Thoughts

alt text

LIVE DEMO: https://internet-thoughts.herokuapp.com/

Ever wonder what the internet thinks about a certain topic, issue, or person? Well, what better way to gauge the internet's popular opinion than through the viral forces of social media platforms such as Twitter, Reddit, and Tumblr! Just enter a search query you are curious about on our site and a sentiment analysis of hundreds of tweets and comments in relation to that topic will be returned to you. Find out where you stand amongst the rest of the world!

The magic behind it all:

A custom sentiment analysis engine

   ->We used a custom corpus with support for emojis and slang
   ->Written in JS

Twitter API

   -> Fetched hundreds of tweets from a search query
   -> Parsed the tweets for use with sentiment analysis engine    ->Written in NodeJS

Backend

   ->Infrastructure in NodeJs, Js

Frontend

   ->CSS
   ->HTML

TODO

Different Platform Info

--do for monthly data after []finish bar (results page) []frequent words wordmap

[]graphs

  • requires info through different platforms

[x]hosting

  • domain + host

[]presentation

[]main page - decide about navbar []database

  • long term data analysis, store in database, different platforms

[]context

  • couont emojiis (results.Ejs)
  • count explanation marks
  • count cases (before converting to lowercase for corpus) - engine.Jst here to convert case
Share this project:

Updates

posted an update —

Internet Thoughts

alt text

LIVE: http://internetthoughts.net/

Ever wonder what the internet thinks about a certain topic, issue, or person? Well, what better way to gauge the internet's popular opinion than by mass analyzing things said about that topic? Just enter a search query and a sentiment analysis of tons of data in relation to that topic will be returned to you. Find out where you stand amongst the internet! Internet-thoughts was built for YHack 2016 at Yale University.

Team

  • Robert Xu |
  • Jonathan Sun | jonathon.solar
  • Tash-had Saqif | tash-had.com

The magic behind it all

A custom sentiment analysis engine

  • We built our own engine to analyze sentiment in the data we fetched
  • Data is analyzed using a Corpus
  • Engine accounts for slang, emoji's, compound words

Twitter, Reddit & Tumblr API's

  • Fetched the most popular tweets, reddit comments and Tumblr posts matching the query, from the last 7 days.
  • Parsed the data from the respective platforms for use with sentiment analysis engine
  • Platforms chosen specifically to ensure diverse demographic (age groups)

Technologies

  • NodeJs, JavaScript, Embedded JavaScript, jQuery, PaperScript, HTMl, CSS, Heroku (hosting)

TODO

  • Save data to database for analysis of change over time
  • Frequent words Wordmap
  • Context
    • Count exclamation marks
    • Count consecutively repeated letters
    • Compare with long term data from database
    • Use data from movie reviews, other sources
    • Use data from surely positive/surely negative sources (positive news, etc)
    • Use letter cases before converting to lowercase

License

Internet-thoughts is licensed under MIT

Log in or sign up for Devpost to join the conversation.