We wanted to increase interaction between the streamer and the viewers. Twitch Sense parses through the Twitch chat messages and analyzes the sentiment of each message. Based on the aggregation of sentiment, we can change the streamer's song and play sound effects that mimic the audience's sentiment.
What's next for Twitch Sense
- Use object detection to see what's happening on the stream
- Use facial recognition to use the streamer's current facial expression as a weight in choosing an action