Inspiration
We introduce a unique capability out of the box on the IPFS platform through public APIs in addition to the existing playable link, capitalising on the robust yet straightforward video files capabilities of decentralised infrastructure.
People all over the world are embracing new working practises in a variety of industries with varying degrees of acculturation to the people, processes, and technologies around them.
Productivity, new business models across industries, and raising awareness are common issues that need to be addressed (individual level feedback, capture emotions, proactive actions and so on).
What it does
In terms of productivity, cooperation, and other issues related to video platforms for remote working, IPFS decentralised storage is a strong platform. Facial expressions, which frequently occur in face-to-face communication (F2F), are often overlooked but have a significant impact on emotional experience.
We are thrilled to introduce this cutting-edge video analytics software through this hackathon, which is beneficial in many industries.
Use Cases
Corporates meeting videos Education – teacher delivering courses through Videos Bankers – talking to customers through any platform that generated Videos Doctors – basic treatment – through any platform that generated Videos Buy & Sell like for Insurance agents and so on and on Connected enterprise - Bring more effectiveness, be sentient and responsive.
How we built it
Node.js, sendgrid, app services from hyperscaler platform, Video indexer APIs
The application infrastructure is hosted on AWS. We have containerized our application and we will use the docker image to run on AWS managed container environment. We are having the cloud formation templates ready to create our infrastructure and it will work in below process.
IPFS APIs enhanced to generate capabilities for below features.
Attentiveness analytics – highlighting multiple attributed as retrieved from Video indexer capabilities Transcript from uploaded Video on IPFS infrastructure Word Cloud – This will give visual representation of text that is captured from video and the importance of each tag is shown with font size or color Top Keywords used – this gives another way to represent the word cloud in simple format (refer app pictures) Topics covered in the video – This segment shares insights on important aspects derived from video statistics based on participant appearance and voice in the video – We have prepared statistics based on the voice of speakers in the video. This has details about the Speakers talk to listen ratio, Speakers longest monologue, word counts and number of fragments. We have calculated this based on the advanced voice analytics technology. About the participants - See the faces appeared in the video Named entities - We have calculated below list of entity details based on the voice of the speakers.
Along with the graphics used in the VIDTRIX app, all static HTML pages are hosted on IPFS.
Challenges we ran into
a)Classifying video that is suitable for such analytics b)Ensure data privacy is enabled in design and executing video to generate analytics
Accomplishments that we're proud of
a)video analytics research on several constructs b)utilising the IPFS Blockchain Storage and the surrounding, mostly open source technology c)Validating the issue with stakeholders through conversations based on empathy
What we learned
Gaining knowledge from the video's subject matter. Given the abundance of NLP algorithms available, this area might also be investigated.
What's next for Video Analytics
- Reference models that can act as patterns for users to select and apply on varied types of videos
- Cross platform interoperability
Log in or sign up for Devpost to join the conversation.