Vidtrix

Inspiration

Riding on powerful yet simple video files capabilities of decentralized infrastructure, we bring a unique capability out of the box on IPFS platform through exposed APIs in addition to existing playable link.

People across the globe are accepting new ways of working - in varied industries with various degrees of adaption surrounded by people, process and technologies.

Common elements to address: productivity, innovative models in different sectors and bringing attentiveness (individual level feedback, capture emotions, proactive actions and so on).

What it does

IPFS decentralized storage is a powerful platform in addressing lot of challenges around Video platform on remote ways of working be it productivity, collaboration & more. What gets missed out is which is very common in F2F mode, that is facial expressions that directly affects emotional experience.

Excited to bring this innovative Video analytics platform through this hackathon which is useful in lot of sectors.

Use Cases

• Corporates meeting videos
• Education – teacher delivering courses through Videos
• Bankers – talking to customers through any platform that generated Videos
• Doctors – basic treatment – through any platform that generated Videos
• Buy & Sell like for Insurance agents and so on and on
• Connected enterprise - Bring more effectiveness, be sentient and responsive.

How we built it

Node.js, sendgrid, app services from hyperscaler platform, Video indexer APIs

IPFS APIs enhanced to generate capabilities for below features.

1. Attentiveness analytics – highlighting multiple attributed as retrieved from Video indexer capabilities Transcript from uploaded Video on IPFS infrastructure
2. Word Cloud – This will give visual representation of text that is captured from video and the importance of each tag is shown with font size or color
3. Top Keywords used – this gives another way to represent the word cloud in simple format (refer app pictures)
4. Topics covered in the video – This segment shares insights on important aspects derived from video statistics based on participant appearance and voice in the video – We have prepared statistics based on the voice of speakers in the video. This has details about the Speakers talk to listen ratio, Speakers longest monologue, word counts and number of fragments. We have calculated this based on the advanced voice analytics technology.
5. About the participants - See the faces appeared in the video
6. Named entities - We have calculated below list of entity details based on the voice of the speakers.

All the static HTML pages are hosted on IPFS along with the images used in VIDTRIX app.

Challenges we ran into

1. Classifying video that is suitable for such analytics
2. Ensure data privacy is enabled in design and executing video to generate analytics

Accomplishments that we're proud of

1. Deepening Video analytics on diverse constructs
2. Applying power of IPFS Blockchain Storage and surrounding tech stack primarily open source
3. Validating the problem with stakeholders through empathy discussions

What we learned

Deriving intelligence from the video content. The way we have lot of NLP algorithms, this space could be explored as well.

What's next for VIDTRIX

1. Reference models that can act as patterns for users to select and apply on varied types of videos
2. Cross platform interoperability

Built With

• api
• blockchain
• cryptocurrency
• filecoin
• html5
• ipfs
• moralis
• node.js