VProfessor.ai

Upload File
Ask the professor
Relevant videos and topics from Azure Text
Automated Transcript
Architecture

Inspiration

Covid-19 forced students to virtual learning where students are struggling to interact and get timely feedback, new learnings, clarifications with the professor or friends due to various reasons
To solve the problem, we came up with web application where it helps the students and increase their speed, efficiency of learning and also get their doubts clarified with additional learnings.

What it does

VProfessor.ai contains different features designed to facilitate online learning. Users can upload a wav/mp3/ text files. Then, a transcript of the audio is returned, along with a summary of the data. This includes key words and main topics, Wikipedia page links, current events from NewsAPI, and recommended YouTube videos. From here, users can either read the summary report on the website or download it as a pdf for their personal studying. Additionally, students may "ask the professor" a question, and get a quick short answer for themselves which leverages wolframalpha api's.

How we built it

We are leveraging Azure cognitive services Speech-to-Text API and use it to convert audio/video files to a written transcript.
With Azure Text Analytics, we will generate an analysis report containing transcript, summary, and keywords.
With that keywords output, we will use the Wikipedia API, NewsAPI to generate links based on the keywords. To provide more information, we will also create a system to search recommended YouTube videos based on a search query, which used the YouTube-Data API.
We are using Azure Blob Storage to store video/audio files.
An additional feature of "ask the professor" is provided to users, where users can search any questions or doubts, it fetches the answer from wolframalpha api and displays to user.
We are hosting the app using Azure App Service to host backend and web app.

Architecture

https://github.com/Manikant92/VProfessor.ai-EducateHacks/blob/main/Architecture.PNG

Challenges we ran into

Learning Azure functionalities as I have little experience there.
Understanding youtube data api became little hectic and difficult.
Using video functionality. Hence, we moved this feature to future scope.

Impact

It creates a wide impact and provides huge benefits to all Students due to Virtual mode of learning during Covid-19.
It saves students time and effort where they can get all information at one place.
It increases efficiency of students/users.
It improves speed of learning.
A one stop app which integrates with multiples api's and makes it easy for students for learning.