Inspiration
In the current pandemic scenario there is significant increase in the use of Learning Management Systems. But one of the issues that I noticed with these systems are that they are particularly designed in such a way that only normal people could use it. This gives some difficulties for the disabled people such as the quadriplegic people. Therefore there is a need to create a Learning Management System that is accessible even by quadriplegic people.
What it does
BLI-QUAD-LEARN is a LMS based Android application that is designed for Quadriplegic people where the whole application can be accessed through voice based commands. This android application is a voice-based interface which is connected to cloud (firebase realtime-database and cloud storage) and raspberry pi (acting as a storage server) to access video lectures and notes produced by the quadriplegic people for study purposes
How we built it
The android application is built using Android Studio. The video display in the laptop screen is coded using python and opencv. The raspberry pi portion of the code is written using python. The android application and raspberry pi communicate with each other through socket communication. For the cloud, firebase realtime-database and cloud storage is used to store user data and videos.
Challenges we ran into
The main challenge I faced during building this application is integrating the speech recognition to the whole android application as the main point of command.
Accomplishments that we're proud of
Able to implement speech recognition in an android application and integrate the android application with various functionalities through cloud and raspberry pi.
What we learned
Learned a lot about speech recognition and how vast it as a domain. Learned some new types of technologies by building this application.
What's next for BLI-QUAD-LEARN
Improvising the speech recognition part of the android application to make it more accurate and can last for a long time.
Built With
- android-studio
- firebase
- firebase-cloud-storage
- java
- python
- raspberry-pi
- socket
- speechrecognizer
Log in or sign up for Devpost to join the conversation.