EdQty

video page
timestamp
txt page
Dain Butterfly Challenge

Inspiration

EdQty is your Gateway to Limitless Learning.

As international students, we often encounter language barriers that can drastically impact our understanding of core concepts. Imagine starting a lecture and stumbling over a single unfamiliar term; that one word can make it challenging to follow the entire session. For students with learning disabilities, these obstacles are compounded—focusing through lengthy lectures or deciphering complex readings becomes an even greater struggle.

These shared experiences inspired us to reimagine the learning process through a tool designed to be more interactive and accessible for everyone. EdQty aims to break down language boundaries and cater to diverse learning needs, offering real-time language support, engaging interactive features, and adaptive learning methods. Our mission is to empower every student—whether facing language barriers or learning challenges—to grasp concepts effectively and confidently.

Our vision is that academic progress should never be obstructed by linguistic difficulties or learning disabilities. EdQty enhances the learning experience, making it inclusive and supportive, promoting engagement and success for a diverse community of students.

What It Does

EdQty is a revolutionary learning tool crafted to dismantle educational barriers for international students and those with learning disabilities. By recognizing the unique challenges faced by students with dyslexia, ADHD, and non-native speakers, we designed our product to create a truly inclusive learning environment.

At the core of EdQty lies a suite of personalized features that redefine the learning journey. Our time-stamped video Q&A feature allows students to pause and engage with content at any point, promoting understanding through interaction with multi-modal material. Integrated text-to-speech and visual aids cater to different learning styles, while an in-built knowledge base delivers context and clarity as needed. These features are designed to make learning accessible and tailored to individual needs.

But EdQty goes beyond simple language translation. Our tool embraces cultural diversity, supporting students in both academic and everyday settings. Whether students are trying to understand complex lecture material or navigate social interactions in a new cultural environment, EdQty equips them with the resources they need. Through confidence-building support and inclusive design, we aim to foster belonging and inclusion, creating a world where learning is a shared experience, accessible to all.

Key Features:

Real-Time Multilingual Translation, Captioning, and Summarization: Instantly translates and summarizes content from various sources into the user's preferred language. Also provides captions for videos in your preferred language and accurate and concise representations that could make it much more convenient than large PDFs and long videos in a foreign language.
Interactive AI Q&A for Deeper Understanding: Allows users to ask specific questions about content, request simplified explanations, and make connections across topics.
Saved Database of Summaries and Notes: A personal repository for organizing and revisiting study materials.
Enhanced Note-Taking and Annotation: Enables highlighting, personal note addition, and direct linking to specific materials.
Daily Life and Social interactions assistance: Offers real-time translations for menus, signs, and product labels, along with cultural insights to ease navigation in new environments.
Time-Stamped Video Q&A: Enables interaction with video content at any specific point, enhancing engagement and understanding.
Generating flashcards, quizzes, and notes, maintaining a summary of the content covered so far as you go through long-form content, allowing you to ask doubts as you go about the content.
Potential inclusions: Visualization aids to enhance understanding when dealing with complex concepts through imagery and animations.

How we built it

For our Edqty demo, we leveraged generative AI models, including large language models (LLMs) like LLaMA 3.2 for natural language processing and a conversational interface and OpenAI's Whisper for accurate audio-to-text conversion. The LangChain framework supports workflow management and coordination between models, while Ollama enables efficient deployment and scaling. Together with a React-based front end and Flask back end, this setup creates a seamless, interactive experience that showcases Edqty's capabilities in delivering personalized, responsive learning support.

We used MongoDB as our database. MongoDB Atlas provides an easily interactable and syncing cloud database to maintain the personalized learning data lake which allows us to upload our learning material in any format and the message history to maintain context across the conversation.

Challenges We Faced

Our team embarked on this journey with a steep learning curve ahead: none of us had prior experience with React. Integrating the front-end and back-end required patience, determination, and a lot of Googling! We built this app in a 24-hour period which while exhausting, was an interesting experience in itself. We pushed through, relying on each other for encouragement and support, and taking brief moments to recharge before diving back into the code.

Accomplishments We’re Proud Of

In the span of just 24 hours, we took our idea from a blank page to a working product w hichsolves a real-life problem that resonated with all of us. We’re incredibly proud of not only building a functioning demo but doing so with a full-stack approach—seamlessly linking our front-end and back-end with interactive elements. None of us had done something like this before, so seeing our code come together into a working product felt like a huge accomplishment. We all had to learn on the spot, expanding our skills as we encountered new challenges. What we created wasn’t just a project; it was proof of what a team of beginners and intermediates can accomplish in a single day when we’re focused, driven, and willing to tackle the problems as they come up.

What We Learned

At the start, we had no shortage of ideas, each of us inspired by different angles and possibilities. Our brainstorming sessions were filled with excitement, and we had countless directions we could take. Through deep discussions and debates, we narrowed down our options, aiming for a project that was practical and impactful. While we initially envisioned building something for a broad audience, we realized that we could create more value by focusing on a specific group and including thoughtful accessibility features. This shift in thinking allowed us to focus on creating something meaningful and highly relevant rather than trying to include every possible feature.

Integrating back-end functionality with a user-friendly front-end was no small feat, but it was a rewarding challenge that deepened our understanding of full-stack development. Perhaps one of the most valuable lessons was the importance of teamwork. By dividing tasks based on our strengths and weaknesses, we created a learning environment where everyone could contribute and grow. Beginners gained technical skills and insights from the intermediates, while the intermediates often saw things from fresh perspectives when addressing questions from the beginners. Our collaborative approach allowed us to not only build a product but also foster a supportive space for learning, troubleshooting, and continuous feedback.

Throughout the development process, we also became more aware of our project’s potential impact. Every feature refinement required us to think carefully about our users’ needs and experiences. As we developed more targeted features and considered client accessibility, we felt a growing responsibility to create something that could genuinely enhance the learning experience for our audience.

What's Next for EdQty

The MVP we built in 24 hours is just the beginning. We’re excited to iterate on our initial product, making it more robust and user-friendly. Moving forward, we plan to enhance features like cultural translation accuracy to ensure our program resonates with diverse users. We’re also envisioning interactive tools, dynamic graphs, and seamless integrations with third-party education platforms like Quizlet and Zoom to make the learning experience more engaging.

Beyond feature development, we aim to conduct customer discovery to gain a deeper understanding of our users’ needs and preferences. Our goal is to build a tool that doesn’t just teach but makes learning easier and more enjoyable. Ultimately, we want EdQty to be a powerful, accessible resource for anyone looking to learn and explore their curiosities.