-
Logo (WIP)
Inspiration
The inspiration for ThoughtSpeak arose from personal experiences caring for multiple family members who are non-verbal. Witnessing their struggles to communicate even the most basic needs highlighted a significant gap in patient care. Their urgent and underserved needs motivated me to develop a practical and life-saving solution that could bridge the communication gap and enhance their quality of life.
What It Does
ThoughtSpeak is a communication aid designed for non-verbal and incapacitated patients. Leveraging the Neurosity Crown Brain-Computer Interface (BCI), the application detects specific thought commands trained by the patient. These commands are processed through OpenAI's API, and the Flux image generation model creates visual representations of the patient's needs. The generated images are instantly delivered to the caretaker's mobile device via SMS or push notifications, enabling immediate and informed responses without requiring any physical interaction from the patient.
How We Built It
The project was built using the Neurosity Crown BCI and its SDK to detect and interpret neural signals associated with specific thought commands. We integrated OpenAI's API to process these commands and utilized the Flux image generation model to create accurate visual representations. The web application was developed using NextJS for server-side rendering, Tailwind CSS for styling, and ShadCN UI components for a responsive and intuitive user interface. Real-time notifications were implemented using Twilio for SMS delivery and Firebase for push notifications.
Challenges We Ran Into
One of the main challenges was accurately detecting and interpreting the neural signals corresponding to specific thought commands, as individual brain patterns can vary significantly. Ensuring the system's reliability and minimizing false positives required extensive training and fine-tuning. Integrating multiple technologies—BCI hardware, AI processing, image generation, and notification systems—into a seamless and efficient workflow also posed technical hurdles. Additionally, maintaining data security and compliance with healthcare privacy regulations was crucial and necessitated careful planning and implementation.
Accomplishments That We're Proud Of
We're proud to have developed a functional prototype that successfully bridges the communication gap for non-verbal patients. Achieving real-time thought command detection and delivering instant visual alerts to caretakers without any physical interaction is a significant milestone. The potential of ThoughtSpeak to provide life-saving improvements in patient care and enhance the quality of life for both patients and caretakers is an accomplishment that motivates us to continue refining the solution.
What We Learned
This project provided valuable insights into brain-computer interface technology and the complexities involved in neural signal processing. We learned about the importance of user-centered design, especially when developing solutions for vulnerable populations. The experience also deepened our understanding of integrating AI models into practical applications and highlighted the critical nature of data security and compliance in healthcare technology.
What's Next for ThoughtSpeak
The next steps for ThoughtSpeak include expanding the library of thought commands and improving personalization to adapt to each patient's unique neural patterns. We aim to enhance the caretaker dashboard with more features for managing notifications and monitoring patient activity. Exploring partnerships with healthcare providers and conducting clinical trials will be essential for validating the solution's effectiveness. Ultimately, we plan to make ThoughtSpeak widely accessible to revolutionize communication for non-verbal and incapacitated patients globally.
Log in or sign up for Devpost to join the conversation.