LumiOS

Meet LumiOS: your AI personal assistant that remembers, understands, and manages your digital world, round the clock. Your life, simplified and illuminated.

Comment 1

Inspiration

This project, Illuminate, was born from my vision to advance the AI revolution and make AI an integral part of daily life. My dissatisfaction with current AI implementations and their superficial integration with our day-to-day applications led me to dream bigger. The movie 'Her' served as a key inspiration, captivating me with its portrayal of technological advancement through minimalistic and pure form of interaction - speech.

Building the Project

Working on Illuminate's core, LumiOS, I seek to actualize this vision. The goal is to create a personal AI combined with an AI operating system, capable of retaining all our interactions and integrating seamlessly with various applications. This project provides a perfect platform for me to expand my knowledge in Flutter and NestJS. While using Flutter for building the frontend, I delved into the intricacies of Riverpod's provider system. Meanwhile, NestJS allowed me to experiment with a new architectural design, combining Domain Driven Design, Clean Architecture, and Event Driven Architecture.

Challenges

The journey was not without its fair share of challenges. Issues with websocket instabilities provided significant hurdles, as did the steep learning curve associated with setting up a Continuous Deployment pipeline using Google Cloud and GitHub actions. These experiences, though testing, contributed immensely to my growth as a developer.

Reflection

Despite these obstacles, the overwhelming realization was that the vision of LumiOS is very much achievable with current technologies. This project has reinforced my belief that we are on the cusp of a radical transformation in the way we interact with technology, a transformation that will redefine our experiences in the years to come.

What's Next for LumiOS

The journey of LumiOS is far from complete. My next big step is to introduce a speech interface to enhance user interaction, following which I plan on expanding its capabilities further. This includes adding access to emails, calendars, and the internet for research purposes, moving beyond the constraints of a mere chat-based interface. The ultimate goal is to continue to build on this idea, to drive deeper integration and create an AI that truly understands and complements the user's lifestyle.

Built With

Share this project:

Updates

posted an update —

Update - August 5, 2023

Hello LumiOS users!

We've been hard at work and have made some exciting updates to LumiOS. Here's what's new:

  1. Updated Overview Video: We've updated our overview video to give you a comprehensive guide to LumiOS. The video is now 7 minutes long and can be accessed here.

  2. Explicit Remembering: LumiOS can now explicitly remember information you've shared. Simply ask, "Do you remember ...?", and watch as LumiOS recalls past interactions with ease.

  3. Function Execution Markers: To ensure transparency, we've added markers to indicate when a function has been executed. This way, you always know what your AI assistant is doing.

  4. Admin View for Message Analysis: While this feature isn't available to users, we wanted to highlight how we're using TIDB's HTAP capability. We've developed an Admin View to analyse keywords across all user messages. This will help us understand user interactions and improve the system.

Unfortunately, in the process of these updates, we ran into a technical issue related to incorrect storage of summaries. To rectify this issue, we had to wipe all user data. We understand that this might have caused inconvenience and we deeply apologize for the disruption. Please remember, LumiOS is still a prototype and such issues, while unfortunate, help us learn and improve.

Stay tuned for more exciting updates!

Log in or sign up for Devpost to join the conversation.

posted an update —

Update - July 23, 2023

We're excited to bring you the latest development in our project, LumiOS - the Speech Interface! With this new update, your AI assistant just got even more interactive. You can now hold a conversation with LumiOS just by speaking to it.

We've uploaded an update video to guide you through this new feature. Watch the video here to see the speech interface in action.

As we continue to develop LumiOS, your feedback is essential. Feel free to share your thoughts and suggestions in the comments. We are eager to improve LumiOS based on the needs of you.

Stay tuned for more updates!

Log in or sign up for Devpost to join the conversation.