ALICE

Why not automate everything

Comment

Inspiration

My Inspiration was out of blue, While making a project in internal UNI hackathon using AI tools for Brainstorming and implementations, The idea struck to me that if AI tools are able to code efficiently and are having reasoning capabilities, why don't we have any AI system which can take control of our entire system and execute the actions to achieve A goal given by the user, by which we can take the Automation to a whole different level and maximizing the productivity of completing tasks in given time constraints, while still discussing about the consequences of its actions with the users for a secure and safe workflow

What it does

My current AI assistant(Meta AI) named "ALICE", Can have End-To-End Conversations with the user simulating conversations as Humanly as Possible, Has Bilingual Conversation Ability and communicate accordingly, It can open websites in Chrome, search for videos in Youtube, Can access Internet to get information, open applications from the system, Can write reports and summaries of topics given by the user in notepad and take screenshots, The behavior is initially is prompt based.

How we built it

Various AI tools are used to Build Alice, Which Incudes:

For designing the System Architecture: "Gemini" and "Claude" For building the System Architecture: "Github Copilot" For a "RAG" framework:"Mem0 API" For taking control of system: "Personal Mode" For Core vision engine: "pywinauto" & "EasyOCR" For OCR Engine: "EasyOCR" For UI Automation: "pywinauto" + "pyautogui" For Image Analysis: "Google Gemini API" + "OpenCV" + "Pillow" For Web searches :"DuckDuckGo search" For Agent Framework: "Livekit-agent" For Windows API: "pywin32" And many other Essentials.

Challenges we ran into

The Major challenge which I ran into and still continued is the Processing speed of system, as I am trying to create a local Agent for system control, To get the best output I required A good system which I do not have yet, If the System have good Graphics card and good processor, My prototype can function very smoothly and accurately

Accomplishments that we're proud of

I am proud of Accomplishing My idea of creating a Local agent which could take the lead and execute all the required actions, My prototype has achieved very minimal features for now, but this proved my idea can really exist and made me understand what topics should I focus and how to nurture my learning such that I can create a Name for myself in Mankind.

What we learned

To be honest, I learned the missing things and hardwork required for making such complex system, As I have vibe coded my prototype, I got the knowledge of various tools, functionalities, frameworks etc, which I did not initially was aware of. I learned how the AI systems works, Where the AI system are currently weak, and how to pave our learning such that we upskill our self with aligning with the usage of AI tools.

What's next for ALICE

There are a bunch of things planned for ALICE:

Automation of Messaging platforms(Emails, Direct Messages, WhatsApp texts, Instagram DM's, etc. )

Automation of using and working in every Websites to performs and execute the tasks given by user.

3.Establishing A mini server in home for smart appliances such that Alice can take control over them.

4.Creating a pathway of communicating with Alice through Smartphone for giving tasks, getting analysis and other essentials.

5.Making A product system with A hologram device, integrated with Alice.

6.Implementing Reinforcement Learning and Deep Learning such that it learns from the actions and improve its performance.

Built With

Share this project:

Updates