Inspiration
The idea for ChitChat with Chehak came from a simple thought:
“What if anyone could have a personal AI assistant that felt human, helped intelligently, and respected their privacy?”
With the rapid rise of conversational AI, I wanted to build something more than just a chatbot — a secure, multimodal AI companion that could understand text, images, documents, and even voice. Inspired by tools like ChatGPT and personal experiences with academic and project queries, I aimed to create a localized, privacy-focused AI tool that users can fully trust.
What it does
ChitChat with Chehak is a full-featured local AI chatbot that allows users to:
- Chat using text or speak via voice input
- Upload documents (PDF, DOCX, TXT) and ask questions based on the content
- Upload images and get AI-generated insights or explanations
- View and maintain chat history locally on the device
- Use the entire system without internet, as it runs on local models (via Ollama)
- Get fast, intelligent answers with complete data privacy and security
The app acts as a personal AI assistant that understands multiple input types and responds intelligently, while keeping everything user-side.
How we built it
Tech Stack Frontend: HTML, CSS, JavaScript Backend: Node.js + Express.js AI Engine: Ollama with local LLaVA / LLama3 model File Handling: Multer, pdf-parse, mammoth Voice Input: Web Speech API Security: Local storage, no cloud/API data sharing
Challenges we ran into
Every good project comes with its hurdles, and here’s what I tackled:
- Streaming large responses from local models while keeping the UI responsive
- Managing stateful conversation history without using a database
- Parsing complex document formats and returning meaningful responses
- Handling CORS issues and file size limits in backend routing
- Implementing cross-browser-compatible voice input features
Each obstacle sharpened my problem-solving skills and pushed me closer to production-grade development practices.
Accomplishments that we're proud of
1,. Created a fully functional, multimodal chatbot without using any paid APIs or cloud services
- Successfully integrated document and image understanding with local AI models
- Built a voice-enabled assistant that feels interactive and human
- Ensured zero data leakage by handling everything locally on the user’s device
- Designed a smooth, responsive chat interface that supports streaming answers and input from multiple sources
- Overcame real-world challenges like CORS errors, large file handling, voice compatibility, and streaming performance
What we learned
Throughout the development of this project, I deepened my understanding of:
- Frontend-backend integration using JavaScript, HTML, and Express.js
- Working with Ollama and LLaVA/LLama3 APIs for free, local AI responses
- Handling file uploads (PDF, DOCX, TXT, Images) and parsing them dynamically
- Integrating voice input features using the Web Speech API
- Efficiently managing chat history, streaming responses, and state updates
- Implementing data security measures to keep all user data local and private
What's next for Chatbot
ChitChat with Chehak is just the beginning. I aim to:
- Add multilingual support for global accessibility
- Enable chat export and session sharing
- Explore offline Progressive Web App (PWA) capabilities
- Continue refining AI response accuracy
Log in or sign up for Devpost to join the conversation.