Inspiration
As students, our late-night study sessions always run into the same practical bottleneck. When you're stuck on a complex engineering or science topic, simply opening ChatGPT or asking Siri/Alexa rarely gives you a verifiable, trustworthy answer:
The Trap of "Confident Hallucinations" in LLMs: If you ask a standard chatbot like ChatGPT about an evolving benchmark, a specific research paper, or a niche hardware spec, it writes with complete confidence—even when it hallucinates numbers, authors, or dates. It doesn't cite where the claim came from in real time, meaning you still have to manually verify every single sentence before putting it in a project report.
The "Single Featured Snippet" Flaw in Voice Assistants: When you ask Alexa, Google Assistant, or Siri a technical question while your hands are busy, they simply scrape the very first search result or Wikipedia summary and read it out. If that top link happens to be an outdated forum post, an unverified tech blog, or a sponsored article, the assistant treats it as gospel truth. There is zero cross-referencing.
Passive Guessing vs. Collaborative Clarification: In real research, prompts are rarely black-and-white. If a friend asks you, "Can you explain backpropagation?", you wouldn't just launch into raw multivariable calculus without checking: "Do you want the intuition, or the mathematical derivation?" Voice assistants and chatbots regularly dump a generic wall of text without ever asking for your intended depth or context.
We asked ourselves: Why can't Alexa act like an actual research partner? If a peer were helping you study, they would verify claims across multiple independent sources, warn you if a fact only appears on one obscure blog, and ask what angle you need before reading out an answer. That clear, everyday academic problem inspired us to build Alexa Voyager.
What it does
How we built it
We designed Alexa Voyager with a modular, extensible architecture:
Local Voice Pipeline: Deployed a local Whisper speech model directly on our simulator to transcribe user speech with low latency, paired with real-time speech synthesis for immediate vocal responses. Orchestrator Agent:
Built a central planning agent that breaks complex queries down into structured investigative vectors rather than executing a single naïve search string.
MCP Live Research Server (Alexa-live-web-research-mcp):
Implemented a custom Model Context Protocol server exposing a research web tool. We leveraged Playwright to handle headless browser navigation, deep page rendering, and noise-free DOM extraction. Claim Verification Heuristic: Implemented an automated scoring pipeline that weights domain authority and checks for independent corroboration before synthesizing facts.
Challenges we ran into
Managing Latency in Autonomous Loops:
Running headless browser automation and cross-source corroboration takes time (15-30sec). We had to implement intermediate progress telemetry—showing users that the agent is actively checking tools and parsing sources—so the interaction feels alive rather than frozen.
Web Noise & Anti-Bot Protection: Live websites are messy, full of cookie consent banners, dynamic scripts, and anti-scraping walls. Designing our Playwright extractors to cleanly strip out DOM noise without tripping bot protections or bloating LLM context windows took significant trial and error.
Designing Dense Research for Voice: Academic research is packed with dense links and data tables, which sound terrible when read aloud. We had to carefully architect our pipeline to store rich structured data in JSON for auditability, while distilling only the verified, natural takeaways for Alexa's spoken voice.
Accomplishments that we're proud of
Zero-Hallucination Verification: Building a working loop that actively refuses to take single-source claims as absolute fact, giving users verifiable confidence in voice-delivered information. True Two-Way Voice Collaboration: Making an assistant that knows when to pause and ask clarifying questions instead of blindly guessing the user's intent. Standardized Protocol Adoption: Successfully building a production-grade MCP integration that decouples browser automation from LLM logic, making our toolchain modular and extensible across other platforms.
What we learned
Clarification Beats Guesswork: Having an AI ask one smart clarifying question upfront saves compute, avoids hallucination, and delivers vastly better answers than dumping generic text. The Power of Open Standards: Working with the Model Context Protocol showed us that standardizing tool interfaces is the future of agentic AI. It made connecting external scrapers to our assistant clean and maintainable. Epistemic Humility Matters: In voice assistants, knowing what you don't know—and communicating single-source uncertainty honestly—is far more valuable than giving an instant, inaccurate answer.
What's next for Alexa voyager
Resilient Anti-Detection Traversal: Incorporating dynamic browser fingerprinting and intelligent proxy rotation to reliably navigate strict bot protections and Cloudflare challenge walls.
Active Agentic Execution: Evolving beyond passive information gathering toward multi-step computer tasks, such as interacting with authenticated web portals, processing PDF documents, and running sandbox code.
Universal Productivity Skillset: Expanding our MCP toolchain from academic and technical research into everyday general-purpose intelligence—including cross-platform calendar scheduling, travel planning, and workflow automation for the next generation of Alexa+.
Built With
- agentic-ai
- alexa
- cheerio
- chromium
- html5
- huggingface
- javascript
- mcp
- model-context-protocol
- node.js
- npm
- ollama
- pixi
- playwright
- qwen
- speech-recognition
- streamable-http
- tavily-api
- text-to-speech
- typescript
- voice-assistant
- web-apis
- web-scraping
- whisper
Log in or sign up for Devpost to join the conversation.