Inspiration

Modern AI assistants excel at answering queries, but users must still perform the tedious work of completing the subsequent tasks.

A simple request can involve multiple searches, apps, reminders, and repeated work.

Astramedia is a company where we think about what it means for an assistant to understand not only the words a user says, but also the work that they intend to happen.

Thus: Astra - Your Intelligent Action Assistant.

Our vision is to enable an AI-powered experience where a user's natural-language intent can be expressed, understood, and executed as structured plans and meaningful actions - via a simple conversation.

What it does

Astra is an intelligent action assistant that helps users achieve their desired results through natural conversation.

The overall experience can be summarized into three primary phases:

Understand > Plan > Act

During the conversation, a user could state a simple natural-language request, such as:

"Help me organize my study plan for tonight."

Astra will understand the request, identify steps to achieve this goal, and present an intuitive user-interface where the user can review and approve each step of the plan before "acting" on it.

The architecture is designed to be extensible and focused on building meaningful connections between tools and services; Astra is able to transform from a simple smart-speech-bubble into a powerful action-driven experience.

For the Amazon Developer Hackathon, we are building the Astra experience within the Alexa+ ecosystem, investigating how the concepts can be applied to drive meaningful connections between user-intent identified by a conversational AI and the real-world applications that can fulfill them.

How we built it

We have designed Astra as a modular full-stack application, so that the user-interface, AI layer, tools, and data layer can be developed independently.

Frontend

  • React

  • TypeScript

  • Tailwind CSS

Our component-based responsive application provides a delightful UI experience.

AI & Application Layer

  • Natural language understanding

  • AI-powered planning

  • Structured actions framework, tool architecture, and API-driven integrations

The AI layer works to understand the intent of the user and convert that into an organized set of actions that can be reviewed and acted upon by the application.

Backend & Data

  • Supabase

  • PostgreSQL

  • APIs

The backend services and databases store and manage the data generated by the user-interactions and application tools.

Amazon Integration

Astra is being built for the Alexa+ track of the Amazon Developer Hackathon; We are working to include the relevant Amazon-specific requirements within the application to ensure the conversational intent can be connected to not only text responses but meaningful actions within the Amazon ecosystem.

Challenges we ran into

One of the greatest challenges of this project was to design an AI assistant that went beyond "just" an AI.

An intelligent action assistant needs to be able to understand what the user wants, identify which action to take, execute tool interactions, maintain state, and provide appropriate responses.

Some of the challenges we faced were:

  • Designing the appropriate conversion from natural language to structured actions

  • Designing a reliable and maintainable tool architecture

  • Addressing the challenges of ambiguous or non-specific requests

  • Balancing the power of AI with deterministic application logic

  • Providing a clear and intuitive conversation UX

  • Building the framework in a scalable manner that allows new tools to be added without requiring major rework of the application (both in terms of the tools themselves, as well as the application's ability to interface with them)

  • Incorporating Amazon technologies in a way that provides meaningful UX

Accomplishments that we're proud of

We are incredibly proud to turn the vision of an intelligent action assistant into reality - not as just a chatbot, but a full-stack application that demonstrates the power of combining:

  • Artificial Intelligence and Machine Learning

  • Full-stack application development

  • Modern web development

  • API driven tools

  • Cloud and database technologies

  • Conversational product design

We are especially proud of the elegant expression of the Understand > Plan > Act paradigm, which provides Astra with a clear value proposition of helping users turn ideas into action.

What we learned

The development of Astra has taught us valuable lessons about the creation of AI powered products; it is not enough to simply connect an application to an AI, but one must also consider:

  • Agentic application design

  • Tool architectures

  • Structured AI response formats and frameworks

  • Conversational UX design

  • API driven development

  • Full-stack system architecture

  • State and data management

  • Designing AI systems around the needs of real-world application

  • Designing applications that can be connected to an AI

  • Building applications for a specific developer ecosystem

We have learned the challenges of relying too much on AI and not having proper tools, validation, error handling, and UX to deal with it.

AI can be powerful, but reliable products require solid tools, appropriate validation, error handling, and clear feedback to the end user.

What's next for Astra - Your Intelligent Action Assistant

Astra has been designed to be a foundation for future development that will allow users to be much more productive with their time and energy.

Our immediate focus is on expanding Astra's capabilities, both in terms of the number of tools it can connect to, as well as the complexity and depth of each interaction; additional features we hope to implement include expanded contextual understanding, task and workflow planning features, and personalized recommendation engines.

We also hope to improve the reliability and error handling of Astra, as well as enhance our capabilities on the Amazon platform.

Ultimately, we want to empower people to get more done - Astra is our vision for an AI assistant that goes "beyond the question" and helps people accomplish things in the real world.

We hope to expand Astra to connect to a wide variety of productivity tools and platforms.

Built With

Share this project:

Updates

Submission history