AutoEmbed

• 

  Gearbox

Inspiration

Fully autonomous robotic systems that do not have live communications like UUVs and Rovers in deep space do not have the ability to perform live fixes in real time. An Agentic system that lives on a UUV could monitor serial ports for error messages, write c code to fix these errors and upload the code to the embedded system.

What it does

Its an Agent you can prompt, It will read your main.c file understand the intention, look at serial data and notice issues. Once issues are noted it will rewrite your main.c file and compile and upload that code onto your microcontroller. It can do this in a loop to iterate multiple times.

How we built it

Frontend

• React + Vite
• Live transparency dashboard
• WebSocket event streaming

Backend

• Express + Node.js
• Autonomous agent loop
• Tool execution layer

Embedded Layer

• ESP-IDF
• ESP32 hardware
• Serial communication

AI Layer

• Nemotron
• Tool-calling agent loop

Challenges we ran into

Getting nemotron working with Nemoclaw was very difficult. Another major challenge was setting up a dual agent system where one agent was a supervisor and the other was the code writer. Getting these two to interface with each other was quite difficult - we primarily used bash scripts.

Accomplishments that we're proud of

We got open claw to write code and flash code onto the microcontroller just by 1 prompt.

What we learned

How to set up Nemotron, ways to interface agents, problems with agents in the context of long term usage (context window- hallucinations).

What's next for AutoEmbed

we will finish the entire feedback loop to combine the ability to flash with the ability to read code into one cohesive loop.

Built With

• esp-idf
• esp32
• github
• javascript
• nemotron
• node.js
• react
• vite
• websocket