Nebius Triage & Operations Agent – Nemotron Execution Engine

Inspiration

Modern operations teams face constant message overload, requiring fast intake and accurate routing. We wanted to build an autonomous agent that could ingest raw operational requests, calculate urgency scores, and output structured JSON routing decisions reliably.

What it does

The Nebius Triage & Operations Agent analyzes incoming requests, classifies intent, assigns urgency scores, and provides required action steps. It executes its reasoning payload using a custom integration with the Nebius Token Factory API and NVIDIA Nemotron-3-Ultra model.

How we built it

• Platform: Built low-code agent logic within Relevance AI.
• Inference Engine: Connected directly to Nebius Token Factory (https://api.tokenfactory.nebius.com/v1/chat/completions) driving nebius/nvidia/Nemotron-3-Ultra-550b-a55b.
• Security & Auth: Utilized Relevance AI custom API key vaulting (chains_nebius_api_key) to manage credentials securely.
• Schema Design: Custom tool payload formatted to return validated JSON schema with explicit routing tier confirmations.

Challenges we ran into

Configuring custom header authentication and ensuring valid JSON schema outputs from open-source model completions required precise prompt constraints and payload alignment in Relevance AI.

Accomplishments that we're proud of

Successfully verified live execution where incoming requests trigger background reasoning steps, correctly returning structured outputs validated with nebius_routing_tier: Nemotron-3-Ultra (Reasoning Executed).

What we learned

How to seamlessly pair flexible agent platforms like Relevance AI with high-throughput inference endpoints like Nebius Token Factory for production-ready agentic workflows.

What's next for Nebius Triage & Operations Agent – Nemotron Execution Engine

Expanding trigger automation to connect incoming webhooks directly into enterprise Slack channels and ticketing systems, alongside deploying multi-agent fallback sub-chains for edge-case resolution.

Built With

• json
• nebius
• nvidia-nemotron
• relevance-ai
• rest-api