RobOSS

• GIF

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

Inspiration

Making robotics and AI accessible to everyone.

Inspired by ChatGPT bringing AI to individuals, we wanted to democratize robotics in the physical world.

Motivation: “AI shouldn’t stay in labs—it should be in the hands of users.”

What it does

RobOSS is a GPT-OSS powered platform.

Enables users to design, simulate, and control robots.

Fully integrated with NVIDIA Isaac Sim, featuring natural language interaction and Agent Mode for autonomous testing and optimization.

Goal: make complex robotics simple and accessible within minutes.

How we built it

Integrated GPT-OSS models via Hugging Face (gpt-oss-120b / 20b).

Connected simulations to real-world prototypes in Isaac Sim.

Developed Agent Mode for AI-driven testing and learning.

Fully open-source under Apache 2.0 license.

Challenges we ran into

Translating real-world robot behavior accurately into simulation.

Ensuring AI correctly interprets natural language commands.

Simplifying the user experience while maintaining technical power.

Accomplishments that we're proud of

Running complex robots in simulation and real-world in minutes.

Enabling AI to autonomously learn and test behaviors via Agent Mode.

Providing a democratic and accessible platform for education, entrepreneurship, and industry.

What we learned

AI can bridge the gap between simulation and real-world robotics.

User experience is as important as technical infrastructure.

Open-source collaboration accelerates innovation and adoption.

What's next for RobOSS

Expanding to more robot types and task scenarios.

Optimizing models for faster performance on smaller devices.

Creating tutorials and example projects for wider adoption in education and entrepreneurship.

Enhancing Agent Mode’s autonomous learning capabilities.

Built With

• isaaclab
• isaacsim
• llm
• openaimodel
• oss-gpt
• python