Healthcare workers spend a significant amount of time retrieving medications from storage areas, which adds unnecessary overhead to already demanding workflows. Nurses and technicians frequently need to leave patient areas to locate medicine supplies, which can delay care and reduce efficiency in busy hospital environments.

Additionally, visually impaired patients and patients with limited mobility often face challenges when attempting to locate and retrieve medications independently. These patients may rely heavily on assistance from healthcare staff or caregivers, further increasing the workload on already stretched medical teams.

At the same time, medication handling requires a high level of accuracy. Retrieving the wrong medication can have serious consequences for patient safety. Hospitals therefore need solutions that not only improve efficiency but also ensure that the correct medicine is identified and delivered.

An intelligent system that can understand spoken medication requests, autonomously navigate to storage locations, verify the correct medicine visually, and return it to the requester could significantly streamline medication retrieval while improving accessibility and safety in healthcare environments.

This system forms a complete real-world AI loop.

1️⃣ Human voice captured

2️⃣ Smallest.ai converts speech into text

3️⃣ Cyberwave SDK executes autonomous locomotion

4️⃣ Robot camera captures shelf imagery

5️⃣ Vision AI verifies the medicine label

6️⃣ Robot performs a gesture to signal success

[System Design] https://github.com/AIBotTeachesAI/go2-medicine-bot/blob/main/MedBot%20final.pdf

Tech Stack Used

Unitree Go2 — quadruped robot hardware

Cyberwave SDK — cloud-based robot control and digital twin (Python, MQTT)

Smallest.ai Waves — speech-to-text (real-time WebSocket streaming) and text-to-speech (neural voice synthesis)

Claude claude-opus-4-6 (Anthropic) — vision language model for medicine label verification

Python — all application code

Built With

  • cyberwave
  • opus
  • python
  • smallest.ai
  • unitreego2
  • waves
Share this project:

Updates