Project Code:1-43 Medizinische Kommunikation_Covid Buddy:

Multilingual chatbot and video chat software to facilitate the communication between the few medical/emergency staff available and the people who need help and advice but they always find the phone line overload, with no human feeling, and they get help in late.

The Challenge

Due to the Corona crisis the number of infected and sick people explode. Additionally direct human contact is more and more restricted. As a result we face the following problems:

  1. Overcrowded emergency telephone lines
  2. Foreigners find it difficult to explain themselves by telephone
  3. Lack of human contact on the phone
  4. Insufficient medical staff to pre-screen or give information over the phone
  5. Uncertainity for families with infected persons

The Idea and its benefits

Implement an AI chatbot combines with a video chat option that can be reached via the smartphone app, internet or phone. The target is to relieve medical hotlines by

  1. Directing only urgent cases directly to a video chat or phone line with a doctor,
  2. And putting low priority cases into a waiting loop or a call back list.
  3. When possible the chatbot gives people standard information f.e. in case of COVID-19 Testing.

The chatbot will be able to understand and speak or write several languages, so that every user can use his or her favorite language

To guarantee usability the following rules should be fulfilled for the final workflow:

  1. A flow can never guarantee to catch all possible real cases. So there must always be a path to a chat with a doctor at least with low priority (waiting loop).
  2. To minimize speech recognition errors and decision paths use closed questions in questionnaires where possible. (closed questions can be answered with yes or no, a number, or a given set of alternatives)
  3. Chatbot should stop asking questions when a classification is clear.
  4. Time emergency: ‘Stop breathing’ might be classified as more time-critical than ‘high fever’. Time-critical questions have to be asked first to avoid losing time.

The Result Today

Given the short time, at the moment, we have developed only the initial part of the Chatbot and Videochat prototypes, but we are very interested in having concrete opportunities to create synergies and collaborations with institutions and companies and continue the project.

Further features ideas

  • extend on further diagnosis
  • make available through speech synthesis/ recognition interface (voice)
  • integrate with home assistant systems for aged or handicapped people
  • integrate with home assistant systems like Alexa
  • enrich web interface with face showing emphatic feelings
  • feature to give specialist appointments for planned examinations
  • make appointments for second opinion doctors
  • feature to revoke emergency calls made a moment ago
  • find blood donation opportunities
  • identify possible organ donors
  • use emotion recognition from voice modalities and facial expression recognition to identify stress levels
  • Built With

    + 1 more
    Share this project:

    Updates