Inspiration

We live in a diverse country with people from all ethnic backgrounds. Not everybody speaks or understands English perfectly. For people, whose first language is not English, information on government websites can get complicated and confusing. People waste a lot of time trying to access the information they need. We also realized that there is no universal Q&A tool that can detect and provide answers to questions in any language for both voice and text. This inspired us to come up with a platform that can help users access information in their preferred language and mode of communication (voice/text).

What it does

Artemis is a user-friendly Q & A chatbot integrated with the ca.gov website to help users with any questions that they have in the language they are comfortable with. It automatically detects the language your phone/system is configured to and responds to both voice/text-based questions. Currently, it can detect over 24 languages. Artemis has a simple and intuitive interface making it super easy to use and can be used across platforms (both web and mobile).

How we built it

First, we mapped some of the ca.gov websites' FAQ to the QnA maker database and created a chatbot with Microsoft Bot Framework which we then linked to the database we made. We then added the web chat to the ca.gov page, created the cognitive speech service in Azure, linked it to the webchat client bot, connected the speech to text/text to speech API, added the translation middleware, and deployed everything to GitHub pages and Azure cloud. Meanwhile, the Sketch assets were designed and developed and integrated into the main Microsoft HTML file.

Built with Visual Studio Code and designed in Sketch.

Challenges we ran into

We faced an Azure bot deployment error, everything crashed. We also faced errors in API calls and unauthorized headers and tokens. Another challenge was trying to integrate the CSS code with the main Microsoft HTML file to make the backend match the created designs. Eventually, it all worked out!

Accomplishments that we are proud of

We are very proud that our project can impact millions of people who do not speak English as their first language access information on government websites. The added voice functionality makes it super easy to use for all people including older generations and people who are differently-abled.

What's next for Artemis

Over time we believe the technology can be adapted by many more enterprises and organizations for their knowledge base and customer support making information more accessible for all!

Built With

  • azure
  • azure-app-service
  • azure-cognitive-services
  • azure-qna-maker
  • azure-speech-to-text
  • azure-text-to-speech
  • css3
  • github
  • html5
  • microsoft
  • microsoft-bot-framework
  • microsoft-translation-api
  • sketch
  • vscode
  • webstorm
Share this project:

Updates