Mobile Phone Repair Co-Pilot

Inspiration

YouTube is a treasure trove of troubleshooting videos. Professionals to DIY enthusiasts create content to troubleshoot or repair issues ranging from simple to complex. It is common practice for many to directly search on YouTube rather than on Google for their troubleshooting needs.

What it does

Mobile Repair Co-Pilot helps the user on their mobile phone troubleshooting journey by summarizing steps to troubleshoot from YouTube videos and also help the user buy spare parts online.

How we built it

Mobile Repair Co-Pilot uses the power of YouTube troubleshooting videos and Google custom search to generate responses.

Challenges we ran into

• Quality of YouTube search results cannot be controlled easily. Sometimes, we still see irrelevant video results especially for complex queries.
• Debugging agent responses in Vertex Agent builder is tricky, It's not always clear what the agent has learnt or how to change the agent response.

What's next for Mobile Phone Repair Co-Pilot

Some of the areas we would like to expand upon:

• To be a true troubleshooting Agent, the conversation with the user needs to be multi-turn. The Agent needs to be able to ask clarifying questions and answer any follow up questions about the sub-steps. This is a tricky problem which needs specific domain knowledge.
• Adding more sources to gather domain knowledge like instruction manuals, authoritative websites, etc.

Built With

• python
• vertex