TrainGuide

What it does

This is basically a glorified proof-of-concept.

How we built it

A web app created using svelte for the UI, that pipes camera data to tensorflow.js models. We use the Web Audio API for the guidance.

Challenges we ran into

We had to train a custom object detector model for the first time in out lives. We first wanted to go with a tiny version of YOLO, but getting a tfjs model from a darknet model proved to be challenging... So we opted for a MobileNet instead. Because we wanted to train a model from scratch AND produce a web app, the allotted time frame was a bit short to obtain a robust object detector model.

Accomplishments that we're proud of

It should work in principle :P

https://github.com/Soni-Sona/TrainGuide

Run the demo app

To run the demo app, go to the github repo and grap everything in the "app" folder. Run in this directory

npm install
npm run dev

and in your browser go to localhost:5000 Have fun !

Built With

• svelte
• tensoflow.js
• tensorflow