Inspiration

We were inspired by the generative properties of OpenAi, and we wanted to see if we could use this technology to help teach and entertain.

What it does

Our program uses the computer camera to detect certain objects in frame and mark them. A user can then choose a marked object and generate a short story that will involve the object.

How we built it

We built this project using the OpenAi API, Python flask, Gtts text to speech, HTML and CSS

Challenges we ran into

At first we wanted to use Taipy, but we kept running into issues with wanting to use Python 3.12, and incompatibilities with that version of Python. We were also having issues with the learning curve of web design using Taipy, so we ended up moving to flask. We also had a lot of issues involving the OpenAi Api key and ensuring that our key did not constantly expire.

Accomplishments that we're proud of

Experimenting with machine learning was a fun challenge that we conquered. Another thing was this was most of our first time's at TamuHacks so we felt proud that we could tackle a challenge and be creative.

What we learned

We learned quite a bit about using machine learning and object detection. We also learned about API's and how to call Apis for a website.

What's next for ToddAI

What's next for us would be to expand the items that the camera could detect, and also improve flow and load times on the web page.

Built With

Share this project:

Updates