project firefly

Inspiration

By taking inspiration from the idea of Jen Looper, we had taken that idea to the next step to effectively allow the conversion and application of connecting the power of firefly lights with the power of music.

What it does

Firefly effectively takes in videos that can be sent with camera or VIA upload, enhances the overall quality and gets the Blinks per minute or BPM. The System would then find similar songs that match that firefly's BPM and displays the most popular songs with the BPM.

How we built it

Firefly's front end was constructed with CSS, HTML and Typescript, utilizing CHATGPT and Claude to help assist and build the overall product. Backend was created primarily through Python and Typescript with the help of both Gemini, ChatGPT, Cloudinary and Claude in order to polish and bring a fully united product

Challenges we ran into

Two main challenges was the Color detection system which was used for detecting and seperating individual firefly sources and interpreting these results. The other result was the timing frame which proved difficult as it had to calculate the BPM from the video, relying on all other components of the code to be spot on.

Accomplishments that we're proud of

We were proud of many small accomplishments and the big ones such as overcoming the obstacles of the color detection system and time frame. One big accomplishment was creating a fully fledged version of the app which was very rewarding as other hackathons had ended with a not so polished product.

What we learned

We had learned alot of different lessons from this hackathon, from remembering to back and commit properly to how the power of AI can really help debug and solve certain issues. These all serve to help bring valuable insights for the next project in the future.

What's next for project firefly

Firefly would like to implement new features within the app such as a way to record data from these firefly sightings and send it to conservation areas as well find different ways to sort music results and hopefully have further access to music API's like Spodify's API and other exciting features.