Inspiration
We both have been wanting to do a web scraper project for a while and finally found a good use case.
What it does
This app scrapes a website and provides a searchable version of it.
How we built it
We built it mostly in golang with a little bit of html, css, and js.
Challenges we ran into
LLMs were not very good at giving a numerical ranking of how relevant a document was to a given search term.
Accomplishments that we're proud of
The amount of parallelization that we did within the go backend is pretty insane.
What we learned
We learned a lot about go, since we started with no knowledge on it, and deploying web applications within go as well as a fully functional webscraper in the language.
What's next for MILK Search
We are going to be finding better search algorithms and improving the web scraper.
Log in or sign up for Devpost to join the conversation.