Inspiration

Under the open innovation track for this hackathon, we decided that we automate our search for open source projects online since we as a team shared this common interest. As we are all striving to become better developers in our perspective fields, there are countless methods to accomplish that, one of the more common methods today is by contributing to open source projects. We stumbled upon a website (codetriage.com) that provides thousand of open source repositories, but then we met another problem in our quest to become better developers. So we asked ourselves how can we filter the thoousands of projects and place them a list that we have easy access to?

What it does

We developed a program that extracts data from codetriage.com using a webscraping tool called BeautifulSoup. This program provides users with a CSV file of open source projects based on their preferences.

How we built it

We used python and the beautiful soup library

Challenges we ran into

Converting the data we scraped from the website into csv file

Accomplishments that we're proud of

We were able to obtain our filtered out data according to our preferencies

What we learned

web-scraping enhanced python skills

What's next for open source web scraping

adding an algorithm to allow us filter on more conditions

Built With

Share this project:

Updates