Github Web Scraping

• 

  n8n workflow image

Inspiration

Inspired by Harshil's workshop on Web Scraping in INIT 2022.

What it does

Shares the top 10 Github Repositories using C++ on Discord.

How I built it

n8n uses nodes to make an HTTP request to Github advanced search. I inspected the Github page and extracted the HTML as a JSON object using class names shown on the page.

Challenges we ran into

Being careful with the syntax.

Accomplishments that I'm proud of

I managed to filter out archived GitHub repositories using an IF node.

What I learned

I learnt how to web scrape without any coding involved.

What's next for Github Web Scraping

I plan to develop a database that regularly pulls Git Repositories. I can extend this project to other web pages and host my own React website that shows live results from these pages.

Built With

• javascript
• n8n