Web Scraping Research

References

https://www.parsehub.com/blog/web-scraping-examples/ https://www.scrapinghub.com/what-is-web-scraping/#:~:text=Web%20scraping%20is%20the%20process,market%20research%20among%20many%20others.

What it does

Web Scraping is a way of accessing and compiling public information/data on your own site for ease of access and use. Instead of copy-and-pasting quotes from other sources, this process is automated and on a MUCH larger scale.

How it works

First you must identify the website from which you want to collect information and note the URL. Next, you must request access of the HTML for said website so you can access the data. Then, you must set up a system to locate and save the desired data for your own later use.

Challenges of Web Scraping

The scraper which you have set up is likely sensitive to the source website's format, so if that changes, there could be issues with your own site and the data being collected.

What it's used for

Examples of things Web Scraping is useful for are:

• Real Estate Listing
• Business Numbers & Statistics
• Comparative Shopping (when sites allow you to compare features, prices, etc.)
• Social Media
• Market Research & Information Analysis
• Compiling Recent/Relevant News
• etc.

Built With

• devpost
• internet
• research