ImageScraper

Inspiration

A year ago, I wanted to scrape all images off a imgur soccer thread. I tried so hard to find a simple image scraper for the command line, but couldn't find any generic image scrapping tool. I sat down one night and make one myself :)

What it does

A high performance, easy to use, multi-threaded command line tool which downloads images from the given webpage.

Demo(older version) : http://showterm.io/d3aef5bc3f37cd49757d1#fast

Challenges I ran into

Dynamic webpages. It's very difficult to scrape images from a dynamic page. I've used web drivers to handle it now, but I've heard back from many users that it doesn't work all the time.

Accomplishments that I'm proud of

Featured on the Github trending list - for a week. Over 15000+ downloads. Probably the only open source multi-threaded image scraper.

What I learned

Package publishing. Product design. Real world bug fixing. Copyrights. Python!

What's next for ImageScraper

Scraping multiple webpages.

Built With

• future
• pypi
• python