GitHub - elvisyjlin/media-scraper: Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

media-scraper scrapes all photos and videos in a web page. It supports general-purpose scraping as well as SNS-specific scraping. media-scraper utilizes the web driver to simulate a user browsing web pages. With the web driver, sessions and cookies easily can be handled easily but it works slightly slowly. On the other hand, I'm currently working on the migration of another repository, which crawl

[suzukiMY]

beautifulsoup

[karatte]

“scrapes all photos and videos in a web page. It supports general-purpose scraping as well as SNS-specific scraping.”