GitHub - glaucocustodio/tanakai: Tanakai is a modern web scraping framework written in Ruby. A fork of Kimurai.

# github_spider.rb require 'tanakai' class GithubSpider < Tanakai::Base @name = "github_spider" @engine = :selenium_chrome @start_urls = ["https://github.com/search?q=Ruby%20Web%20Scraping"] @config = { user_agent: "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36", before_request: { delay: 4..7 } } def parse(response, url:, data: {}) respons

[YassLab]

“Tanakai intends to be a maintained fork of Kimurai, a modern web scraping framework written in Ruby which works out of the box with Apparition, Cuprite, Headless Chromium/Firefox and PhantomJS, or simple HTTP requests and allows you to scrape and interact with JavaScript rendered websites. ”