GitHub - vifreefly/kimuraframework: Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites# github_spider.rb require 'kimurai' class GithubSpider < Kimurai::Base @name = "github_spider" @engine = :selenium_chrome @start_urls = ["https://github.com/search?q=Ruby%20Web%20Scraping"] @config = { user_agent: "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36", before_request: { delay: 4..7 } } def parse(response, url:, data: {}) respons
