History

Switch to headless Chrome for capybara/selenium scraping

Thibaut Courouble committed 9 years ago

Commit 65e82361 parent 2ff56e21 file · +6 −3Browse files

Unified · Split

lib/docs/core/scrapers/url_scraper.rb+6−3
@@ -49,10 +49,13 @@ module Docs · 48 unmodified lines
4949
5050 def load_capybara_selenium
5151 require 'capybara/dsl'
52− Capybara.register_driver :selenium_marionette do |app|
53− Capybara::Selenium::Driver.new(app, marionette: true)
52+ require 'selenium/webdriver'
53+ Capybara.register_driver :chrome do |app|
54+ options = Selenium::WebDriver::Chrome::Options.new(args: %w[headless disable-gpu])
55+ Capybara::Selenium::Driver.new(app, browser: :chrome, options: options)
5456 end
55− Capybara.current_driver = :selenium_marionette
57+ Capybara.javascript_driver = :chrome
58+ Capybara.current_driver = :chrome
5659 Capybara.run_server = false
5760 Capybara
5861 end