Code

History

Commits on bash to lib/docs/core/scrapers28
  1. fix: replace calls to `Dir.exists?` with `Dir.exist?`Simon Legner committed 4 years ago961bbeb
  2. Fix OpenJDK scraperJasper van Merle committed 7 years ago8325ed7
  3. Simplify file scraper setup; scrape files in the "docs/[slug]" directoryThibaut Courouble committed 7 years agobf00366
  4. Instrument FileScraper read errors rather than use putsThibaut Courouble committed 8 years ago0095779
  5. Update C/C++ documentationThibaut Courouble committed 8 years ago472f03d
  6. Add rate limiterThibaut Courouble committed 8 years agoad9276e
  7. Improve error message on failed requestsThibaut Courouble committed 8 years ago914100a
  8. Switch to headless Chrome for capybara/selenium scrapingThibaut Courouble committed 9 years ago65e8236
  9. Improve error loggingThibaut Courouble committed 9 years ago6fc48db
  10. Improve MDN scrapersThibaut Courouble committed 9 years ago476c69e
  11. Add <base> supportThibaut Courouble committed 9 years ago4e41ed9
  12. Update TensorFlow documentation (0.11)Thibaut Courouble committed 9 years ago0d4c6b5
  13. Update Elixir documentation (1.3.3)Thibaut Courouble committed 10 years ago6fdf81e
  14. Refactor scrapers with multiple base URLsThibaut Courouble committed 10 years ago46a9ed1
  15. Update and version Meteor documentationThibaut Courouble committed 10 years agob279f84
  16. Update Angular.js documentation (1.5.6)Thibaut Courouble committed 10 years agof6530ed
  17. Change User-Agent to 'DevDocs'Thibaut Courouble committed 10 years ago1a4bea8
  18. Finish CakePHP documentationThibaut Courouble committed 10 years ago5f2d9cd
  19. Refactor FixRedirectionsBehaviorThibaut Courouble committed 10 years agob8658d9
  20. Raise error and stop scraping on 4xx/5xx status codeThibaut committed 10 years ago3eb5ccb
  21. Added dojo to devdocs & ability to define headers in scraper requestsShaneQful committed 10 years ago3465933
  22. Add two-pass redirection rewriterThibaut committed 11 years ago018628e
  23. Use String#removeThibaut committed 12 years agobcd4a5b
  24. Make Docs::FileScraper#request_all accept an array of URLsThibaut committed 12 years ago5e69d6d
  25. Make Docs::UrlScraper#request_all accept an array of URLsThibaut committed 12 years agocd6057e
  26. Add CleanLocalUrls filter for removing localhost URLsThibaut committed 12 years ago24347f3
  27. Set the default FileScraper::base_url to localhostThibaut committed 12 years ago9089d03
  28. Going open sourceThibaut committed 13 years ago18986c1