Unified · Split
| @@ -87,6 +87,7 @@ Modifications made to each document include: · 86 unmodified lines | |||
| 87 | * replacing all external (not scraped) URLs with their fully qualified counterpart | 87 | * replacing all external (not scraped) URLs with their fully qualified counterpart |
| 88 | * replacing all internal (scraped) URLs with their unqualified and relative counterpart | 88 | * replacing all internal (scraped) URLs with their unqualified and relative counterpart |
| 89 | * adding content, such as a title and link to the original document | 89 | * adding content, such as a title and link to the original document |
| 90 | * ensuring correct syntax highlighting using [Prism](http://prismjs.com/) | ||
| 90 | 91 | ||
| 91 | These modifications are applied via a set of filters using the [HTML::Pipeline](https://github.com/jch/html-pipeline) library. Each scraper includes filters specific to itself, one of which is tasked with figuring out the pages' metadata. | 92 | These modifications are applied via a set of filters using the [HTML::Pipeline](https://github.com/jch/html-pipeline) library. Each scraper includes filters specific to itself, one of which is tasked with figuring out the pages' metadata. |
| 92 | 93 | ||