NB-Public/green-spider
14
0
Fork 1
mirror of https://github.com/netzbegruenung/green-spider.git synced 2024-05-05 02:23:40 +02:00
Code Issues 2 Projects Releases Wiki Activity
259 commits 11 branches 7 tags 4.1 MiB
Commit graph

3 commits

Author SHA1 Message Date
Marian Steinbach 5e8347916c
Fehlerbehebung im url_reachability check (#108) 
* Fix detection of redirects to bad domains

* Fix bad domain check

* Add --url flag to spider for faster debugging

* Pass args to make spider

* Add spidering of a single URL for debugging purposes

* Fix tests

* Fix test in CI

* Remove pip upgrade
 2019-04-19 00:35:28 +02:00
Marian Steinbach d0e3a4210f
Fix link raters (social media links, contact link) (#95) 
* Fix rating for contact_link and social_media_link

* Skip checks when dependencies not met
 2018-11-28 23:46:40 +01:00
Marian Steinbach ae6a2e83e9
Refactor and modularize spider (#70) 
See PR description for details
 2018-10-03 11:05:42 +02:00