Marian Steinbach 5e8347916c Fehlerbehebung im url_reachability check (#108) ... * Fix detection of redirects to bad domains * Fix bad domain check * Add --url flag to spider for faster debugging * Pass args to make spider * Add spidering of a single URL for debugging purposes * Fix tests * Fix test in CI * Remove pip upgrade		2019-04-19 00:35:28 +02:00
..
__init__.py	Refactor and modularize spider (#70)	2018-10-03 11:05:42 +02:00
spider.py	Fehlerbehebung im url_reachability check (#108)	2019-04-19 00:35:28 +02:00
spider_test.py	Improve certificate check to support SNI (#71)	2018-10-03 21:01:52 +02:00