* WIP commit for single job execution
* Convert exception to string
* Pass more arguments
* Move python modules lsit into requirements.txt
* Document single site spidering
* Remove debugging
* Fix detection of redirects to bad domains
* Fix bad domain check
* Add --url flag to spider for faster debugging
* Pass args to make spider
* Add spidering of a single URL for debugging purposes
* Fix tests
* Fix test in CI
* Remove pip upgrade
Marian Steinbach
