32 Commits (790faa20e36734d3bab93121c6e19232202f8431)

Author SHA1 Message Date
Marian Steinbach a001301121 Cleanup 4 years ago
Marian Steinbach 545ea671d8 Add retry for get_job_from_queue 4 years ago
Marian Steinbach cb58b32c39 Remove icon downloading from spider 4 years ago
Marian Steinbach 3a7a553534 Add creating of a job for a particular URL 4 years ago
Marian Steinbach 88ec1f63f7 Big spider.py overhaul 4 years ago
Marian Steinbach 8fefc6c0c1 Add detection for more strings 4 years ago
Marian Steinbach c7523ac47f Add CMS detection for josephknowsbest 4 years ago
Marian Steinbach ccdf954524 Data update, screenshot update 4 years ago
Marian Steinbach d8cfbddf3a Set data path back to whole Germany 4 years ago
Marian Steinbach 45c4d72326 Add icon pull logic 4 years ago
Marian Steinbach 8a7cf17701 Add volume for icons 4 years ago
Christian Tramnitz 8df5c66813 Move append into for-loop. This allows mutliple web sites per entry to be added. 4 years ago
Marian Steinbach 997519df35 More tests 4 years ago
Marian Steinbach 16ca2699d0 Ensure stable result sorting 4 years ago
Marian Steinbach 0450cfaac2 Make function output deterministic 4 years ago
Marian Steinbach e15051952e Fix YAML file encoding problem 4 years ago
Marian Steinbach 4de5890c60 Change to run spider in Docker container 4 years ago
Marian Steinbach 914fb1f35e Detect and report responsive layout details 4 years ago
Marian Steinbach 7dd451c3b6 Increase score for HTTPS 4 years ago
Marian Steinbach 94241ba380 Add detection for most common CMSes 4 years ago
Marian Steinbach 278261db26 Some stability improvements 4 years ago
Marian Steinbach ea05bf5192 Move test criteria logic into spider, add scoring 4 years ago
Marian Steinbach 9672e41dba Add icon retrieval 4 years ago
Marian Steinbach 313f56f39e Set JSON output to UTF-8 encoding 4 years ago
Marian Steinbach 48ee1ab8a1 Add content checks 4 years ago
Marian Steinbach 5438818043 Set stable sorting for all arrays 4 years ago
Marian Steinbach 3513eddfe6 Update results, spider logic and webapp 4 years ago
Marian Steinbach 56995067ec New test logic, new results 4 years ago
Marian Steinbach fb634fc1f3 Reduce concurrency to reduce variance in timing results 4 years ago
Marian Steinbach b3da3ccc12 Round duration time in milliseconds 4 years ago
Marian Steinbach 220a6ba629 First working code and results 4 years ago