NB-Public/green-spider
14
0
Fork 1
mirror of https://github.com/netzbegruenung/green-spider.git synced 2024-04-30 08:04:52 +02:00
Code Issues 2 Projects Releases Wiki Activity
Hilft Dir dabei, Deine BÜNDNIS 90/DIE GRÜNEN Website zu optimieren https://green-spider.netzbegruenung.de/
6 commits 7 branches 7 tags 4.1 MiB
Python 88.9%
Shell 8.9%
Makefile 1.3%
Dockerfile 0.9%
Go to file
Marian Steinbach 92fda9958a Add test results for new directory entries
2018-04-04 00:04:53 +02:00
.gitignore First working code and results 2018-04-03 23:15:28 +02:00
README.md First working code and results 2018-04-03 23:15:28 +02:00
requirements.txt First working code and results 2018-04-03 23:15:28 +02:00
result.json Add test results for new directory entries 2018-04-04 00:04:53 +02:00
spider.py Reduce concurrency to reduce variance in timing results 2018-04-03 23:25:14 +02:00

README.md

green-spider

Collects data on green websites and checks for things like SEO, performance, TLS.

Written and tested in Python3

Ideas

  • If the URL does not start with www., will entering www.<url> also work?
  • If the URL is HTTP, is it possible to access the site via HTTPS (recommended)?
  • If the URL is HTTPS, is it possible to access the sire via HTTP (recommended: redirect to HTTPS)
  • Check which cookies are set and with what settings (expiry, domain)
  • submit the URL against a service like Google Page Speed and retrieve the score
  • Check against our own webpagetest.org instance
  • Detect which one of the well-known CMS is used?

Usage

virtualenv -p python3 venv
source venv/bin/activate
pip install -r requirements.txt

python spider.py