NB-Public/green-spider
14
0
Fork 1
mirror of https://github.com/netzbegruenung/green-spider.git synced 2024-04-26 22:34:52 +02:00
Code Issues 2 Projects Releases Wiki Activity
Hilft Dir dabei, Deine BÜNDNIS 90/DIE GRÜNEN Website zu optimieren https://green-spider.netzbegruenung.de/
33 commits 7 branches 7 tags 4.1 MiB
Python 88.9%
Shell 8.9%
Makefile 1.3%
Dockerfile 0.9%
Go to file
Marian Steinbach 34b58b03d0 Updating report data
2018-04-13 18:02:13 +02:00
docs Updating report data 2018-04-13 18:02:13 +02:00
webapp Updating report data 2018-04-13 18:02:13 +02:00
.gitignore Update results, spider logic and webapp 2018-04-05 18:11:40 +02:00
Makefile Fix "make webapp" target 2018-04-05 20:24:40 +02:00
README.md Update ideas section 2018-04-05 19:51:41 +02:00
requirements.txt Add beautifulsoup4 and update requirements.txt 2018-04-09 22:39:26 +02:00
spider.py Add icon retrieval 2018-04-09 23:02:12 +02:00

README.md

green-spider

Collects data on green websites and checks for things like SEO, performance, TLS.

Written and tested in Python3

Results published at https://netzbegruenung.github.io/green-spider/

Usage

Run the spider:

make spider

The result will be in webapp/dist/data.

Build the webapp:

make webapp

Ideas

  • Check which cookies are set and with what settings (expiry, domain)
  • submit the URL against a service like Google Page Speed and retrieve the score (see https://github.com/addyosmani/psi/)
  • Check against our own webpagetest.org instance
  • Detect which one of the well-known CMS is used
  • Warn in case a certificate will expire soon
  • Favourite icon availability check