Commit Graph

172 Commits

Author SHA1 Message Date
Marian Steinbach 790faa20e3
Create LICENSE 2018-08-28 21:04:20 +02:00
Marian Steinbach 0210e03d5d
Merge pull request #60 from netzbegruenung/download-icons
Remove downloading of icons
2018-08-28 20:51:05 +02:00
Marian Steinbach e2077fe12b Adapt display code for the favicon 2018-08-27 23:48:54 +02:00
Marian Steinbach aa3b75add4 Data update with new icon data format 2018-08-27 23:39:28 +02:00
Marian Steinbach a463087b0a Add icon fetching to data export 2018-08-27 23:39:00 +02:00
Marian Steinbach 4abeb48cec Add a site icon 2018-08-27 23:38:41 +02:00
Marian Steinbach a001301121 Cleanup 2018-08-27 23:23:48 +02:00
Marian Steinbach 545ea671d8 Add retry for get_job_from_queue 2018-08-27 22:40:31 +02:00
Marian Steinbach cb58b32c39 Remove icon downloading from spider 2018-08-27 21:17:14 +02:00
Marian Steinbach 77a736c61f Comment makefile targets 2018-08-27 21:17:04 +02:00
Marian Steinbach 89f5f4fbe5
Merge pull request #59 from netzbegruenung/add-admin-scripts
Add devops scripts
2018-08-27 20:56:21 +02:00
Marian Steinbach 84e62b218a Consolidate scripts 2018-08-27 20:50:18 +02:00
Marian Steinbach aec2ce47f0 Adding devops scripts 2018-08-27 20:17:46 +02:00
Marian Steinbach d9cd0c9a7a Data update 2018-08-27 15:52:01 +02:00
Marian Steinbach 77d57d7d87 Webapp update 2018-08-23 10:27:14 +02:00
Marian Steinbach bf23478265
Merge pull request #58 from netzbegruenung/write-to-db
Use job queue, write to database
2018-08-23 10:16:50 +02:00
Marian Steinbach ab84ec8796 Fixes displaying of inaccessible sites 2018-08-23 10:02:58 +02:00
Marian Steinbach ea47673ed2 More Makefile adaptation 2018-08-23 10:02:34 +02:00
Marian Steinbach 35f21f298d Replace the screenshots target with an export target 2018-08-23 10:02:07 +02:00
Marian Steinbach 3a7a553534 Add creating of a job for a particular URL 2018-08-23 10:01:22 +02:00
Marian Steinbach 01155b58a5 Update README 2018-08-23 10:00:55 +02:00
Marian Steinbach 2472af988d Add target to create spider jobs 2018-08-23 09:38:30 +02:00
Marian Steinbach 0d9b44b384 Dockerfile update
- remove unused certifi module
- add google-cloud-datastore module
- add export script
2018-08-23 09:37:53 +02:00
Marian Steinbach 404365897d Add spider result export capabilities 2018-08-23 09:37:02 +02:00
Marian Steinbach 88ec1f63f7 Big spider.py overhaul 2018-08-23 09:36:33 +02:00
Marian Steinbach b61172445b
Update README.md 2018-08-17 08:52:26 +02:00
Marian Steinbach c5c57cf7d0
Merge pull request #56 from netzbegruenung/fix-makefile
Fix Makefile for screenshots
2018-08-17 07:18:22 +02:00
Marian Steinbach 785fbb2951 Fix makefile for Screenshots 2018-08-17 07:09:21 +02:00
Marian Steinbach 05ad670e9a Update schreenshots 2018-08-17 07:08:59 +02:00
Marian Steinbach de1f3574d7
Merge pull request #55 from netzbegruenung/screenshots-from-db
Remove screenshot creation, fetch screenshot data from database
2018-08-15 22:43:30 +02:00
Marian Steinbach 989ed53acf Fetch screenshot data from database 2018-08-15 22:02:20 +02:00
Marian Steinbach d6f3f93244 New screenshot data 2018-08-12 19:13:55 +02:00
Marian Steinbach e1bac23ccd
Merge pull request #54 from netzbegruenung/detect-josephknowsbest
Detect josephknowsbest, data update
2018-08-10 16:59:55 +02:00
Marian Steinbach 8fefc6c0c1 Add detection for more strings 2018-08-10 16:10:04 +02:00
Marian Steinbach 69715469e2 Data update 2018-08-10 16:09:24 +02:00
Marian Steinbach c7523ac47f Add CMS detection for josephknowsbest 2018-08-10 11:26:02 +02:00
Marian Steinbach 26b8aa8bec Data update 2018-07-27 13:04:17 +02:00
Marian Steinbach 9ddc34a16d Data update 2018-06-21 20:49:52 +02:00
Marian Steinbach 349d544478
Merge pull request #52 from netzbegruenung/tooltip-styling
Darstellung von Tooltips verbessern
2018-06-07 17:54:33 +02:00
Marian Steinbach 690144acd3 Set styling for tooltips 2018-06-07 17:37:58 +02:00
Marian Steinbach 13b4481337 Regenerate bundle.js 2018-06-07 09:28:08 +02:00
Marian Steinbach fb55b8121a Fix typo 2018-06-07 09:27:30 +02:00
Marian Steinbach 38c7a5c126
Merge pull request #51 from netzbegruenung/add-tooltips
Tooltip hinzufügen
2018-06-06 23:37:52 +02:00
Marian Steinbach 2034345d97 Add and apply tooltip 2018-06-06 23:35:07 +02:00
Marian Steinbach f4ba6bfd06 Add site icon 2018-06-06 23:34:54 +02:00
Marian Steinbach b8cdfbd13d Dependency update 2018-06-06 23:34:28 +02:00
Marian Steinbach f5de4a77ae Screenshot update 2018-06-06 21:34:16 +02:00
Marian Steinbach 0080dc33c0 Data update 2018-06-06 06:44:14 +02:00
Marian Steinbach ccdf954524 Data update, screenshot update 2018-05-30 14:54:45 +02:00
Marian Steinbach 7ad7afda46 Update published screenshot data 2018-05-26 00:10:13 +02:00