NB-Public/green-spider
14
0
Fork 1
mirror of https://github.com/netzbegruenung/green-spider.git synced 2024-04-26 06:20:06 +02:00
Code Issues 2 Projects Releases Wiki Activity

Commit graph

  • c474e2d80e
         Merge c79c1259ad into 5e183dc34a dependabot[bot] 2024-04-12 04:49:15 +0000
  • c79c1259ad
         Bump idna from 3.6 to 3.7 dependabot/pip/idna-3.7 dependabot[bot] 2024-04-12 04:49:13 +0000
  • 6ade3514e0
         Merge ba06c34f2c into 5e183dc34a Marian Steinbach 2024-04-09 21:49:33 +0200
  • 035ce40d4a
         Merge c62ee18c48 into 5e183dc34a Marian Steinbach 2024-04-03 21:15:01 +0000
  • c62ee18c48 Use selenium v4 selenium-v4 Marian Steinbach 2024-04-03 23:14:40 +0200
  • a5ef2a0f67
         Merge c8984adc17 into 5e183dc34a dependabot[bot] 2024-04-03 20:30:38 +0000
  • c8984adc17
         Bump protobuf from 4.25.3 to 5.26.1 dependabot/pip/protobuf-5.26.1 dependabot[bot] 2024-04-03 20:30:35 +0000
  • 419d7e01fc
         Merge 7c5a4f006a into 5e183dc34a dependabot[bot] 2024-04-03 20:30:23 +0000
  • 7c5a4f006a
         Update click requirement from <8,>=7 to >=7,<9 dependabot/pip/click-gte-7-and-lt-9 dependabot[bot] 2024-04-03 20:30:21 +0000
  • dbb774b894
         Merge e74c026a23 into 5e183dc34a dependabot[bot] 2024-04-03 20:30:15 +0000
  • e74c026a23
         Bump docker from 5.0.3 to 7.0.0 dependabot/pip/docker-7.0.0 dependabot[bot] 2024-04-03 20:30:13 +0000
  • 5e183dc34a
         Update dependencies (#356) main Marian Steinbach 2024-04-03 22:29:33 +0200
  • e1ccffd860 Update w3lib Marian Steinbach 2024-04-03 22:16:39 +0200
  • 9b774323c5 Update feedparser Marian Steinbach 2024-04-03 22:11:01 +0200
  • 42d7354e89 Update various modules Marian Steinbach 2024-04-03 22:03:32 +0200
  • 2b32d963d7 Update gitdb and GitPython Marian Steinbach 2024-04-03 22:00:43 +0200
  • 8574244ebe Update cffi Marian Steinbach 2024-04-03 21:57:45 +0200
  • 68f5b49cbf Update pyasn1 modules Marian Steinbach 2024-04-03 21:55:26 +0200
  • 7d8d6c0c7a Update Google modules Marian Steinbach 2024-04-03 21:53:24 +0200
  • 99d0980686
         Bump google-auth from 2.28.1 to 2.29.0 (#351) v2024.4.3 dependabot[bot] 2024-04-03 14:54:53 +0000
  • b91761dbd4
         Bump google-auth from 2.28.1 to 2.29.0 dependabot[bot] 2024-04-03 14:32:34 +0000
  • ee167db02f
         Bump certifi from 2023.7.22 to 2024.2.2 (#352) dependabot[bot] 2024-04-03 14:31:46 +0000
  • ef0b808132
         Bump certifi from 2023.7.22 to 2024.2.2 dependabot[bot] 2024-04-03 14:27:57 +0000
  • 4402bf60c3
         Bump pyasn1 from 0.4.8 to 0.6.0 dependabot[bot] 2024-04-03 14:27:55 +0000
  • 5127148821
         Bump pyasn1-modules from 0.2.8 to 0.4.0 dependabot[bot] 2024-04-03 14:27:50 +0000
  • a84c2244bd
         Bump pyopenssl from 23.0.0 to 24.1.0 (#349) dependabot[bot] 2024-04-03 14:27:10 +0000
  • 3ea081813d
         Bump pyopenssl from 23.0.0 to 24.1.0 dependabot[bot] 2024-04-03 14:19:25 +0000
  • e2bc62e51a
         Bump redis from 4.1.0 to 5.0.3 (#350) dependabot[bot] 2024-04-03 14:18:30 +0000
  • f2a4be1b9d
         Bump urllib3 from 1.26.7 to 1.26.18 (#355) dependabot[bot] 2024-04-03 14:17:35 +0000
  • a0edd7d5a9
         Bump redis from 4.1.0 to 5.0.3 dependabot[bot] 2024-04-03 13:58:58 +0000
  • 9413d59549
         Bump urllib3 from 1.26.7 to 1.26.18 dependabot[bot] 2024-04-03 13:58:30 +0000
  • 1136637ed8
         Bump rq from 1.16.0 to 1.16.1 (#344) dependabot[bot] 2024-04-03 13:58:04 +0000
  • 9a997f2079
         Bump rq from 1.16.0 to 1.16.1 dependabot[bot] 2024-04-03 13:54:57 +0000
  • ab58152b8e
         Set chromium version to 123.0.6312.86-r0 (#354) Marian Steinbach 2024-04-03 15:45:02 +0200
  • e4c8baface Set chromium version to 123.0.6312.86-r0 Marian Steinbach 2024-04-03 15:41:28 +0200
  • 0c0bcbf54e
         Mehrere Fixes und Verbesserungen (#343) v2024.3.7 Marian Steinbach 2024-03-07 11:31:16 +0100
  • d937f44ae1 Upgrade docker to 5.0.3 Marian Steinbach 2024-03-06 23:58:53 +0100
  • 306866030a Fix 'make spider' command Marian Steinbach 2024-03-06 23:58:42 +0100
  • e1cf2f3719 Bring back function to execute a single spider job Marian Steinbach 2024-03-06 23:42:59 +0100
  • 73e847d025 Print more detailed results count Marian Steinbach 2024-03-06 23:40:56 +0100
  • dfda970571 Remove unused environment variable references Marian Steinbach 2024-03-06 23:40:37 +0100
  • 4f6687e2c0 Prevent output buffering in job creation Marian Steinbach 2024-03-06 23:40:22 +0100
  • 1cfb537bbc Improvements in run-job.sh script Marian Steinbach 2024-03-06 23:39:53 +0100
  • 58e3712e46 Use UTC for feed item age calculation Marian Steinbach 2024-03-06 23:38:40 +0100
  • ba06c34f2c Merge branch 'main' into font-detection font-detection Marian Steinbach 2024-03-04 17:22:09 +0100
  • 67d9d159bc
         Bump urllib3 from 1.26.7 to 2.2.1 dependabot[bot] 2024-03-04 16:19:24 +0000
  • c59db691a0
         Reparatur und Aufräumen an der job execution (#340) Marian Steinbach 2024-03-04 17:18:37 +0100
  • a80471a083 Remove unused config entry Marian Steinbach 2024-03-04 17:15:23 +0100
  • ce8a440d72 Add dryrun target to spider a URL without storing results Marian Steinbach 2024-03-04 17:15:10 +0100
  • d3d3e05a1d Update .dockerignore Marian Steinbach 2024-03-04 14:23:43 +0100
  • d5d2128546 Detect GrueneType instead of Arvo Marian Steinbach 2024-03-04 13:53:20 +0100
  • 796343a623 Merge branch 'update-job-execution' of https://github.com/netzbegruenung/green-spider into update-job-execution Marian Steinbach 2024-03-04 09:36:09 +0100
  • 4c64c05103 Add 'spider' make target Marian Steinbach 2024-03-04 09:36:02 +0100
  • 4009014ba4
         Merge branch 'main' into update-job-execution Marian Steinbach 2024-03-04 09:34:54 +0100
  • 1933a6c4a1 Let 'make jobs' execute git clone and use docker compose Marian Steinbach 2024-03-04 09:28:06 +0100
  • 75964011c2 Remove worker functions from spider code Marian Steinbach 2024-03-04 09:27:40 +0100
  • 3f4ea41e86 Remove git clone from manager code Marian Steinbach 2024-03-04 09:27:11 +0100
  • 1a225c5275 Remove obsolete 'spider' command from cli Marian Steinbach 2024-03-04 09:26:13 +0100
  • f094719e7b Add make tarket venv Marian Steinbach 2024-03-04 09:01:30 +0100
  • df9334e0ff Improve manager code Marian Steinbach 2024-03-04 09:00:49 +0100
  • 513bb3584e Newline Marian Steinbach 2024-03-04 08:58:50 +0100
  • 23d9a913f7 Pin click to v7 due to problems with rq Marian Steinbach 2024-03-04 08:57:44 +0100
  • 0e1c13fec6 Add some docs Marian Steinbach 2024-03-04 08:57:00 +0100
  • 7830ddd2d3 Update image name Marian Steinbach 2024-03-04 08:56:53 +0100
  • 5209cf4349 Script makeover: only one spider job, debian 11, add git clone Marian Steinbach 2024-03-04 08:56:42 +0100
  • 31441e976c Improve docker compose setup Marian Steinbach 2024-03-04 08:55:59 +0100
  • 54752ab580
         Bump parsel from 1.6.0 to 1.8.1 dependabot[bot] 2024-03-01 17:44:55 +0000
  • 59edf8a0cf
         Bump pyasn1 from 0.4.8 to 0.5.1 dependabot[bot] 2024-03-01 17:43:59 +0000
  • 2927acde84
         Bump kubernetes from 20.13.0 to 29.0.0 (#334) v2024.3.3 dependabot[bot] 2024-03-01 17:42:22 +0000
  • fd5b33617f
         Bump kubernetes from 20.13.0 to 29.0.0 dependabot[bot] 2024-03-01 17:37:58 +0000
  • 27705c83cb
         Bump idna from 2.10 to 3.6 (#331) dependabot[bot] 2024-03-01 17:29:18 +0000
  • 41591186e1
         Bump idna from 2.10 to 3.6 dependabot[bot] 2024-03-01 17:21:13 +0000
  • b17896cdb5
         Bump cssselect from 1.1.0 to 1.2.0 (#335) dependabot[bot] 2024-03-01 17:19:48 +0000
  • 570f5bc783
         Bump cssselect from 1.1.0 to 1.2.0 dependabot[bot] 2024-03-01 17:15:39 +0000
  • a0e0dae2b9
         Bump google-auth from 2.13.0 to 2.28.1 (#330) dependabot[bot] 2024-03-01 17:14:42 +0000
  • 4f5a4e7e4d Merge branch 'main' into update-job-execution Marian Steinbach 2024-03-01 18:14:35 +0100
  • 9a329ea4b9
         Bump google-auth from 2.13.0 to 2.28.1 dependabot[bot] 2024-03-01 17:11:49 +0000
  • e48f80cd50
         Bump rq from 1.8.0 to 1.16.0 (#333) dependabot[bot] 2024-03-01 17:10:31 +0000
  • a47b2277f9
         Bump rq from 1.8.0 to 1.16.0 dependabot[bot] 2024-03-01 17:06:01 +0000
  • bfd5ebc25e
         Bump smmap2 from 2.0.5 to 3.0.1 (#338) dependabot[bot] 2024-03-01 17:05:04 +0000
  • da56de71c0
         Bump smmap2 from 2.0.5 to 3.0.1 dependabot[bot] 2024-03-01 17:01:54 +0000
  • 724708217d
         Bump cachetools from 5.3.2 to 5.3.3 (#332) dependabot[bot] 2024-03-01 16:59:50 +0000
  • 0d94a704a4
         Bump cachetools from 5.3.2 to 5.3.3 dependabot[bot] 2024-03-01 16:53:14 +0000
  • 7d43d75b93
         Update auf Chromium v122; Verbesserung am container image build (#339) Marian Steinbach 2024-03-01 17:51:56 +0100
  • dfebac4a90 Change package sources, do not use edge/main Marian Steinbach 2024-03-01 17:47:36 +0100
  • 12ceba15d5 Pin base image to checksum Marian Steinbach 2024-03-01 17:47:01 +0100
  • de994e7c67 Use Chromium v122 Marian Steinbach 2024-03-01 17:46:43 +0100
  • 5ff8cf9968 Update jq URL Marian Steinbach 2024-03-01 09:17:32 +0100
  • 894711a2d8
         Entfernen obsoleter Inhalte aus Devops script und README (#329) Marian Steinbach 2024-02-22 09:43:22 +0100
  • 5591afeb25 Remove Kubernetes info from README Marian Steinbach 2024-02-22 09:42:13 +0100
  • ab9a4cffd4 Remove screenshotter, fix job name argument Marian Steinbach 2024-02-22 09:41:23 +0100
  • f0db5aad9b
         Change quay.io to ghcr.io (#328) Marian Steinbach 2024-02-22 09:32:49 +0100
  • 3d3427e97d Change quay.io to ghcr.io Marian Steinbach 2024-02-22 09:31:58 +0100
  • b1762da7ef
         Workflow zum Erzeugen und Veröffentlichen eines Container Image auf ghcr.io (#327) v2024.2.22 Marian Steinbach 2024-02-22 09:16:44 +0100
  • a4900c8da8 Merge branch 'main' into add-release-package-workflow Marian Steinbach 2024-02-22 09:14:13 +0100
  • 8dd5d81bd2 Remove debugging trigger Marian Steinbach 2024-02-22 09:13:10 +0100
  • c86794b687
         Update README content (#326) Marian Steinbach 2024-02-22 09:08:45 +0100
  • 4cdb609c04 Add step to create VERSION file Marian Steinbach 2024-02-22 09:06:26 +0100
  • d7d4eeff96 Update image name in Makefile Marian Steinbach 2024-02-22 09:03:16 +0100
  • 67b93c2d79 Add workflow Marian Steinbach 2024-02-22 09:03:07 +0100