v2024.5.9

What's Changed

• Update dependencies by @marians in #356
• Fix spider setup, update Chromium to v124 by @marians in #363

Full Changelog: v2024.4.3...v2024.5.9

v2024.4.3

What's Changed

• Set chromium version to 123.0.6312.86-r0 by @marians in #354
• Bump rq from 1.16.0 to 1.16.1 by @dependabot in #344
• Bump urllib3 from 1.26.7 to 1.26.18 by @dependabot in #355
• Bump redis from 4.1.0 to 5.0.3 by @dependabot in #350
• Bump pyopenssl from 23.0.0 to 24.1.0 by @dependabot in #349
• Bump certifi from 2023.7.22 to 2024.2.2 by @dependabot in #352
• Bump google-auth from 2.28.1 to 2.29.0 by @dependabot in #351

Full Changelog: v2024.3.7...v2024.4.3

v2024.3.7

What's Changed

• Reparatur und Aufräumen an der job execution by @marians in #340 und #343

Full Changelog: v2024.3.3...v2024.3.7

v2024.3.3

What's Changed

• Update auf Chromium v122; Verbesserung am container image build by @marians in #339
• Bump cachetools from 5.3.2 to 5.3.3 by @dependabot in #332
• Bump smmap2 from 2.0.5 to 3.0.1 by @dependabot in #338
• Bump rq from 1.8.0 to 1.16.0 by @dependabot in #333
• Bump google-auth from 2.13.0 to 2.28.1 by @dependabot in #330
• Bump cssselect from 1.1.0 to 1.2.0 by @dependabot in #335
• Bump idna from 2.10 to 3.6 by @dependabot in #331
• Bump kubernetes from 20.13.0 to 29.0.0 by @dependabot in #334

Full Changelog: v2024.2.22...v2024.3.3

v2024.2.22

• Weitgehend identisch mit v2024.2.21
• Einige Python Module wurden aktualisiert
• Ab diesem Release sollten container images unter ghcr.io/netzbegruenung/green-spider:v2024.2.22 bzw. mit dem entsprechenden Version Tag veröffentlicht werden.

Full Changelog: v2024.2.21...v2024.2.22

v2024.2.21

Hinsweis: Ab diesem Release verwenden wir das Tag-Schema vJJJJ.M.T, denn es ist ansonsten in diesem Projekt schwierig, zu entscheiden, was im Sinne von Semver ein Major, Minor, und Patch Update sein soll.

• Chromium v121
• Alpine Linux v3.19

v1.0.0

• Alpine 13.6
• Chromium 106

Alpine packages

abseil-cpp-20220623.1-r1
alpine-baselayout-3.2.0-r22
alpine-baselayout-data-3.2.0-r22
alpine-keys-2.4-r1
alsa-lib-1.2.7.2-r0
aom-libs-3.5.0-r0
apk-tools-2.12.9-r3
at-spi2-atk-2.38.0-r0
at-spi2-core-2.46.0-r0
avahi-libs-0.8-r6
binutils-2.39-r2
brotli-libs-1.0.9-r8
build-base-0.5-r3
busybox-1.35.0-r17
c-ares-1.18.1-r0
ca-certificates-20220614-r2
ca-certificates-bundle-20220614-r0
cairo-1.17.6-r3
cairo-gobject-1.17.6-r3
cargo-1.64.0-r2
chromium-106.0.5249.119-r1
chromium-chromedriver-106.0.5249.119-r1
cjson-1.7.15-r3
cups-libs-2.4.2-r0
dbus-libs-1.14.4-r0
eudev-libs-3.2.11-r2
expat-2.4.9-r0
ffmpeg-libs-5.1.2-r1
file-5.42-r0
flac-libs-1.4.2-r0
font-opensans-0_git20210927-r1
fontconfig-2.14.1-r0
fortify-headers-1.1-r1
freetype-2.12.1-r0
fribidi-1.0.12-r0
g++-12.2.1_git20220924-r3
gcc-12.2.1_git20220924-r3
gdbm-1.23-r0
gdk-pixbuf-2.42.9-r1
git-2.38.1-r0
glib-2.74.0-r4
gmp-6.2.1-r2
gnutls-3.7.8-r2
graphite2-1.3.14-r2
gtk+3.0-3.24.34-r6
gtk-update-icon-cache-3.24.34-r6
harfbuzz-5.3.1-r1
hicolor-icon-theme-0.17-r2
hwids-pci-20210613-r0
icu-data-en-72.1-r1
icu-libs-72.1-r1
isl25-0.25-r0
jsoncpp-1.9.5-r0
lame-3.100-r2
lcms2-2.13.1-r0
libass-0.16.0-r0
libasyncns-0.8-r1
libatk-1.0-2.46.0-r0
libatomic-12.2.1_git20220924-r3
libblkid-2.38.1-r0
libbsd-0.11.7-r0
libbz2-1.0.8-r3
libc-dev-0.7.2-r3
libc-utils-0.7.2-r3
libcrypto1.1-1.1.1q-r0
libcrypto3-3.0.5-r3
libcurl-7.85.0-r0
libdav1d-1.0.0-r2
libdrm-2.4.113-r0
libepoxy-1.5.10-r0
libevent-2.1.12-r5
libffi-3.4.3-r0
libffi-dev-3.4.3-r0
libfontenc-1.1.6-r0
libgcc-12.2.1_git20220924-r3
libgcrypt-1.10.1-r0
libgomp-12.2.1_git20220924-r3
libgpg-error-1.46-r0
libice-1.0.10-r1
libintl-0.21.1-r1
libjpeg-turbo-2.1.4-r0
libltdl-2.4.7-r0
libmagic-5.42-r0
libmd-1.0.4-r0
libmount-2.38.1-r0
libogg-1.3.5-r1
libpciaccess-0.17-r0
libpng-1.6.38-r0
libpulse-16.1-r5
librist-0.2.7-r0
libsm-1.2.3-r1
libsndfile-1.1.0-r2
libsodium-1.0.18-r2
libsrt-1.5.1-r0
libssh-0.10.4-r0
libssl1.1-1.1.1q-r0
libssl3-3.0.5-r3
libstdc++-12.2.1_git20220924-r3
libstdc++-dev-12.2.1_git20220924-r3
libtasn1-4.19.0-r0
libtheora-1.1.1-r16
libunistring-1.1-r0
libuuid-2.38.1-r0
libva-2.16.0-r0
libvdpau-1.5-r0
libvorbis-1.3.7-r0
libvpx-1.12.0-r1
libwebp-1.2.4-r1
libwoff2common-1.0.2-r2
libwoff2enc-1.0.2-r2
libx11-1.8.1-r1
libxau-1.0.10-r0
libxcb-1.15-r0
libxcomposite-0.4.5-r1
libxcursor-1.2.1-r1
libxdamage-1.1.5-r1
libxdmcp-1.1.3-r1
libxext-1.3.4-r1
libxfixes-6.0.0-r0
libxft-2.3.6-r0
libxi-1.8-r0
libxinerama-1.1.4-r2
libxkbcommon-1.4.1-r0
libxml2-2.10.3-r0
libxml2-dev-2.10.3-r0
libxml2-utils-2.10.3-r0
libxmu-1.1.4-r0
libxrandr-1.5.2-r1
libxrender-0.9.11-r0
libxslt-1.1.37-r0
libxslt-dev-1.1.37-r0
libxt-1.2.1-r0
libxtst-1.2.4-r0
libzmq-4.3.4-r1
linux-headers-5.19.5-r0
llvm15-libs-15.0.3-r0
make-4.3-r1
mbedtls-2.28.1-r0
mesa-22.2.2-r0
mesa-gbm-22.2.2-r0
minizip-1.2.13-r0
mkfontscale-1.2.2-r1
mpc1-1.2.1-r1
mpdecimal-2.5.1-r1
mpfr4-4.1.0-r0
musl-1.2.3-r1
musl-dev-1.2.3-r1
musl-utils-1.2.3-r0
ncurses-libs-6.3_p20221008-r0
ncurses-terminfo-base-6.3_p20221008-r0
nettle-3.8.1-r0
nghttp2-libs-1.50.0-r0
nspr-4.35-r0
nss-3.84-r0
numactl-2.0.16-r0
openssl-dev-3.0.5-r3
opus-1.3.1-r1
orc-0.4.32-r2
p11-kit-0.24.1-r1
pango-1.50.11-r0
patch-2.7.6-r8
pcre2-10.40-r0
pipewire-libs-0.3.59-r2
pixman-0.42.0-r0
pkgconf-1.9.3-r0
py3-cffi-1.15.1-r0
py3-contextlib2-21.6.0-r2
py3-cparser-2.21-r0
py3-cryptography-38.0.2-r0
py3-grpcio-1.50.0-r0
py3-lxml-4.9.1-r0
py3-packaging-21.3-r2
py3-parsing-3.0.9-r0
py3-pip-22.3-r0
py3-retrying-1.3.3-r3
py3-setuptools-65.5.0-r0
py3-six-1.16.0-r3
py3-wheel-0.37.1-r1
py3-yaml-6.0-r0
python3-3.10.8-r1
python3-dev-3.10.8-r1
re2-2022.06.01-r1
readline-8.2.0-r0
rust-1.64.0-r2
rust-stdlib-1.64.0-r2
scanelf-1.3.4-r0
sdl2-2.24.1-r0
shared-mime-info-2.2-r1
snappy-1.1.9-r4
soxr-0.1.3-r3
speexdsp-1.2.1-r0
sqlite-libs-3.39.4-r0
ssl_client-1.35.0-r17
svt-av1-libs-1.2.1-r0
tdb-libs-1.4.7-r0
tiff-4.4.0-r1
v4l-utils-libs-1.22.1-r2
vidstab-1.1.0-r2
wayland-libs-client-1.21.0-r1
wayland-libs-cursor-1.21.0-r1
wayland-libs-egl-1.21.0-r1
wayland-libs-server-1.21.0-r1
x264-libs-0.164_git20220602-r0
x265-libs-3.5-r3
xdg-utils-1.1.3-r4
xkeyboard-config-2.37-r0
xprop-1.2.5-r0
xset-1.2.4-r0
xvidcore-1.3.7-r1
xz-dev-5.2.7-r0
xz-libs-5.2.7-r0
yaml-0.2.5-r0
zlib-1.2.13-r0
zlib-dev-1.2.13-r0
zstd-libs-1.5.2-r9

Python dependencies

beautifulsoup4==4.10.0
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.1
chardet==3.0.4
charset-normalizer==2.0.12
click==8.0.3
contextlib2==21.6.0
cryptography==38.0.2
cssselect==1.1.0
Deprecated==1.2.13
dnspython==2.1.0
docker==4.4.1
feedparser==6.0.8
gitdb==4.0.9
GitPython==3.1.24
google-api-core==2.10.2
google-auth==2.13.0
google-cloud-core==2.3.2
google-cloud-datastore==2.9.0
google-cloud-storage==2.5.0
google-crc32c==1.5.0
google-resumable-media==2.4.0
googleapis-common-protos==1.56.4
grpcio==1.50.0
grpcio-status==1.50.0
html-similarity==0.3.3
httpretty==1.1.4
idna==2.10
kubernetes==20.13.0
libcst==0.4.7
lxml==4.9.1
mypy-extensions==0.4.3
oauthlib==3.2.2
packaging==21.3
parsel==1.6.0
proto-plus==1.22.1
protobuf==4.21.8
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pyOpenSSL==22.0.0
pyparsing==3.0.9
python-dateutil==2.8.2
pytz==2021.3
PyYAML==6.0
redis==4.1.0
requests==2.26.0
requests-oauthlib==1.3.1
responses==0.22.0
retrying==1.3.3
rq==1.8.0
rsa==4.7.2
selenium==3.141.0
sgmllib3k==1.0.0
six==1.16.0
smmap==3.0.4
smmap2==2.0.5
soupsieve==2.2.1
tenacity==5.1.5
toml==0.10.2
types-toml==0.10.8
typing-inspect==0.8.0
typing_extensions==4.4.0
urllib3==1.26.7
w3lib==1.22.0
websocket-client==0.59.0
wrapt==1.14.1