nextcloud doesn't start after backup - need manual restart

[filipdot]

Steps to reproduce

1. use a nextcloud
2. wait till in make backup at 0400
3. wake up and find out that it wasn't working
4. restart nextcloud-aio-nextcloud
5. now it working

Logs after 0400:

2024-11-08T04:04:19.929551035Z Connection to nextcloud-aio-database (172.23.0.4) 5432 port [tcp/postgresql] succeeded!

2024-11-08T04:04:22.053029259Z now

2024-11-08T04:04:22.053073021Z -------------------------------

2024-11-08T04:04:22.053077291Z 2024-11-08 04:04:22.052456+00

2024-11-08T04:04:22.053080661Z (1 row)

2024-11-08T04:04:22.053084031Z

2024-11-08T04:04:22.162095396Z + '[' -f /dev-dri-group-was-added ']'

2024-11-08T04:04:22.162386218Z ++ find /dev -maxdepth 1 -mindepth 1 -name dri

2024-11-08T04:04:22.162987144Z + '[' -n '' ']'

2024-11-08T04:04:22.163023635Z + set +x

2024-11-08T04:04:22.172344547Z Enabling Imagick...

2024-11-08T07:44:11.166076618Z Connection to nextcloud-aio-database (172.23.0.4) 5432 port [tcp/postgresql] succeeded!

2024-11-08T07:44:13.185481131Z now

2024-11-08T07:44:13.185532213Z -------------------------------

2024-11-08T07:44:13.185538133Z 2024-11-08 07:44:13.184833+00

2024-11-08T07:44:13.185543064Z (1 row)

2024-11-08T07:44:13.185548414Z

2024-11-08T07:44:13.200079583Z + '[' -f /dev-dri-group-was-added ']'

2024-11-08T07:44:13.200330523Z ++ find /dev -maxdepth 1 -mindepth 1 -name dri

2024-11-08T07:44:13.200814783Z + '[' -n '' ']'

2024-11-08T07:44:13.200836644Z + set +x

2024-11-08T07:44:13.209182022Z Enabling Imagick...

2024-11-08T07:44:14.833696194Z WARNING: opening from cache https://dl-cdn.alpinelinux.org/alpine/v3.20/main: No such file or directory

2024-11-08T07:44:14.833725355Z WARNING: opening from cache https://dl-cdn.alpinelinux.org/alpine/v3.20/community: No such file or directory

2024-11-08T07:44:14.852795439Z Connection to nextcloud-aio-redis (172.23.0.5) 6379 port [tcp/redis] succeeded!

2024-11-08T07:44:17.050220297Z Applying one-click-instance settings...

2024-11-08T07:44:17.682240211Z System config value one-click-instance set to boolean true

2024-11-08T07:44:18.349868219Z System config value one-click-instance.user-limit set to integer 100

2024-11-08T07:44:19.000115173Z System config value one-click-instance.link set to string https://nextcloud.com/all-in-one/

2024-11-08T07:44:19.653047025Z support already enabled

2024-11-08T07:44:19.671640140Z Adjusting log files...

2024-11-08T07:44:20.291345704Z System config value upgrade.cli-upgrade-link set to string #2726

2024-11-08T07:44:20.935585014Z System config value logfile set to string /var/www/html/data/nextcloud.log

2024-11-08T07:44:21.587541897Z Config value were not updated

2024-11-08T07:44:22.216101991Z System config value updatedirectory set to string /nc-updater

2024-11-08T07:44:22.840478785Z System config value maintenance_window_start set to integer 100

2024-11-08T07:44:22.856729605Z Applying network settings...

2024-11-08T07:44:23.471337362Z System config value allow_local_remote_servers set to boolean true

2024-11-08T07:44:24.113453407Z System config value davstorage.request_timeout set to integer 3600

2024-11-08T07:44:24.734118471Z System config value trusted_domains => 1 set to string domainname

2024-11-08T07:44:25.376105570Z System config value overwrite.cli.url set to string https://domainnamel/

2024-11-08T07:44:26.043828614Z System config value htaccess.RewriteBase set to string /

2024-11-08T07:44:26.700962067Z .htaccess has been updated

2024-11-08T07:44:27.394070042Z System config value dbpersistent set to boolean false

2024-11-08T07:44:28.102907504Z System config value auth.bruteforce.protection.enabled set to boolean true

2024-11-08T07:44:28.718900649Z System config value ratelimit.protection.enabled set to boolean true

2024-11-08T07:44:29.354575473Z System config value files_external_allow_create_new_local set to boolean true

2024-11-08T07:44:33.594882733Z notify_push is up-to-date or no updates could be found

2024-11-08T07:44:34.222075203Z System config value trusted_proxies => 0 set to string 127.0.0.1

2024-11-08T07:44:34.836640050Z System config value trusted_proxies => 1 set to string ::1

2024-11-08T07:44:35.490817206Z System config value trusted_proxies => 10 set to string 172.23.0.0/16

2024-11-08T07:44:36.126561254Z Config value were not updated

2024-11-08T07:44:36.143453299Z + echo nextcloud-aio-collabora

2024-11-08T07:44:36.143484860Z + grep -q 'nextcloud-.*-collabora'

2024-11-08T07:44:36.144179128Z + COLLABORA_HOST=domainname

2024-11-08T07:44:36.144190509Z + set +x

2024-11-08T07:44:37.409462852Z richdocuments is up-to-date or no updates could be found

2024-11-08T07:44:38.039561241Z Config value were not updated

2024-11-08T07:44:38.826329217Z No ipv6-address found for domainname.

2024-11-08T07:44:39.474682046Z Config value were not updated

2024-11-08T07:44:39.492035440Z + '[' -z '' ']'

2024-11-08T07:44:39.492066162Z + TALK_HOST=domainname

2024-11-08T07:44:39.492069262Z + HPB_PATH=/standalone-signaling/

2024-11-08T07:44:39.492071732Z + '[' -z '' ']'

2024-11-08T07:44:39.492074072Z + TURN_DOMAIN= domainname

2024-11-08T07:44:39.492076432Z + set +x

2024-11-08T07:44:40.798902043Z spreed new version available: 19.0.11

2024-11-08T07:44:53.905852745Z spreed updated

2024-11-08T07:44:55.998206798Z Connection to nextcloud-aio-talk-recording (172.23.0.8) 1234 port [tcp/*] succeeded!

2024-11-08T07:44:56.708238174Z Config value were not updated

2024-11-08T07:44:56.729906942Z Connection to nextcloud-aio-clamav (172.23.0.6) 3310 port [tcp/*] succeeded!

2024-11-08T07:44:58.175315812Z files_antivirus is up-to-date or no updates could be found

2024-11-08T07:44:58.822507497Z Config value were not updated

2024-11-08T07:44:59.447053893Z Config value were not updated

2024-11-08T07:45:00.084996794Z Config value were not updated

2024-11-08T07:45:00.712407916Z Config value were not updated

2024-11-08T07:45:01.336784996Z Config value were not updated

2024-11-08T07:45:01.973221115Z Config value were not updated

2024-11-08T07:45:02.608223347Z System config value enabledPreviewProviders => 0 set to string OC\Preview\Imaginary

2024-11-08T07:45:03.236328178Z System config value preview_imaginary_url set to string http://nextcloud-aio-imaginary:9000

2024-11-08T07:45:03.879422268Z System config value preview_imaginary_key set to string 4689aefce00655a1fc1b56d3344a605c5e72bcff69e42ac7

2024-11-08T07:45:03.898147937Z Connection to nextcloud-aio-fulltextsearch (172.23.0.7) 9200 port [tcp/*] succeeded!

2024-11-08T07:45:05.193728519Z fulltextsearch is up-to-date or no updates could be found

2024-11-08T07:45:06.479826425Z fulltextsearch_elasticsearch is up-to-date or no updates could be found

2024-11-08T07:45:07.953594038Z files_fulltextsearch is up-to-date or no updates could be found

2024-11-08T07:45:08.598055354Z {

2024-11-08T07:45:08.598094645Z "search_platform": "OCA\FullTextSearch_Elasticsearch\Platform\ElasticSearchPlatform",

2024-11-08T07:45:08.598098655Z "app_navigation": "0",

2024-11-08T07:45:08.598101446Z "provider_indexed": "{"test_provider":"0","deck":"1","files":"1"}",

2024-11-08T07:45:08.598104626Z "cron_err_reset": "1730892546",

2024-11-08T07:45:08.598107126Z "tick_ttl": "1800",

2024-11-08T07:45:08.598109626Z "collection_indexing_list": "50",

2024-11-08T07:45:08.598112556Z "migration_24": "1",

2024-11-08T07:45:08.598114986Z "collection_internal": "local"

2024-11-08T07:45:08.598117456Z }

2024-11-08T07:45:09.222729086Z {

2024-11-08T07:45:09.222761798Z "elastic_host": "http://elastic:165340c5d03cdf6f3972732dfd27ffd0fabe4b3f358e9cdd@nextcloud-aio-fulltextsearch:9200",

2024-11-08T07:45:09.222768998Z "elastic_index": "nextcloud-aio",

2024-11-08T07:45:09.222774288Z "fields_limit": "10000",

2024-11-08T07:45:09.222780238Z "es_ver_below66": "0",

2024-11-08T07:45:09.222785209Z "elastic_logger_enabled": "true",

2024-11-08T07:45:09.222790069Z "analyzer_tokenizer": "standard",

2024-11-08T07:45:09.222795259Z "allow_self_signed_cert": "false"

2024-11-08T07:45:09.222800129Z }

2024-11-08T07:45:09.837774168Z {

2024-11-08T07:45:09.837808229Z "files_local": "1",

2024-11-08T07:45:09.837811990Z "files_external": "0",

2024-11-08T07:45:09.837829650Z "files_group_folders": "0",

2024-11-08T07:45:09.837832240Z "files_encrypted": "0",

2024-11-08T07:45:09.837834651Z "files_federated": "0",

2024-11-08T07:45:09.837837011Z "files_size": "20",

2024-11-08T07:45:09.837839371Z "files_pdf": "1",

2024-11-08T07:45:09.837841691Z "files_office": "1",

2024-11-08T07:45:09.837844041Z "files_image": "0",

2024-11-08T07:45:09.837846461Z "files_audio": "0",

2024-11-08T07:45:09.837848821Z "files_chunk_size": "2"

2024-11-08T07:45:09.837851291Z }

2024-11-08T07:45:11.128353358Z whiteboard is up-to-date or no updates could be found

2024-11-08T07:45:11.758219602Z Config value were not updated

2024-11-08T07:45:12.382991489Z Config value were not updated

2024-11-08T07:45:12.420240220Z + '[' true = true ']'

2024-11-08T07:45:12.420264431Z + '[' 11000 = 443 ']'

2024-11-08T07:45:12.420267851Z + set +x

2024-11-08T07:45:13.679376015Z [08-Nov-2024 07:45:13] NOTICE: fpm is running, pid 658

2024-11-08T07:45:13.679404196Z [08-Nov-2024 07:45:13] NOTICE: ready to handle connections

2024-11-08T07:45:28.599029166Z Activating Collabora config...

2024-11-08T07:45:29.254567814Z ✓ Reset callback url autodetect

2024-11-08T07:45:29.254597476Z Checking configuration

2024-11-08T07:45:29.254600636Z 🛈 Configured WOPI URL: https://domainname

2024-11-08T07:45:29.254603136Z 🛈 Configured public WOPI URL: https://domainname

2024-11-08T07:45:29.254606126Z 🛈 Configured callback URL:

2024-11-08T07:45:29.254608496Z

2024-11-08T07:45:29.433021237Z ✓ Fetched /hosting/discovery endpoint

2024-11-08T07:45:29.434639383Z ✓ Valid mimetype response

2024-11-08T07:45:29.436185225Z ✓ Valid capabilities entry

2024-11-08T07:45:29.513033075Z ✓ Fetched /hosting/capabilities endpoint

2024-11-08T07:45:29.513396170Z ✓ Detected WOPI server: Collabora Online Development Edition 24.04.9.1

2024-11-08T07:45:29.515157962Z

2024-11-08T07:45:29.515183373Z Collabora URL (used for Nextcloud to contact the Collabora server):

2024-11-08T07:45:29.515186843Z https://domainname

2024-11-08T07:45:29.515189933Z Collabora public URL (used in the browser to open Collabora):

2024-11-08T07:45:29.515192593Z https://domainname

2024-11-08T07:45:29.515195133Z Callback URL (used by Collabora to connect back to Nextcloud):

2024-11-08T07:45:29.515197733Z autodetected (will use the same URL as your user for browsing Nextcloud)

Other information

Host OS

docker on ubuntu 22.04

Output of sudo docker info

Client: Docker Engine - Community
Version: 27.3.1
Context: default
Debug Mode: false
Plugins:
buildx: Docker Buildx (Docker Inc.)
Version: v0.17.1
Path: /usr/libexec/docker/cli-plugins/docker-buildx
compose: Docker Compose (Docker Inc.)
Version: v2.29.7
Path: /usr/libexec/docker/cli-plugins/docker-compose
scan: Docker Scan (Docker Inc.)
Version: v0.23.0
Path: /usr/libexec/docker/cli-plugins/docker-scan

Server:
Containers: 47
Running: 42
Paused: 0
Stopped: 5
Images: 61
Server Version: 27.3.1
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Using metacopy: false
Native Overlay Diff: true
userxattr: false
Logging Driver: json-file
Cgroup Driver: systemd
Cgroup Version: 2
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
Swarm: inactive
Runtimes: io.containerd.runc.v2 runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c
runc version: v1.1.14-0-g2c9f560
init version: de40ad0
Security Options:
apparmor
seccomp
Profile: builtin
cgroupns
Kernel Version: 5.15.0-124-generic
Operating System: Ubuntu 22.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 31.33GiB
Name: ubuntu2204lts
ID: 4TVN:GN7V:7BAZ:D5ZC:M745:GJ4E:CVQI:4IKH:IK4P:DL2K:SWL2:54HN
Docker Root Dir: /var/lib/docker
Debug Mode: false
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false

WARNING: bridge-nf-call-iptables is disabled
WARNING: bridge-nf-call-ip6tables is disabled

Docker run command or docker-compose file that you used

version: "3.8"
volumes:
nextcloud_aio_mastercontainer:
name: nextcloud_aio_mastercontainer # This line is not allowed to be changed

services:
nextcloud:
image: nextcloud/all-in-one:latest # Must be changed to 'nextcloud/all-in-one:latest-arm64' when used with an arm64 CPU
restart: always
container_name: nextcloud-aio-mastercontainer # This line is not allowed to be changed
volumes:
- nextcloud_aio_mastercontainer:/mnt/docker-aio-config # This line is not allowed to be changed
- /var/run/docker.sock:/var/run/docker.sock:ro # May be changed on macOS, Windows or docker rootless. See the applicable documentation
ports:
- 8080:8080
- 8443:8443 # Can be removed when running behind a reverse proxy. See https://github.com/nextcloud/all-in-one/blob/main/reverse-proxy.md
environment: # Is needed when using any of the options below
- APACHE_PORT=11000 # Is needed when running behind a reverse proxy. See https://github.com/nextcloud/all-in-one/blob/main/reverse-proxy.md
# - APACHE_IP_BINDING=127.0.0.1 # Should be set when running behind a reverse proxy that is running on the same host. See https://github.com/nextcloud/all-in-one/blob/main/reverse-proxy.md
- TALK_PORT=3478 # This allows to adjust the port that the talk container is using.
- NEXTCLOUD_DATADIR=/mnt/ncdata
- NEXTCLOUD_MOUNT=/mnt/
- NEXTCLOUD_UPLOAD_LIMIT=20G
- NEXTCLOUD_MEMORY_LIMIT=1024M
- NEXTCLOUD_MAX_TIME=3600

Other valuable info

[szaimen]

Hi, can you post the output of sudo docker logs nextcloud-aio-mastercontainer here?

[filipdot]

Here:
logs mastercontainer.txt

[szaimen]

This reminds me of #5222 (comment)