The gallery is hanging (redis-serve or php-fpm ? )

[sosed213]

Steps to reproduce

When the web app gallery is paged, hangs for 5-10 seconds. The preview pictures are not uploaded.

At this point, the server loads the CPU php7-FPM 60%, and radis-server 27%.

Then it hangs, and it loads further.

I noticed that hangs occur immediately after keyspace_messes in the radis monitor.
keyspace_hits:3343725
keyspace_misses:15172

Such a problem is probably more than a year old. On previous versions, it was the same.

This problem is observed in both mysql and postgresql. On php7.0 and on php7.1.

If you start the server without a radis-server, then the cloud starts to work more slowly.

Server configuration

Core i5, 16gb, ssd 120gb + 2tb.

Operating system:
Ubuntu Server 16.04
Linux 4.4.0-128-generic #154-Ubuntu SMP Fri May 25 14:15:18 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

Web server:
nginx/1.14.0

Database:
mysql Ver 15.1 Distrib 10.2.16-MariaDB, for debian-linux-gnu (x86_64) using readline 5.2
psql (PostgreSQL) 10.4 (Ubuntu 10.4-2.pgdg16.04+1)

PHP version:
PHP 7.0.30-1+ubuntu16.04.1+deb.sury.org+1 (cli) (built: May 2 2018 12:43:14) ( NTS )
Copyright (c) 1997-2017 The PHP Group
Zend Engine v3.0.0, Copyright (c) 1998-2017 Zend Technologies
with Zend OPcache v7.0.30-1+ubuntu16.04.1+deb.sury.org+1, Copyright (c) 1999-2017, by Zend Technologies

PHP 7.1.18-1+ubuntu16.04.1+deb.sury.org+1 (cli) (built: Jun 11 2018 14:22:30) ( NTS )
Copyright (c) 1997-2018 The PHP Group
Zend Engine v3.1.0, Copyright (c) 1998-2018 Zend Technologies
with Zend OPcache v7.1.18-1+ubuntu16.04.1+deb.sury.org+1, Copyright (c) 1999-2018, by Zend Technologies

Nextcloud version: (see Nextcloud admin page)
Cloud#1 Nextcloud 13.0.4
Cloud#2 Nextcloud-Test 13.0.4

Updated from an older Nextcloud/ownCloud or fresh install:
Cloud#1 and Cloud#2
Fresh install.

Where did you install Nextcloud from:

Signing status:
Cloud#1 and Cloud#2
No errors have been found.

List of activated apps:

App list Cloud1

``` Enabled: - activity: 2.6.1 - apporder: 0.4.1 - audioplayer: 2.3.0 - bookmarks: 0.11.0 - bruteforcesettings: 1.1.0 - calendar: 1.6.1 - comments: 1.3.0 - contacts: 2.1.5 - dav: 1.4.7 - deck: 0.3.1 - drawio: 0.8.9 - dropit: 0.1.1 - federatedfilesharing: 1.3.1 - files: 1.8.0 - files_external: 1.4.1 - files_pdfviewer: 1.2.1 - files_sharing: 1.5.0 - files_texteditor: 2.5.1 - files_trashbin: 1.3.0 - files_versions: 1.6.0 - files_videoplayer: 1.2.0 - firstrunwizard: 2.2.1 - flowupload: 0.0.7 - gallery: 18.0.0 - logreader: 2.0.0 - lookup_server_connector: 1.1.0 - mail: 0.8.2 - nextcloud_announcements: 1.2.0 - notes: 2.3.2 - notifications: 2.1.2 - oauth2: 1.1.1 - ocsms: 1.13.1 - onlyoffice: 1.3.0 - password_policy: 1.3.0 - previewgenerator: 1.0.9 - provisioning_api: 1.3.0 - radio: 0.6.1 - rainloop: 5.1.0 - serverinfo: 1.3.0 - sharebymail: 1.3.0 - spreed: 3.2.2 - tasks: 0.9.6 - theming: 1.4.5 - twofactor_backupcodes: 1.2.3 - unsplash: 1.1.1 - updatenotification: 1.3.0 - workflowengine: 1.3.0 Disabled: - admin_audit - admin_notifications - encryption - federation - files_downloadactivity - ojsxc - survey_client - systemtags - user_external - user_ldap ```

App list Cloud2

``` Enabled: - activity: 2.6.1 - admin_audit: 1.3.0 - admin_notifications: 1.0.1 - apporder: 0.4.1 - audioplayer: 2.3.0 - bookmarks: 0.11.0 - calendar: 1.6.1 - comments: 1.3.0 - contacts: 2.1.5 - dav: 1.4.7 - deck: 0.3.1 - external: 3.0.3 - federatedfilesharing: 1.3.1 - federation: 1.3.0 - files: 1.8.0 - files_downloadactivity: 1.2.0 - files_external: 1.4.1 - files_pdfviewer: 1.2.1 - files_sharing: 1.5.0 - files_snapshots: 0.1.1 - files_texteditor: 2.5.1 - files_trashbin: 1.3.0 - files_versions: 1.6.0 - files_videoplayer: 1.2.0 - firstrunwizard: 2.2.1 - gallery: 18.0.0 - groupfolders: 1.2.0 - logreader: 2.0.0 - lookup_server_connector: 1.1.0 - mail: 0.8.2 - news: 12.0.4 - nextcloud_announcements: 1.2.0 - notes: 2.3.2 - notifications: 2.1.2 - oauth2: 1.1.1 - ocsms: 1.13.1 - onlyoffice: 1.3.0 - password_policy: 1.3.0 - previewgenerator: 1.0.9 - provisioning_api: 1.3.0 - ransomware_protection: 1.1.0 - serverinfo: 1.3.0 - sharebymail: 1.3.0 - survey_client: 1.1.0 - systemtags: 1.3.0 - telephoneprovider: 1.0.1 - theming: 1.4.5 - twofactor_backupcodes: 1.2.3 - unsplash: 1.1.1 - updatenotification: 1.3.0 - weather: 1.5.1 - workflowengine: 1.3.0 Disabled: - encryption - gpxpod - user_external - user_ldap ```

Nextcloud configuration:

Config report Cloud1

``` { "system": { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "cloud.mydomain.ru", ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "overwrite.cli.url": "https:\/\/cloud.mydomain.ru", "overwriteprotocol": "https", "dbtype": "mysql", "version": "13.0.4.0", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "mysql.utf8mb4": true, "htaccess.RewriteBase": "\/", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "loglevel": 2, "logtimezone": "Asia\/Omsk", "logfile": "\/var\/www\/cloud12\/data\/nextcloud12.log", "log_rotate_size": 104857600, "cron_log": true, "filesystem_check_changes": true, "quota_include_external_storage": false, "knowledgebaseenabled": false, "cache_path": "\/var\/cache\/cloud", "memcache.local": "\\OC\\Memcache\\Redis", "filelocking.enabled": "true", "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 6379, "timeout": 0, "dbindex": 0 }, "maintenance": false, "theme": "", "enable_previews": true, "enabledPreviewProviders": [ "OC\\Preview\\Movie", "OC\\Preview\\Image", "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap" ], "enable_movie_transcode": true, "mail_smtpmode": "smtp", "mail_smtpsecure": "ssl", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauth": 1, "mail_smtpauthtype": "LOGIN", "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "465", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***" } } ```

Config report Cloud2

``` { "system": { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "cloud2.mydomain.ru", ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "overwrite.cli.url": "http:\/\/cloud2.mydomain.ru", "dbtype": "pgsql", "version": "13.0.4.0", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "filesystem_check_changes": true, "loglevel": 2, "logtimezone": "Asia\/Omsk", "log_rotate_size": 104857600, "cron_log": true, "quota_include_external_storage": false, "knowledgebaseenabled": false, "cache_path": "\/var\/cache\/cloud", "memcache.local": "\\OC\\Memcache\\Redis", "filelocking.enabled": "true", "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 6379, "timeout": 0, "dbindex": 0 }, "enable_previews": true, "preview_max_x": 2048, "preview_max_y": 2048, "preview_max_scale_factor": 2, "enabledPreviewProviders": [ "OC\\Preview\\Movie", "OC\\Preview\\Image", "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap" ], "enable_movie_transcode": true, "mail_smtpmode": "smtp", "mail_smtpauthtype": "LOGIN", "mail_smtpsecure": "ssl", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauth": 1, "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "465", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "updater.release.channel": "beta", "maintenance": false, "theme": "" } } ```

Are you using external storage, if yes which one: local/smb/sftp/...
/mnt/disk2/Doc

Are you using encryption: yes/no
No

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
No

Client configuration

Browser:
Chrome
Firefox

Operating system:
Windows 7, Windows 10, Android

Logs

Web server error log

Web server error log

Insert your webserver log here

Nextcloud log (data/nextcloud.log)

Nextcloud log

Insert your Nextcloud log here

Browser log

Browser log

Insert your browser log here, this could for example include:

a) The javascript console log
b) The network log
c) ...

[MorrisJobke]

@sosed213 Could I ask you to open this in the gallery app, as this is most likely related to how the gallery app loads the previews and needs to be fixed there.

https://github.com/nextcloud/gallery

Thanks