Backup for Grafana and Nextcloud not working

[AdMo]

Dear Community,

I'm looking for help for the following issues when backing up grafana and nextcloud:

Backup of [hidden] (Grafana) failed: Could not pipe http://172.18.0.2:3000/backup?access_token=[hidden] to /home/yellowtent/appsdata/33711a7d-a850-/dump.rdb: connect ECONNREFUSED 172.18.0.2:3000

The IP 172.18.0.2 seems not to exist (172.18.0.1 is there).

Nextcloud backup stops with:

Mar 04 11:44:52 box:taskworker Starting task 2949. Logs are at /home/yellowtent/platformdata/logs/tasks/2949.log
Mar 04 11:44:52 box:taskworker Running task of type appBackup
Mar 04 11:44:52 box:tasks updating task 2949 with: {"percent":1,"message":"Backing up [hiddeen] Waiting for lock"}
Mar 04 11:44:52 box:locks write: current locks: {"app_backup_b19f0354-bebd-4265-82fe-71ca2f8b79a4":"2949"}
Mar 04 11:44:52 box:locks acquire: app_backup_b19f0354-bebd-4265-82fe-71ca2f8b79a4
Mar 04 11:44:52 box:tasks updating task 2949 with: {"message":"Snapshotting app [hidden]"}
Mar 04 11:44:52 box:services backupAddons
Mar 04 11:44:52 box:services backupAddons: backing up ["postgresql","ldap","sendmail","oidc","redis","localstorage","scheduler","turn"]
Mar 04 11:44:52 box:services Backing up postgresql
Mar 04 11:44:52 box:services pipeRequestToFile: connected with status code 200
Mar 04 11:44:53 box:services Backing up redis
Mar 04 11:44:58 box:services pipeRequestToFile: timeout - connect or post-connect idle timeout
Mar 04 11:44:58 box:tasks setCompleted - 2949: {"result":null,"error":{"message":"Task crashed. Request timedout","stack":"Error: Request timedout\n at ClientRequest.<anonymous> (/home/yellowtent/box/src/services.js:1351:20)\n at Object.onceWrapper (node:events:633:28)\n at ClientRequest.emit (node:events:519:28)\n at Socket.emitRequestTimeout (node:_http_client:863:9)\n at Object.onceWrapper (node:events:633:28)\n at Socket.emit (node:events:531:35)\n at Socket._onTimeout (node:net:604:8)\n at listOnTimeout (node:internal/timers:588:17)\n at process.processTimers (node:internal/timers:523:7)","code":"crashed"},"percent":100}
Mar 04 11:44:58 box:tasks updating task 2949 with: {"completed":true,"result":null,"error":{"message":"Task crashed. Request timedout","stack":"Error: Request timedout\n at ClientRequest.<anonymous> (/home/yellowtent/box/src/services.js:1351:20)\n at Object.onceWrapper (node:events:633:28)\n at ClientRequest.emit (node:events:519:28)\n at Socket.emitRequestTimeout (node:_http_client:863:9)\n at Object.onceWrapper (node:events:633:28)\n at Socket.emit (node:events:531:35)\n at Socket._onTimeout (node:net:604:8)\n at listOnTimeout (node:internal/timers:588:17)\n at process.processTimers (node:internal/timers:523:7)","code":"crashed"},"percent":100}
Mar 04 11:44:58 box:taskworker Task took 5.92 seconds
Mar 04 11:44:58 Error: Request timedout
Mar 04 11:44:58 at ClientRequest.<anonymous> (/home/yellowtent/box/src/services.js:1351:20)
Mar 04 11:44:58 at Object.onceWrapper (node:events:633:28)
Mar 04 11:44:58 at ClientRequest.emit (node:events:519:28)
Mar 04 11:44:58 at Socket.emitRequestTimeout (node:_http_client:863:9)
Mar 04 11:44:58 at Object.onceWrapper (node:events:633:28)
Mar 04 11:44:58 at Socket.emit (node:events:531:35)
Mar 04 11:44:58 at Socket._onTimeout (node:net:604:8)
Mar 04 11:44:58 at listOnTimeout (node:internal/timers:588:17)
Mar 04 11:44:58 at process.processTimers (node:internal/timers:523:7)
Mar 04 11:44:58 Exiting with code 50

I already tried removing /mnt/managedbackups/.../snapshot/, restarting apps.

Any ideas what is wrong?

[joseph]

@AdMo said:

Mar 04 11:44:53 box:services Backing up redis
Mar 04 11:44:58 box:services pipeRequestToFile: timeout - connect or post-connect idle timeout

Most likely redis is not running or needs more memory. Go to services -> redis . Edit it and give it much more memory. That should most likely fix it.

[james]

Hello @admo

Please provide more details:

• Cloudorn version
• backup provider
• backup type TGZ or RSYNC?
• Grafana and Nextcloud app version

Also run the Troubleshooting tool and post the output of it here.

[AdMo]

Thank you for the fast answer.

1. Cloudorn version
   Cloudron Version 9.0.17 (Ubuntu Version Ubuntu 24.04.3 LTS Linux 6.8.0-100-generic)

2. backup provider
   full disk mounted auto as /mnt/managedbackups/...
   I already tried local backup - no change;

3. backup type TGZ or RSYNC?
   tried both; no change

4. Grafana and Nextcloud app version
   Grafana 12.4.0 (and previous versions)
   Nextcloud 32.0.6

5. Troubleshooting tool:

Vendor: QEMU Product: Standard PC (i440FX + PIIX, 1996)
Linux: 6.8.0-100-generic
Ubuntu: noble 24.04
Execution environment: kvm
Processor: 13th Gen Intel(R) Core(TM) i9-13900H
BIOS pc-i440fx-10.1  CPU @ 2.0GHz x 8
RAM: 32859220KB
Disk: /dev/sda2       2.7T
[OK]	node version is correct
[OK]	IPv6 is enabled in kernel. No public IPv6 address
[OK]	docker is running
[OK]	docker version is correct
[OK]	MySQL is running
[OK]	netplan is good
[OK]	DNS is resolving via systemd-resolved
[OK]	unbound is running
[OK]	nginx is running
[OK]	dashboard cert is valid
[OK]	dashboard is reachable via loopback
[OK]	No pending database migrations
[OK]	Service 'mysql' is running and healthy
[OK]	Service 'postgresql' is running and healthy
[OK]	Service 'mongodb' is running and healthy
[OK]	Service 'mail' is running and healthy
[OK]	Service 'graphite' is running and healthy
[OK]	Service 'sftp' is running and healthy
[OK]	box v9.0.17 is running
[FAIL]	Could not load dashboard domain. (this isn't working as I have a VPS routing all the traffic due to CGNAT)

[joseph]

@AdMo said:

Mar 04 11:44:53 box:services Backing up redis
Mar 04 11:44:58 box:services pipeRequestToFile: timeout - connect or post-connect idle timeout

Most likely redis is not running or needs more memory. Go to services -> redis . Edit it and give it much more memory. That should most likely fix it.

[AdMo]

fixed - after increasing redis memory it works now (will keep an eye on it from now on).
Thank you very much!
Good day today as I learned something new