humhub - Broken Backup

[wheez]

I am currently trying it with the execFiles edited out. I did with just removing the whole entry execFiles, but that gave an iteration error. So I think I need to provide an empty list which I am doing right now.

I am using the cli on macos.

Will get back when that restore attempt is done.

[wheez]

So I tried the backup with the updated fsmetadata.json
This time the restoration succeeds but it fails here:

Apr 22 17:03:37 box:backuptask downloadApp: time: 545.961
Apr 22 17:03:37 box:tasks update 312: {"percent":75,"message":"Restoring addons"}
Apr 22 17:03:37 box:services restoreAddons
Apr 22 17:03:37 box:services restoreAddons: restoring ["mysql","localstorage","sendmail","ldap","scheduler"]
Apr 22 17:03:37 box:services restoreMySql
Apr 22 17:03:37 box:services pipeFileToRequest: piping /home/yellowtent/appsdata/124b9caf-59f9-4931-9a9c-3120b74acc2a/mysqldump to http://172.18.30.1:3000/databases/1dc1f3e09796534e/restore?access_token=b5607c10af035cecffc97fd883a114531ca0bebd2ff6e2a4190b846677897f890a33f1dcb2bcc956ae757f9b081646664d6b47e3010f2ca692ad5716cafbf09eabf5cbcad07af8f026e98df0486a67314f30afedddeb723557bc8758db5ac294a4db83ea8b1b51544c412177ee1a3a70c6819e200b939d89c1b7c506a82544ff
Apr 22 17:03:37 box:apptask run: app error for state pending_import: BoxError: Error piping file /home/yellowtent/appsdata/124b9caf-59f9-4931-9a9c-3120b74acc2a/mysqldump to request http://172.18.30.1:3000/databases/1dc1f3e09796534e/restore?access_token=b5607c10af035cecffc97fd883a114531ca0bebd2ff6e2a4190b846677897f890a33f1dcb2bcc956ae757f9b081646664d6b47e3010f2ca692ad5716cafbf09eabf5cbcad07af8f026e98df0486a67314f30afedddeb723557bc8758db5ac294a4db83ea8b1b51544c412177ee1a3a70c6819e200b939d89c1b7c506a82544ff at /home/yellowtent/box/src/services.js:1388:38 at node:internal/util:539:20 at process.processTicksAndRejections (node:internal/process/task_queues:82:21) { reason: 'Addons Error', details: {} }
Apr 22 17:03:37 box:taskworker Task took 549.941 seconds
Apr 22 17:03:37 box:tasks setCompleted - 312: {"result":null,"error":{"stack":"BoxError: Error piping file /home/yellowtent/appsdata/124b9caf-59f9-4931-9a9c-3120b74acc2a/mysqldump to request http://172.18.30.1:3000/databases/1dc1f3e09796534e/restore?access_token=b5607c10af035cecffc97fd883a114531ca0bebd2ff6e2a4190b846677897f890a33f1dcb2bcc956ae757f9b081646664d6b47e3010f2ca692ad5716cafbf09eabf5cbcad07af8f026e98df0486a67314f30afedddeb723557bc8758db5ac294a4db83ea8b1b51544c412177ee1a3a70c6819e200b939d89c1b7c506a82544ff\n at /home/yellowtent/box/src/services.js:1388:38\n at node:internal/util:539:20\n at process.processTicksAndRejections (node:internal/process/task_queues:82:21)","name":"BoxError","reason":"Addons Error","details":{},"message":"Error piping file /home/yellowtent/appsdata/124b9caf-59f9-4931-9a9c-3120b74acc2a/mysqldump to request http://172.18.30.1:3000/databases/1dc1f3e09796534e/restore?access_token=b5607c10af035cecffc97fd883a114531ca0bebd2ff6e2a4190b846677897f890a33f1dcb2bcc956ae757f9b081646664d6b47e3010f2ca692ad5716cafbf09eabf5cbcad07af8f026e98df0486a67314f30afedddeb723557bc8758db5ac294a4db83ea8b1b51544c412177ee1a3a70c6819e200b939d89c1b7c506a82544ff"}}
Apr 22 17:03:37 box:tasks update 312: {"percent":100,"result":null,"error":{"stack":"BoxError: Error piping file /home/yellowtent/appsdata/124b9caf-59f9-4931-9a9c-3120b74acc2a/mysqldump to request http://172.18.30.1:3000/databases/1dc1f3e09796534e/restore?access_token=b5607c10af035cecffc97fd883a114531ca0bebd2ff6e2a4190b846677897f890a33f1dcb2bcc956ae757f9b081646664d6b47e3010f2ca692ad5716cafbf09eabf5cbcad07af8f026e98df0486a67314f30afedddeb723557bc8758db5ac294a4db83ea8b1b51544c412177ee1a3a70c6819e200b939d89c1b7c506a82544ff\n at /home/yellowtent/box/src/services.js:1388:38\n at node:internal/util:539:20\n at process.processTicksAndRejections (node:internal/process/task_queues:82:21)","name":"BoxError","reason":"Addons Error","details":{},"message":"Error piping file /home/yellowtent/appsdata/124b9caf-59f9-4931-9a9c-3120b74acc2a/mysqldump to request http://172.18.30.1:3000/databases/1dc1f3e09796534e/restore?access_token=b5607c10af035cecffc97fd883a114531ca0bebd2ff6e2a4190b846677897f890a33f1dcb2bcc956ae757f9b081646664d6b47e3010f2ca692ad5716cafbf09eabf5cbcad07af8f026e98df0486a67314f30afedddeb723557bc8758db5ac294a4db83ea8b1b51544c412177ee1a3a70c6819e200b939d89c1b7c506a82544ff"}}
Apr 22 17:03:37 BoxError: Error piping file /home/yellowtent/appsdata/124b9caf-59f9-4931-9a9c-3120b74acc2a/mysqldump to request http://172.18.30.1:3000/databases/1dc1f3e09796534e/restore?access_token=b5607c10af035cecffc97fd883a114531ca0bebd2ff6e2a4190b846677897f890a33f1dcb2bcc956ae757f9b081646664d6b47e3010f2ca692ad5716cafbf09eabf5cbcad07af8f026e98df0486a67314f30afedddeb723557bc8758db5ac294a4db83ea8b1b51544c412177ee1a3a70c6819e200b939d89c1b7c506a82544ff
Apr 22 17:03:37 at /home/yellowtent/box/src/services.js:1388:38
Apr 22 17:03:37 at node:internal/util:539:20
Apr 22 17:03:37 at process.processTicksAndRejections (node:internal/process/task_queues:82:21)

There is no mysqldump in that folder. But I tried moving the sqldump from the snapshot folder into the one I am trying to restore to.
I also tried to restore from the snapshot folder but that also does not work with the same error.

But hey it seems like some kind of progress.

[nebulon]

Try to temporarily increase the memory limit for the mysql service, in case the import is large.

Also check the logs of the mysql service itself.

[wheez]

Ok so I managed to restore the backup.
I had to upload the mysqldump and ingest it via the terminal. Then the ingestion of the database worked.
The files and modules were still missing after that. So I wrote a bash script to decrypt these folders as well and uploaded them with the file manager.

Now everything seems to be working.

[nebulon]

glad it worked out in the end, still pretty rough. I would recommend to take a fresh backup and clone the app instance from that into a new test instance, just to verify if that works then. Otherwise we have to investigate what the root cause is.