Scaleway Backup Failed

[superhua]

Our Scaleway backup recently started to fail with the following notification:

Backup failed: Upload error: code: UnknownEndpoint message: Inaccessible host: example.s3.nl-ams.scw.cloud' at portundefined'. This service may not be available in the `nl-ams' region..

Recent logs:

Dec 02 04:18:10 box:backupupload upload completed. error: BoxError: Upload error: code: UnknownEndpoint message: Inaccessible host: `example.s3.nl-ams.scw.cloud' at port `undefined'. This service may not be available in the `nl-ams' region. at Object.finish (/home/yellowtent/box/src/storage/s3.js:129:30) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async tarPack (/home/yellowtent/box/src/backupformat/tgz.js:174:5) at async /home/yellowtent/box/src/backupformat/tgz.js:266:9 at async promiseRetry (/home/yellowtent/box/src/promise-retry.js:17:20) at async Object.upload (/home/yellowtent/box/src/backupformat/tgz.js:262:5) at async Object.upload (/home/yellowtent/box/src/backuptask.js:91:5) { reason: 'External Error', details: {} }
Dec 02 04:18:10 box:backuptask runBackupUpload: result - {"result":"Upload error: code: UnknownEndpoint message: Inaccessible host: `example.s3.nl-ams.scw.cloud' at port `undefined'. This service may not be available in the `nl-ams' region."}
Dec 02 04:18:10 box:shell backuptask: /usr/bin/sudo -S -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_c4f23162-e4a0-4a4b-8c64-ce1dad23f1ca tgz {"localRoot":"/home/yellowtent/appsdata/c4f23162-e4a0-4a4b-8c64-ce1dad23f1ca","layout":[]} errored BoxError: backuptask exited with code 50 signal null
Dec 02 04:18:10 at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:111:19)
Dec 02 04:18:10 at ChildProcess.emit (node:events:519:28)
Dec 02 04:18:10 at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
Dec 02 04:18:10 reason: 'Shell Error',
Dec 02 04:18:10 details: {},
Dec 02 04:18:10 code: 50,
Dec 02 04:18:10 signal: null
Dec 02 04:18:10 }
Dec 02 04:18:10 box:taskworker Task took 1088.331 seconds
Dec 02 04:18:10 box:tasks setCompleted - 5149: {"result":null,"error":{"stack":"BoxError: Upload error: code: UnknownEndpoint message: Inaccessible host: `example.s3.nl-ams.scw.cloud' at port `undefined'. This service may not be available in the `nl-ams' region.\n at runBackupUpload (/home/yellowtent/box/src/backuptask.js:170:15)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:365:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:387:5)\n at async fullBackup (/home/yellowtent/box/src/backuptask.js:508:29)","name":"BoxError","reason":"External Error","details":{},"message":"Upload error: code: UnknownEndpoint message: Inaccessible host: `example.s3.nl-ams.scw.cloud' at port `undefined'. This service may not be available in the `nl-ams' region."}}
Dec 02 04:18:10 box:tasks update 5149: {"percent":100,"result":null,"error":{"stack":"BoxError: Upload error: code: UnknownEndpoint message: Inaccessible host: `example.s3.nl-ams.scw.cloud' at port `undefined'. This service may not be available in the `nl-ams' region.\n at runBackupUpload (/home/yellowtent/box/src/backuptask.js:170:15)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:365:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:387:5)\n at async fullBackup (/home/yellowtent/box/src/backuptask.js:508:29)","name":"BoxError","reason":"External Error","details":{},"message":"Upload error: code: UnknownEndpoint message: Inaccessible host: `example.s3.nl-ams.scw.cloud' at port `undefined'. This service may not be available in the `nl-ams' region."}}
Dec 02 04:18:10 BoxError: Upload error: code: UnknownEndpoint message: Inaccessible host: `example.s3.nl-ams.scw.cloud' at port `undefined'. This service may not be available in the `nl-ams' region.
Dec 02 04:18:10 at runBackupUpload (/home/yellowtent/box/src/backuptask.js:170:15)
Dec 02 04:18:10 at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Dec 02 04:18:10 at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:365:5)
Dec 02 04:18:10 at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:387:5)
Dec 02 04:18:10 at async fullBackup (/home/yellowtent/box/src/backuptask.js:508:29)

What's odd is that we have another Cloudron also backing up to the same region in Scaleway (s3.nl-ams.scw.cloud), and it is fine.

[superhua]

Update: cloudron-support --troubleshoot returns:

[WARN]	netplan configuration is empty. this might be OK depending on your networking setup
[FAIL]	DNS is not resolving

Further, /etc/netplan/ is empty. How do I generate the correct .yaml file to include there?

Final Update: I was able to crate a netplan .yaml file by following these instructions.

[nebulon]

Since nothing has changed on the Cloudron side, did you ask scaleway support if they may have changed anything?

[joseph]

@superhua said in Scaleway Backup Failed:

s3.nl-ams.scw.cloud

Can you check if host s3.nl-ams.scw.cloud works on your server? Did you use Scaleway as the provider in the Backups view? (or the S3 compat provider?)

[joseph]

I guess you could also go to Backups -> Configure -> Save . I am guessing this doesn't work already.

[superhua]

@joseph host s3.nl-ams.scw.cloud returns: Host s3.nl-ams.scw.cloud not found: 2(SERVFAIL)

Two notes:

1. Any host query returns the same error.
2. This does not happen on my other server (which also uses Cloudron and successfully backups to Scaleway -- and is with the same server provider).

I contacted the server provider, but they replied saying they don't offer support.

Am I correct in saying this is a server issue rather than a Scaleway issue?

[jdaviescoates]

@superhua said in Scaleway Backup Failed:

I contacted the server provider, but they replied saying they don't offer support.

Which provider is this so I know to avoid them? thanks!

[superhua]

RackNerd. However, to be fair, their Black Friday promotions are good, and they have been great for what we typically need.

[jdaviescoates]

@superhua said in Scaleway Backup Failed:

Black Friday promotions

I am mostly allergic to such things. It just unsubscribe from marketing lists day for me.

[superhua]

Update: cloudron-support --troubleshoot returns:

[WARN]	netplan configuration is empty. this might be OK depending on your networking setup
[FAIL]	DNS is not resolving

Further, /etc/netplan/ is empty. How do I generate the correct .yaml file to include there?

Final Update: I was able to crate a netplan .yaml file by following these instructions.

[superhua]

This post is deleted!