Update to version 7.3.6 failed

[mononym]

Hello.
The latest update fails on my server. The last notifications show "Failed to update Cloudron: Task 1873 timed out." In the Event Log many more failed attempts show up. The pattern is Cloudron update to version 7.3.6 was started > Backup cleaner removed 0 backups > Cloudron update errored. Error: update exited with code 1 signal null. Or:

{
  "taskId": "1894",
  "boxUpdateInfo": {
    "version": "7.3.6",
    "changelog": [
      "Fix display of box backups",
      "aws: add melbourne region",
      "mail usage: fix issue caused by deleted mailboxes",
      "reverseproxy: fix issue where renewed certs are not written to disk",
      "support: fix crash when opening tickets with 0 length files"
    ],
    "sourceTarballUrl": "https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz",
    "sourceTarballSigUrl": "https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz.sig",
    "boxVersionsUrl": "https://releases.cloudron.io/versions.json",
    "boxVersionsSigUrl": "https://releases.cloudron.io/versions.json.sig",
    "unstable": false
  }
}

{
  "taskId": "1895",
  "errorMessage": null,
  "removedBoxBackupPaths": [],
  "removedMailBackupPaths": [],
  "removedAppBackupPaths": [],
  "missingBackupPaths": []
}

{
  "taskId": "1894",
  "errorMessage": "update exited with code 1 signal null",
  "timedOut": false
}

Tried again with skipping the backup:

Feb 18 11:02:53 box:locker Acquired : box_update
Feb 18 11:02:53 box:tasks startTask - starting task 1897 with options {"timeout":72000000,"nice":15,"memoryLimit":800}. logs at /home/yellowtent/platformdata/logs/tasks/1897.log
Feb 18 11:02:53 box:shell startTask spawn: /usr/bin/sudo -S -E /home/yellowtent/box/src/scripts/starttask.sh 1897 /home/yellowtent/platformdata/logs/tasks/1897.log 15 800
Feb 18 11:02:53 box:shell startTask (stdout): sudo: unable to resolve host 1001507-513: Name or service not known
Feb 18 11:02:53 box:shell startTask (stdout): Running as unit: box-task-1897.service
Feb 18 11:02:59 box:shell startTask (stdout): Finished with result: exit-code
processes terminated with: code=exited/status=50
runtime: 6.005s
Feb 18 11:02:59 box:shell startTask (stdout): Service box-task-1897 failed to run
Feb 18 11:02:59 box:shell startTask (stdout): Service box-task-1897 finished with exit code 1
Feb 18 11:02:59 box:shell startTask code: 1, signal: null
Feb 18 11:02:59 box:tasks startTask: 1897 completed with code 1
Feb 18 11:02:59 box:locker Released : box_update
Feb 18 11:02:59 box:updater Update failed with error {
stack: 'BoxError: update exited with code 1 signal null\n' +
' at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:78:17)\n' +
' at ChildProcess.emit (node:events:513:28)\n' +
' at Process.ChildProcess._handle.onexit (node:internal/child_process:293:12)',
name: 'BoxError',
reason: 'Spawn Error',
details: {},
message: 'update exited with code 1 signal null',
code: 1,
signal: null
Feb 18 11:02:59 box:tasks startTask: 1897 done. error: {
stack: 'BoxError: update exited with code 1 signal null\n' +
' at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:78:17)\n' +
' at ChildProcess.emit (node:events:513:28)\n' +
' at Process.ChildProcess._handle.onexit (node:internal/child_process:293:12)',
name: 'BoxError',
reason: 'Spawn Error',
details: {},
message: 'update exited with code 1 signal null',
code: 1,
signal: null

Thank you for your reply.

[girish]

@mononym yeah, unfortunately, the update log is not exposed in the UI. Can you check /home/yellowtent/platformdata/logs/tasks/1894.log ?

[girish]

@mononym said in Update to version 7.3.6 failed:

1897

or the 1897.log after your updated task. Something is crashing it seems.

[mononym]

2023-02-18T11:02:54.535Z box:settings initCache: pre-load settings
2023-02-18T11:02:54.550Z box:taskworker Starting task 1897. Logs are at /home/yellowtent/platformdata/logs/tasks/1897.log
2023-02-18T11:02:54.553Z box:tasks update 1897: {"percent":1,"message":"Checking disk space"}
2023-02-18T11:02:54.564Z box:tasks update 1897: {"percent":5,"message":"Downloading and verifying release"}
2023-02-18T11:02:54.567Z box:updater Downloading https://releases.cloudron.io/versions.json to /home/yellowtent/platformdata/update/versions.json
2023-02-18T11:02:54.567Z box:updater downloadUrl: curl -s --fail https://releases.cloudron.io/versions.json -o /home/yellowtent/platformdata/update/versions.json
2023-02-18T11:02:54.567Z box:shell downloadUrl spawn: /usr/bin/curl -s --fail https://releases.cloudron.io/versions.json -o /home/yellowtent/platformdata/update/versions.json
2023-02-18T11:02:55.548Z box:updater downloadUrl: downloaded https://releases.cloudron.io/versions.json to /home/yellowtent/platformdata/update/versions.json
2023-02-18T11:02:55.548Z box:updater Downloading https://releases.cloudron.io/versions.json.sig to /home/yellowtent/platformdata/update/versions.json.sig
2023-02-18T11:02:55.548Z box:updater downloadUrl: curl -s --fail https://releases.cloudron.io/versions.json.sig -o /home/yellowtent/platformdata/update/versions.json.sig
2023-02-18T11:02:55.548Z box:shell downloadUrl spawn: /usr/bin/curl -s --fail https://releases.cloudron.io/versions.json.sig -o /home/yellowtent/platformdata/update/versions.json.sig
2023-02-18T11:02:55.936Z box:updater downloadUrl: downloaded https://releases.cloudron.io/versions.json.sig to /home/yellowtent/platformdata/update/versions.json.sig
2023-02-18T11:02:55.936Z box:updater gpgVerify: /usr/bin/gpg --status-fd 1 --no-default-keyring --keyring /home/yellowtent/box/src/releases.gpg --verify /home/yellowtent/platformdata/update/versions.json.sig /home/yellowtent/platformdata/update/versions.json
2023-02-18T11:02:55.936Z box:shell gpgVerify exec: /usr/bin/gpg --status-fd 1 --no-default-keyring --keyring /home/yellowtent/box/src/releases.gpg --verify /home/yellowtent/platformdata/update/versions.json.sig /home/yellowtent/platformdata/update/versions.json
2023-02-18T11:02:55.961Z box:shell gpgVerify (stdout): [GNUPG:] NEWSIG
[GNUPG:] KEY_CONSIDERED 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 0
[GNUPG:] SIG_ID h6xU8U2yvdlagNvYd/tQyU/RQ0A 2023-02-02 1675330575
[GNUPG:] KEY_CONSIDERED 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 0
[GNUPG:] GOODSIG 0A372F8703C493CC Cloudron UG <admin@cloudron.io>
[GNUPG:] VALIDSIG 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 2023-02-02 1675330575 0 4 0 1 10 00 0EADB19CDDA23CD0FE71E3470A372F8703C493CC
[GNUPG:] KEY_CONSIDERED 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 0
[GNUPG:] TRUST_UNDEFINED 0 pgp
[GNUPG:] VERIFICATION_COMPLIANCE_MODE 23

2023-02-18T11:02:55.961Z box:shell gpgVerify (stderr): gpg: Signature made Thu Feb  2 09:36:15 2023 UTC
gpg:                using RSA key 0EADB19CDDA23CD0FE71E3470A372F8703C493CC
gpg: Good signature from "Cloudron UG <admin@cloudron.io>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 0EAD B19C DDA2 3CD0 FE71  E347 0A37 2F87 03C4 93CC

2023-02-18T11:02:55.963Z box:updater Downloading https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz to /home/yellowtent/platformdata/update/box.tar.gz
2023-02-18T11:02:55.963Z box:updater downloadUrl: curl -s --fail https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz -o /home/yellowtent/platformdata/update/box.tar.gz
2023-02-18T11:02:55.963Z box:shell downloadUrl spawn: /usr/bin/curl -s --fail https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz -o /home/yellowtent/platformdata/update/box.tar.gz
2023-02-18T11:02:58.021Z box:updater downloadUrl: downloaded https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz to /home/yellowtent/platformdata/update/box.tar.gz
2023-02-18T11:02:58.022Z box:updater Downloading https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz.sig to /home/yellowtent/platformdata/update/box.tar.gz.sig
2023-02-18T11:02:58.022Z box:updater downloadUrl: curl -s --fail https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz.sig -o /home/yellowtent/platformdata/update/box.tar.gz.sig
2023-02-18T11:02:58.022Z box:shell downloadUrl spawn: /usr/bin/curl -s --fail https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz.sig -o /home/yellowtent/platformdata/update/box.tar.gz.sig
2023-02-18T11:02:58.411Z box:updater downloadUrl: downloaded https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz.sig to /home/yellowtent/platformdata/update/box.tar.gz.sig
2023-02-18T11:02:58.411Z box:updater gpgVerify: /usr/bin/gpg --status-fd 1 --no-default-keyring --keyring /home/yellowtent/box/src/releases.gpg --verify /home/yellowtent/platformdata/update/box.tar.gz.sig /home/yellowtent/platformdata/update/box.tar.gz
2023-02-18T11:02:58.411Z box:shell gpgVerify exec: /usr/bin/gpg --status-fd 1 --no-default-keyring --keyring /home/yellowtent/box/src/releases.gpg --verify /home/yellowtent/platformdata/update/box.tar.gz.sig /home/yellowtent/platformdata/update/box.tar.gz
2023-02-18T11:02:58.594Z box:shell gpgVerify (stdout): [GNUPG:] NEWSIG
[GNUPG:] KEY_CONSIDERED 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 0
[GNUPG:] SIG_ID Z7LAKQiRgIE5mAceEzF7mgTqV6w 2023-02-01 1675289078
[GNUPG:] KEY_CONSIDERED 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 0
[GNUPG:] GOODSIG 0A372F8703C493CC Cloudron UG <admin@cloudron.io>
[GNUPG:] VALIDSIG 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 2023-02-01 1675289078 0 4 0 1 10 00 0EADB19CDDA23CD0FE71E3470A372F8703C493CC
[GNUPG:] KEY_CONSIDERED 0EADB19CDDA23CD0FE71E3470A372F8703C493CC 0
[GNUPG:] TRUST_UNDEFINED 0 pgp
[GNUPG:] VERIFICATION_COMPLIANCE_MODE 23

2023-02-18T11:02:58.594Z box:shell gpgVerify (stderr): gpg: Signature made Wed Feb  1 22:04:38 2023 UTC
gpg:                using RSA key 0EADB19CDDA23CD0FE71E3470A372F8703C493CC
gpg: Good signature from "Cloudron UG <admin@cloudron.io>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 0EAD B19C DDA2 3CD0 FE71  E347 0A37 2F87 03C4 93CC

2023-02-18T11:02:58.596Z box:updater extractTarball: tar -zxf /home/yellowtent/platformdata/update/box.tar.gz -C /tmp/box-4230898975
2023-02-18T11:02:58.596Z box:shell extractTarball spawn: /bin/tar -zxf /home/yellowtent/platformdata/update/box.tar.gz -C /tmp/box-4230898975
2023-02-18T11:02:59.839Z box:updater extractTarball: extracted /home/yellowtent/platformdata/update/box.tar.gz to /tmp/box-4230898975
2023-02-18T11:02:59.839Z box:updater Updating box with https://releases.cloudron.io/box-7df1399f17-b36f59f481-7.3.6.tar.gz
2023-02-18T11:02:59.839Z box:tasks update 1897: {"percent":70,"message":"Installing update"}
2023-02-18T11:02:59.840Z box:shell update spawn: /usr/bin/sudo -S /home/yellowtent/box/src/scripts/update.sh /tmp/box-4230898975
2023-02-18T11:02:59.847Z box:shell update (stdout): sudo: unable to resolve host 1001507-513: Name or service not known

2023-02-18T11:02:59.859Z box:shell update (stdout): Updating Cloudron with /tmp/box-4230898975
=> reset service cloudron-updater status (of previous update)

2023-02-18T11:02:59.871Z box:shell update (stdout): Failed to install cloudron. See log for details

2023-02-18T11:02:59.872Z box:shell update code: 1, signal: null
2023-02-18T11:02:59.873Z box:taskworker Task took 5.385 seconds
2023-02-18T11:02:59.873Z box:tasks setCompleted - 1897: {"result":null,"error":{"stack":"BoxError: update exited with code 1 signal null\n    at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:78:17)\n    at ChildProcess.emit (node:events:513:28)\n    at Process.ChildProcess._handle.onexit (node:internal/child_process:293:12)","name":"BoxError","reason":"Spawn Error","details":{},"message":"update exited with code 1 signal null","code":1,"signal":null}}
2023-02-18T11:02:59.873Z box:tasks update 1897: {"percent":100,"result":null,"error":{"stack":"BoxError: update exited with code 1 signal null\n    at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:78:17)\n    at ChildProcess.emit (node:events:513:28)\n    at Process.ChildProcess._handle.onexit (node:internal/child_process:293:12)","name":"BoxError","reason":"Spawn Error","details":{},"message":"update exited with code 1 signal null","code":1,"signal":null}}
2023-02-18T11:02:59.864Z box:shell update (stdout): => Run installer.sh as cloudron-updater.

2023-02-18T11:02:59.865Z box:shell update (stdout): => starting service cloudron-updater. see logs at /home/yellowtent/platformdata/logs/updater/cloudron-updater-2023-02-18_11-02-59.log

2023-02-18T11:02:59.871Z box:shell update (stdout): Failed to start transient service unit: Unit cloudron-updater.service already exists.

BoxError: update exited with code 1 signal null
    at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:78:17)
    at ChildProcess.emit (node:events:513:28)
    at Process.ChildProcess._handle.onexit (node:internal/child_process:293:12)

[girish]

@mononym said in Update to version 7.3.6 failed:

2023-02-18T11:02:59.865Z box:shell update (stdout): => starting service cloudron-updater. see logs at /home/yellowtent/platformdata/logs/updater/cloudron-updater-2023-02-18_11-02-59.log

2023-02-18T11:02:59.871Z box:shell update (stdout): Failed to start transient service unit: Unit cloudron-updater.service already exists.

I think the another updater is running in background (not sure). Can you try systemctl kill cloudron-updater ? And then try to update again?

Can you also check journalctl -u cloudron-updater -a ? Anything interesting there in the end?

[mononym]

@girish said in Update to version 7.3.6 failed:

systemctl kill cloudron-updater

This solved it ! Thank you !