Docuseal wouldn't crashed and wouldn't start
-
Hello,
This morning I uploaded a doc and the app crashed, I go the Cloudron page: This app is unresponsive". I tried to restart the app but it got Stuck on the "Starting" state. Then rebooted the server and same thing.
See the log that has the error in case there is a bug:
2023-11-12T08:43:21.000Z ==> changing permissions 2023-11-12T08:43:21.000Z ==> starting docuseal 2023-11-12T08:43:23.000Z ==> changing permissions 2023-11-12T08:43:23.000Z ==> starting docuseal 2023-11-12T08:43:23.000Z => Booting Puma 2023-11-12T08:43:23.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:23.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:23.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:23.000Z Exiting 2023-11-12T08:43:24.000Z => Booting Puma 2023-11-12T08:43:24.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:24.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:24.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:24.000Z Exiting 2023-11-12T08:43:25.000Z ==> changing permissions 2023-11-12T08:43:25.000Z ==> starting docuseal 2023-11-12T08:43:26.000Z => Booting Puma 2023-11-12T08:43:26.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:26.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:26.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:26.000Z Exiting 2023-11-12T08:43:27.000Z ==> changing permissions 2023-11-12T08:43:27.000Z ==> starting docuseal 2023-11-12T08:43:28.000Z => Booting Puma 2023-11-12T08:43:28.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:28.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:28.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:28.000Z Exiting 2023-11-12T08:43:30.000Z ==> changing permissions 2023-11-12T08:43:30.000Z ==> starting docuseal 2023-11-12T08:43:31.000Z => Booting Puma 2023-11-12T08:43:31.000Z => Healtheck error: Error: connect ECONNREFUSED 172.18.16.128:3000 2023-11-12T08:43:31.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:31.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:31.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:31.000Z Exiting 2023-11-12T08:43:35.000Z ==> changing permissions 2023-11-12T08:43:35.000Z ==> starting docuseal 2023-11-12T08:43:36.000Z => Booting Puma 2023-11-12T08:43:36.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:36.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:36.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:36.000Z Exiting 2023-11-12T08:43:43.000Z ==> changing permissions 2023-11-12T08:43:43.000Z ==> starting docuseal 2023-11-12T08:43:44.000Z => Booting Puma 2023-11-12T08:43:44.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:44.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:44.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:44.000Z Exiting 2023-11-12T08:43:47.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:43:57.000Z ==> changing permissions 2023-11-12T08:43:57.000Z ==> starting docuseal 2023-11-12T08:43:57.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:43:58.000Z => Booting Puma 2023-11-12T08:43:58.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:43:58.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:43:58.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:43:58.000Z Exiting 2023-11-12T08:44:01.000Z ==> changing permissions 2023-11-12T08:44:01.000Z ==> starting docuseal 2023-11-12T08:44:01.166Z box:taskworker Starting task 14329. Logs are at /home/yellowtent/platformdata/logs/d99d4145-455f-4681-97ce-5aad9341b430/apptask.log 2023-11-12T08:44:01.182Z box:apptask run: startTask installationState: pending_restart runState: running 2023-11-12T08:44:01.182Z box:tasks update 14329: {"percent":10,"message":"Starting app services"} 2023-11-12T08:44:01.185Z box:tasks update 14329: {"percent":20,"message":"Restarting container"} 2023-11-12T08:44:01.678Z box:tasks update 14329: {"percent":80,"message":"Configuring reverse proxy"} 2023-11-12T08:44:01.706Z box:reverseproxy providerMatchesSync: subject=CN = sign.catalystcollective.org domain=sign.catalystcollective.org issuer=C = US, O = Let's Encrypt, CN = R3 wildcard=false/false prod=true/true issuerMismatch=false wildcardMismatch=false match=true 2023-11-12T08:44:01.718Z box:reverseproxy ensureCertificate: sign.catalystcollective.org acme cert exists and is up to date 2023-11-12T08:44:01.718Z box:reverseproxy expiryDate: subject=CN = sign.catalystcollective.org notBefore=Oct 30 09:57:45 2023 GMT notAfter=Jan 28 09:57:44 2024 GMT daysLeft=77.05118383101852 2023-11-12T08:44:01.718Z box:reverseproxy needsRenewal: false. force: false 2023-11-12T08:44:01.738Z box:reverseproxy writeAppLocationNginxConfig: writing config for "sign.catalystcollective.org" to /home/yellowtent/platformdata/nginx/applications/d99d4145-455f-4681-97ce-5aad9341b430/sign.catalystcollective.org.conf with options {"sourceDir":"/home/yellowtent/box","vhost":"sign.catalystcollective.org","hasIPv6":true,"ip":"172.18.16.128","port":3000,"endpoint":"app","redirectTo":null,"certFilePath":"/home/yellowtent/platformdata/nginx/cert/sign.catalystcollective.org.cert","keyFilePath":"/home/yellowtent/platformdata/nginx/cert/sign.catalystcollective.org.key","robotsTxtQuoted":null,"cspQuoted":null,"hideHeaders":[],"proxyAuth":{"enabled":false,"id":"d99d4145-455f-4681-97ce-5aad9341b430","location":"/"},"upstreamUri":"","ocsp":true,"hstsPreload":false} 2023-11-12T08:44:01.739Z box:shell reload spawn: /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx 2023-11-12T08:44:01.855Z box:tasks update 14329: {"percent":100,"message":"Done"} 2023-11-12T08:44:01.863Z box:tasks setCompleted - 14329: {"result":null,"error":null} 2023-11-12T08:44:01.863Z box:tasks update 14329: {"percent":100,"result":null,"error":null} 2023-11-12T08:44:01.863Z box:taskworker Task took 0.734 seconds 2023-11-12T08:44:02.000Z => Booting Puma 2023-11-12T08:44:02.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:02.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:02.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:02.000Z Exiting 2023-11-12T08:44:03.000Z ==> changing permissions 2023-11-12T08:44:03.000Z ==> starting docuseal 2023-11-12T08:44:04.000Z => Booting Puma 2023-11-12T08:44:04.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:04.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:04.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:04.000Z Exiting 2023-11-12T08:44:05.000Z ==> changing permissions 2023-11-12T08:44:05.000Z ==> starting docuseal 2023-11-12T08:44:05.000Z => Booting Puma 2023-11-12T08:44:05.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:05.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:05.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:05.000Z Exiting 2023-11-12T08:44:06.000Z ==> changing permissions 2023-11-12T08:44:06.000Z ==> starting docuseal 2023-11-12T08:44:07.000Z => Booting Puma 2023-11-12T08:44:07.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:44:07.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:07.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:07.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:07.000Z Exiting 2023-11-12T08:44:09.000Z ==> changing permissions 2023-11-12T08:44:09.000Z ==> starting docuseal 2023-11-12T08:44:10.000Z => Booting Puma 2023-11-12T08:44:10.000Z => Healtheck error: Error: connect ECONNREFUSED 172.18.16.128:3000 2023-11-12T08:44:10.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:10.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:10.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:10.000Z Exiting 2023-11-12T08:44:12.000Z ==> changing permissions 2023-11-12T08:44:12.000Z ==> starting docuseal 2023-11-12T08:44:13.000Z => Booting Puma 2023-11-12T08:44:13.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:13.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:13.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:13.000Z Exiting 2023-11-12T08:44:16.000Z ==> changing permissions 2023-11-12T08:44:16.000Z ==> starting docuseal 2023-11-12T08:44:17.000Z => Booting Puma 2023-11-12T08:44:17.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:17.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:17.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:17.000Z Exiting 2023-11-12T08:44:24.000Z ==> changing permissions 2023-11-12T08:44:24.000Z ==> starting docuseal 2023-11-12T08:44:25.000Z => Booting Puma 2023-11-12T08:44:25.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:25.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:25.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:25.000Z Exiting 2023-11-12T08:44:27.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:44:37.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:44:38.000Z ==> changing permissions 2023-11-12T08:44:38.000Z ==> starting docuseal 2023-11-12T08:44:39.000Z => Booting Puma 2023-11-12T08:44:39.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:44:39.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:44:39.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:44:39.000Z Exiting 2023-11-12T08:44:43.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:44:53.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:45:03.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:45:05.000Z ==> changing permissions 2023-11-12T08:45:05.000Z ==> starting docuseal 2023-11-12T08:45:06.000Z => Booting Puma 2023-11-12T08:45:06.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:45:06.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:45:06.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:45:06.000Z Exiting 2023-11-12T08:45:13.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:45:23.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:45:33.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:45:43.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:45:53.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:45:58.000Z ==> changing permissions 2023-11-12T08:45:58.000Z ==> starting docuseal 2023-11-12T08:45:59.000Z => Booting Puma 2023-11-12T08:45:59.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:45:59.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:45:59.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:45:59.000Z Exiting 2023-11-12T08:46:03.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:46:13.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:46:23.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:46:33.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:46:43.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:46:53.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:46:59.000Z ==> changing permissions 2023-11-12T08:46:59.000Z ==> starting docuseal 2023-11-12T08:47:00.000Z => Booting Puma 2023-11-12T08:47:00.000Z => Healtheck error: Error: connect ECONNREFUSED 172.18.16.128:3000 2023-11-12T08:47:00.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:47:00.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:47:00.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:47:00.000Z Exiting 2023-11-12T08:47:17.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:47:27.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:48:07.000Z ==> changing permissions 2023-11-12T08:48:07.000Z ==> starting docuseal 2023-11-12T08:48:16.000Z => Booting Puma 2023-11-12T08:48:16.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:16.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:16.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:16.000Z Exiting 2023-11-12T08:48:18.000Z ==> changing permissions 2023-11-12T08:48:18.000Z ==> starting docuseal 2023-11-12T08:48:19.000Z => Booting Puma 2023-11-12T08:48:19.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:19.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:19.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:19.000Z Exiting 2023-11-12T08:48:21.000Z ==> changing permissions 2023-11-12T08:48:21.000Z ==> starting docuseal 2023-11-12T08:48:23.000Z => Booting Puma 2023-11-12T08:48:23.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:23.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:23.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:23.000Z Exiting 2023-11-12T08:48:26.000Z ==> changing permissions 2023-11-12T08:48:26.000Z ==> starting docuseal 2023-11-12T08:48:27.000Z => Booting Puma 2023-11-12T08:48:27.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:27.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:27.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:27.000Z Exiting 2023-11-12T08:48:29.000Z ==> changing permissions 2023-11-12T08:48:30.000Z ==> starting docuseal 2023-11-12T08:48:31.000Z => Booting Puma 2023-11-12T08:48:31.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:31.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:31.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:31.000Z Exiting 2023-11-12T08:48:34.000Z ==> changing permissions 2023-11-12T08:48:34.000Z ==> starting docuseal 2023-11-12T08:48:36.000Z => Booting Puma 2023-11-12T08:48:36.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:36.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:36.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:36.000Z Exiting 2023-11-12T08:48:40.000Z ==> changing permissions 2023-11-12T08:48:40.000Z ==> starting docuseal 2023-11-12T08:48:40.000Z => Healtheck error: Error: connect ECONNREFUSED 172.18.16.128:3000 2023-11-12T08:48:42.000Z => Booting Puma 2023-11-12T08:48:42.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:42.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:42.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:42.000Z Exiting 2023-11-12T08:48:49.000Z ==> changing permissions 2023-11-12T08:48:49.000Z ==> starting docuseal 2023-11-12T08:48:50.000Z => Booting Puma 2023-11-12T08:48:50.000Z => Healtheck error: Error: connect ECONNREFUSED 172.18.16.128:3000 2023-11-12T08:48:50.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:48:50.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:48:50.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:48:50.000Z Exiting 2023-11-12T08:49:03.000Z ==> changing permissions 2023-11-12T08:49:03.000Z ==> starting docuseal 2023-11-12T08:49:04.000Z => Booting Puma 2023-11-12T08:49:04.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:49:04.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:49:04.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:49:04.000Z Exiting 2023-11-12T08:49:07.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:49:13.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:49:23.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:49:31.000Z ==> changing permissions 2023-11-12T08:49:31.000Z ==> starting docuseal 2023-11-12T08:49:31.000Z => Booting Puma 2023-11-12T08:49:31.000Z => Healtheck error: Error: connect ECONNREFUSED 172.18.16.128:3000 2023-11-12T08:49:31.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:49:31.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:49:31.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:49:31.000Z Exiting 2023-11-12T08:49:47.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:49:57.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:50:03.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:50:13.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:50:23.000Z ==> changing permissions 2023-11-12T08:50:23.000Z ==> starting docuseal 2023-11-12T08:50:23.000Z => Healtheck error: Error: connect EHOSTUNREACH 172.18.16.128:3000 2023-11-12T08:50:24.000Z => Booting Puma 2023-11-12T08:50:24.000Z => Rails 7.0.7 application starting in production 2023-11-12T08:50:24.000Z => Run `bin/rails server --help` for more startup options 2023-11-12T08:50:24.000Z A server is already running. Check /app/code/tmp/pids/server.pid. 2023-11-12T08:50:24.000Z Exiting 2023-11-12T08:50:37.000Z => Healtheck error: Error: Timeout of 7000ms exceeded 2023-11-12T08:50:47.000Z => Healtheck error: Error: Timeout of 7000ms exceeded
I tried to restore from backup (from last night) but that also failed and then realised that for some reason my backup storage got unmounted. I remounted it, then backup worked fine and the app is now running fine.
Still not sure what caused the error in the first place. All now works fine but thought it might be useful to report this incident happened since this app package is "unstable state".
-
@avatar1024 this issue has been fixed in the latest version:
https://github.com/docusealco/docuseal/commit/7b15111e8f2f202f5fffdbcf445517dd92d1e533 -
@avatar1024 Can you try this?
- Put app in repair mode
- Using Web terminal, delete
/tmp/docuseal/tmp/pids/server.pid
- Disable repair mode
Does this make the app work ?
-
@girish , thanks for this. As explained in my first message, I mainly posted to let you know that happened for info / debug / to improve the package. I myself restored from a previous backup and the app is running fine so I cannot test / reproduce it (unfortunately / fortunately ).
-
-