Outline stopped working after upgrade to 1.2

[eddowding]

"This app is currently not responding. Please try refreshing the page in a few minutes."

Any tips & pointers & help welcome!

$ node ./build/server/index.js
May 17 09:22:38Done in 0.72s.
May 17 09:22:38Sequelize CLI [Node: 18.18.0, CLI: 6.6.1, ORM: 6.37.3]
May 17 09:22:38=> Starting outline
May 17 09:22:38Loaded configuration file "server/config/database.json".
May 17 09:22:38No migrations were executed, database schema was already up to date.
May 17 09:22:38The environment variable MAXIMUM_IMPORT_SIZE is deprecated and will be removed in a future release. Use FILE_STORAGE_IMPORT_MAX_SIZE instead
May 17 09:22:38Using environment "production-ssl-disabled".
May 17 09:22:40=> Healtheck error: Error: connect ECONNREFUSED 172.18.16.6:3000
May 17 09:22:43{"error":"ENOENT: no such file or directory, mkdir '/var/lib/outline/data'","level":"error","message":"Failed to create directory for local file storage at /var/lib/outline/data","stack":"Error: ENOENT: no such file or directory, mkdir '/var/lib/outline/data'\n at mkdirSync (node:fs:1398:3)\n at mkdirSync (/app/code/node_modules/dd-trace/packages/datadog-instrumentations/src/fs.js:265:57)\n at Object.<anonymous> (/app/code/build/plugins/storage/server/index.js:13:25)\n at Module._compile (node:internal/modules/cjs/loader:1256:14)\n at Module._extensions..js (node:internal/modules/cjs/loader:1310:10)\n at Module.load (node:internal/modules/cjs/loader:1119:32)\n at Module._load (node:internal/modules/cjs/loader:960:12)\n at Module.require (node:internal/modules/cjs/loader:1143:19)\n at Hook.Module.require (/app/code/node_modules/dd-trace/packages/dd-trace/src/ritm.js:85:33)\n at require (node:internal/modules/cjs/helpers:119:18)\n at /app/code/build/server/utils/PluginManager.js:90:7\n at Array.forEach (<anonymous>)\n at PluginManager.loadPlugins (/app/code/build/server/utils/PluginManager.js:89:93)\n at PluginManager.getHooks (/app/code/build/server/utils/PluginManager.js:77:10)\n at Object.<anonymous> (/app/code/build/server/emails/templates/index.js:17:30)\n at Module._compile (node:internal/modules/cjs/loader:1256:14)\n at Module._extensions..js (node:internal/modules/cjs/loader:1310:10)\n at Module.load (node:internal/modules/cjs/loader:1119:32)\n at Module._load (node:internal/modules/cjs/loader:960:12)\n at Module.require (node:internal/modules/cjs/loader:1143:19)\n at Hook.Module.require (/app/code/node_modules/dd-trace/packages/dd-trace/src/ritm.js:85:33)\n at require (node:internal/modules/cjs/helpers:119:18)"}
May 17 09:22:44Done in 5.75s.
May 17 09:22:44{"label":"lifecycle","level":"info","message":"Gracefully quitting"}
May 17 09:22:44{"label":"lifecycle","level":"info","message":"Note: Restricting process count to 1 due to use of collaborative service"}
May 17 09:22:57=> Healtheck error: Error: Timeout of 7000ms exceeded
May 17 09:23:07=> Healtheck error: Error: Timeout of 7000ms exceeded
May 17 09:23:17=> Healtheck error: Error: Timeout of 7000ms exceeded

[uwcrbc]

Same here - The following log entries keep repeating every few seconds:

=> Starting outline
May 17 09:40:47 yarn run v1.22.19
May 17 09:40:47 $ node ./build/server/index.js
May 17 09:40:48 The environment variable MAXIMUM_IMPORT_SIZE is deprecated and will be removed in a future release. Use FILE_STORAGE_IMPORT_MAX_SIZE instead
May 17 09:40:50 => Healtheck error: Error: connect ECONNREFUSED 172.18.17.156:3000
May 17 09:40:56 {"error":"ENOENT: no such file or directory, mkdir '/var/lib/outline/data'","level":"error","message":"Failed to create directory for local file storage at /var/lib/outline/data","stack":"Error: ENOENT: no such file or directory, mkdir '/var/lib/outline/data'\n at mkdirSync (node:fs:1398:3)\n at mkdirSync (/app/code/node_modules/dd-trace/packages/datadog-instrumentations/src/fs.js:265:57)\n at Object.<anonymous> (/app/code/build/plugins/storage/server/index.js:13:25)\n at Module._compile (node:internal/modules/cjs/loader:1256:14)\n at Module._extensions..js (node:internal/modules/cjs/loader:1310:10)\n at Module.load (node:internal/modules/cjs/loader:1119:32)\n at Module._load (node:internal/modules/cjs/loader:960:12)\n at Module.require (node:internal/modules/cjs/loader:1143:19)\n at Hook.Module.require (/app/code/node_modules/dd-trace/packages/dd-trace/src/ritm.js:85:33)\n at require (node:internal/modules/cjs/helpers:119:18)\n at /app/code/build/server/utils/PluginManager.js:90:7\n at Array.forEach (<anonymous>)\n at PluginManager.loadPlugins (/app/code/build/server/utils/PluginManager.js:89:93)\n at PluginManager.getHooks (/app/code/build/server/utils/PluginManager.js:77:10)\n at Object.<anonymous> (/app/code/build/server/emails/templates/index.js:17:30)\n at Module._compile (node:internal/modules/cjs/loader:1256:14)\n at Module._extensions..js (node:internal/modules/cjs/loader:1310:10)\n at Module.load (node:internal/modules/cjs/loader:1119:32)\n at Module._load (node:internal/modules/cjs/loader:960:12)\n at Module.require (node:internal/modules/cjs/loader:1143:19)\n at Hook.Module.require (/app/code/node_modules/dd-trace/packages/dd-trace/src/ritm.js:85:33)\n at require (node:internal/modules/cjs/helpers:119:18)"}
May 17 09:40:56 {"label":"lifecycle","level":"info","message":"Note: Restricting process count to 1 due to use of collaborative service"}
May 17 09:40:57 {"label":"lifecycle","level":"info","message":"Gracefully quitting"}
May 17 09:40:57 Done in 10.00s.
May 17 09:40:58 => Changing ownership
May 17 09:40:58 => Running migration
May 17 09:40:58 yarn run v1.22.19
May 17 09:40:58 $ sequelize db:migrate --env=production-ssl-disabled
May 17 09:40:59 <30>1 2024-05-17T09:40:59Z redacted-app/container-name 41074bf0-8c3a-4778-ab73-1a3973b070da 937 41074bf0-8c3a-4778-ab73-1a3973b070da - Sequelize CLI [Node: 18.18.0, CLI: 6.6.1, ORM: 6.37.3] <30>1 2024-05-17T09:40:59Z redacted-app/container-name 41074bf0-8c3a-4778-ab73-1a3973b070da 937 41074bf0-8c3a-4778-ab73-1a3973b070da -
May 17 09:40:59 Loaded configuration file "server/config/database.json".
May 17 09:40:59 Using environment "production-ssl-disabled".
May 17 09:40:59 No migrations were executed, database schema was already up to date.
May 17 09:40:59 Done in 1.30s.

We are also using Env variable for local storage and import.

Not working since the 1.2 overnight update.

[girish]

@eddowding @uwcrbc Can you add export FILE_STORAGE_LOCAL_ROOT_DIR=/app/data/storage to /app/data/env.sh?

[girish]

@eddowding @uwcrbc Did you guys add export FILE_STORAGE=local manually in /app/data/env.sh by any chance?

[uwcrbc]

@girish said in Outline stopped working after upgrade to 1.2:

@eddowding @uwcrbc Can you add export FILE_STORAGE_LOCAL_ROOT_DIR=/app/data/storage to /app/data/env.sh?

Tried this. Stopped and started the app. It initially said not responding straight after the start (presumable running some migration - have not check the log further). but within couple of minutes, the app worked again - Status is running.
Seems like this did the trick. Thanks @girish. Is it something we overlooked?

@girish said in Outline stopped working after upgrade to 1.2:

@eddowding @uwcrbc Did you guys add export FILE_STORAGE=local manually in /app/data/env.sh by any chance?

Yes I did add the env. variable manually a while ago.

[girish]

@uwcrbc ahh. I made a mistake in the migration script yesterday (https://git.cloudron.io/cloudron/outline-app/-/commit/98200bc17d96d9ff6b8c8f73f76595e911a7f8bc#9dcf658ee8180c343527e6fa4612975d22036004_11_12) . The code assumes that FILE_STORAGE= is not added manually by the end user.

[eddowding]

Thank you!