Here is the log around the crash if useful: https://files.chourmo.net/s/7PeZHa2LnZaNs4Z
Posts
-
Mirotalk SFU crashes regularly during meeting after update -
Mirotalk SFU crashes regularly during meeting after updateCan you two please update your app as well and report back to me?
Hi James, unfortunately I could reproduce the crash today. I was in a meeting 3 other people. I left the meeting and the instance crashed for everyone. By the way, something I didn't make it very clear in the OP is that, not only people get kicked out of the meeting but the app actually crashes for a bit and becomes inaccessible. I either need to wait a bit or restart the app.
-
NetBird - WireGuard based VPN@jdaviescoates It now works, but it didn't before when I tried
-
NetBird - WireGuard based VPNThe @super-fan badge and group will automatically be assigned to users that posted more than 500 times in our forum.
If you have more then 500 posts and you don't see the badge, edit your profile and you can enable the badge visibility or also hide it.Where is my super fan badge...
it doesn't appear on my profile even though I am a super duper fan 
-
Chat -
Mirotalk SFU crashes regularly during meeting after update@james not as far as I can tell but I can't be sure which version it started happening given I've done several updates in a row.
-
Mirotalk SFU crashes regularly during meeting after updateI did a bunch of MiroTalk SFU updates on one of my instance (for some reasons that instance was behind on auto update, the package was at 2.12.5 this morning and so updated several times to get to the current version 2.13.1).
Then I had a meeting and several crashes occurred during it.
Here are the logs when the crash happened:
Nov 02 10:06:32 browser: 'Chrome 156.0.0.0' Nov 02 10:06:32 isDesktop: true, Nov 02 10:06:32 os: 'Windows 10', Nov 02 10:06:32 peer_name: 'xxxxxxx', Nov 02 10:06:32 } Nov 02 10:06:32 } +1ms Nov 02 10:06:33 [11/2/2026, 10:06:33:139] [Server] Get producers 'xxxxxxx' +174ms Nov 02 10:06:33 [11/2/2026, 10:06:33:200] [Server] Create WebRTC transport request received { Nov 02 10:06:33 [11/2/2026, 10:06:33:201] [Room] webRtcTransportOptions -----> { Nov 02 10:06:33 [11/2/2026, 10:06:33:202] [Room] webRtcTransportOptions -----> { Nov 02 10:06:33 [11/2/2026, 10:06:33:202] [Server] Create WebRTC transport request received { Nov 02 10:06:33 [11/2/2026, 10:06:33:203] [Room] WebRTC Transport not created, mediasoup worker closed { Nov 02 10:06:33 [11/2/2026, 10:06:33:204] [Room] WebRTC Transport not created, mediasoup worker closed { Nov 02 10:06:33 [11/2/2026, 10:06:33:204] [Server] Create WebRTC Transport skipped, media server unavailable { Nov 02 10:06:33 [11/2/2026, 10:06:33:205] [Server] Create WebRTC Transport skipped, media server unavailable { Nov 02 10:06:33 ], Nov 02 10:06:33 ], Nov 02 10:06:33 announcedAddress: '45.129.180.172', Nov 02 10:06:33 announcedAddress: '45.129.180.172', Nov 02 10:06:33 announcedAddress: '45.129.180.172', Nov 02 10:06:33 announcedAddress: '45.129.180.172', Nov 02 10:06:33 browser: 'Chrome 156.0.0.0' Nov 02 10:06:33 browser: 'Chrome 156.0.0.0' Nov 02 10:06:33 browser: 'Chrome 156.0.0.0' Nov 02 10:06:33 browser: 'Chrome 156.0.0.0' Nov 02 10:06:33 enableBwe: true, Nov 02 10:06:33 enableBwe: true, Nov 02 10:06:33 enableSctp: true, Nov 02 10:06:33 enableSctp: true, Nov 02 10:06:33 enableTcp: true, Nov 02 10:06:33 enableTcp: true, Nov 02 10:06:33 enableUdp: true, Nov 02 10:06:33 enableUdp: true, Nov 02 10:06:33 error: 'Channel closed, cannot send request [method:ROUTER_CREATE_WEBRTCTRANSPORT]', Nov 02 10:06:33 error: 'Channel closed, cannot send request [method:ROUTER_CREATE_WEBRTCTRANSPORT]', Nov 02 10:06:33 error: 'Media server unavailable', Nov 02 10:06:33 error: 'Media server unavailable', Nov 02 10:06:33 iceConsentTimeout: 35, Nov 02 10:06:33 iceConsentTimeout: 35, Nov 02 10:06:33 initialAvailableOutgoingBitrate: 2500000, Nov 02 10:06:33 initialAvailableOutgoingBitrate: 2500000, Nov 02 10:06:33 ip: '0.0.0.0', Nov 02 10:06:33 ip: '0.0.0.0', Nov 02 10:06:33 ip: '0.0.0.0', Nov 02 10:06:33 ip: '0.0.0.0', Nov 02 10:06:33 isDesktop: true, Nov 02 10:06:33 isDesktop: true, Nov 02 10:06:33 isDesktop: true, Nov 02 10:06:33 isDesktop: true, Nov 02 10:06:33 listenInfos: [ Nov 02 10:06:33 listenInfos: [ Nov 02 10:06:33 maxIncomingBitrate: 3000000, Nov 02 10:06:33 maxIncomingBitrate: 3000000, Nov 02 10:06:33 maxReceiveMessageSize: 262144 Nov 02 10:06:33 maxReceiveMessageSize: 262144 Nov 02 10:06:33 maxSendMessageSize: 262144, Nov 02 10:06:33 maxSendMessageSize: 262144, Nov 02 10:06:33 minOutgoingBitrate: 1000000, Nov 02 10:06:33 minOutgoingBitrate: 1000000, Nov 02 10:06:33 os: 'Windows 10', Nov 02 10:06:33 os: 'Windows 10', Nov 02 10:06:33 os: 'Windows 10', Nov 02 10:06:33 os: 'Windows 10', Nov 02 10:06:33 peerInfo: { Nov 02 10:06:33 peerInfo: { Nov 02 10:06:33 peer_name: 'xxxxxxx', Nov 02 10:06:33 peer_name: 'xxxxxxx', Nov 02 10:06:33 peer_name: 'xxxxxxx', Nov 02 10:06:33 peer_name: 'xxxxxxx', Nov 02 10:06:33 portRange: { min: 25000, max: 25100 } Nov 02 10:06:33 portRange: { min: 25000, max: 25100 } Nov 02 10:06:33 portRange: { min: 25000, max: 25100 } Nov 02 10:06:33 portRange: { min: 25000, max: 25100 } Nov 02 10:06:33 preferUdp: true, Nov 02 10:06:33 preferUdp: true, Nov 02 10:06:33 protocol: 'tcp', Nov 02 10:06:33 protocol: 'tcp', Nov 02 10:06:33 protocol: 'udp', Nov 02 10:06:33 protocol: 'udp', Nov 02 10:06:33 socket_id: '3yWKF4OAPTkLTzItAAAD' Nov 02 10:06:33 socket_id: '3yWKF4OAPTkLTzItAAAD' Nov 02 10:06:33 { Nov 02 10:06:33 { Nov 02 10:06:33 { Nov 02 10:06:33 { Nov 02 10:06:33 } Nov 02 10:06:33 } Nov 02 10:06:33 } Nov 02 10:06:33 } Nov 02 10:06:33 } +0ms Nov 02 10:06:33 } +0ms Nov 02 10:06:33 } +1ms Nov 02 10:06:33 } +1ms Nov 02 10:06:33 } +1ms Nov 02 10:06:33 } +237ms Nov 02 10:06:33 } +2ms Nov 02 10:06:33 } +61ms Nov 02 10:06:33 }, Nov 02 10:06:33 }, Nov 02 10:06:33 ⠙ Nov 02 10:07:20 => Healthcheck error: Error: connect ECONNREFUSED 172.18.17.127:3010 Nov 02 10:07:20 => Healthcheck error: Error: connect ECONNREFUSED 172.18.17.127:3010 Nov 02 10:07:20 => Healthcheck error: Error: connect ECONNREFUSED 172.18.17.127:3010 Nov 02 10:07:20 => Healthcheck error: Error: connect ECONNREFUSED 172.18.17.127:3010 Nov 02 10:07:20 => Healthcheck error: Error: connect ECONNREFUSED 172.18.17.127:3010 Nov 02 10:07:21 => Ensuring permissions Nov 02 10:07:21 => Starting MiroTalk SFU Nov 02 10:07:21 2026-11-02T10:07:21Z Nov 02 10:07:21 > mirotalksfu@2.7.11 start Nov 02 10:07:21 > node app/src/Server.js Nov 02 10:07:21 2026-11-02T10:07:21Z Nov 02 10:07:22 ◇ injected env (365) from .env Nov 02 10:07:24 [11/2/2026, 10:07:24:354] [NodeMailer] Email { Nov 02 10:07:24 alert: true, Nov 02 10:07:24 notify: false, Nov 02 10:07:24 host: 'mail', Nov 02 10:07:24 port: 2525, Nov 02 10:07:24 username: 'xxxxxxx', Nov 02 10:07:24 password: 'xxxxxxx', Nov 02 10:07:24 from: 'test@mirotalk.com', Nov 02 10:07:24 to: 'admin@cloudron.local' Nov 02 10:07:24 } Nov 02 10:07:24 [11/2/2026, 10:07:24:401] [Server] Server Recording enabled creating dir '/app/data/rtmp' +1s Nov 02 10:07:24 [11/2/2026, 10:07:24:417] [HtmlInjector] filesPath cached [ Nov 02 10:07:24 '/app/code/public/views/landing.html', Nov 02 10:07:24 '/app/code/public/views/newroom.html', Nov 02 10:07:24 '/app/code/public/views/Room.html', Nov 02 10:07:24 '/app/code/public/views/login.html', Nov 02 10:07:24 '/app/code/public/views/whoAreYou.html', Nov 02 10:07:24 '/app/code/public/views/activeRooms.html', Nov 02 10:07:24 '/app/code/public/views/customizeRoom.html' Nov 02 10:07:24 ] Nov 02 10:07:24 [11/2/2026, 10:07:24:459] [Server] WORKERS: 6 Nov 02 10:07:24 [11/2/2026, 10:07:24:589] [Server] Nov 02 10:07:24 2026-11-02T10:07:24Z Nov 02 10:07:24 ███████╗██╗ ██████╗ ███╗ ██╗ ███████╗███████╗██████╗ ██╗ ██╗███████╗██████╗ Nov 02 10:07:24 ██╔════╝██║██╔════╝ ████╗ ██║ ██╔════╝██╔════╝██╔══██╗██║ ██║██╔════╝██╔══██╗ Nov 02 10:07:24 ███████╗██║██║ ███╗██╔██╗ ██║█████╗███████╗█████╗ ██████╔╝██║ ██║█████╗ ██████╔╝ Nov 02 10:07:24 ╚════██║██║██║ ██║██║╚██╗██║╚════╝╚════██║██╔══╝ ██╔══██╗╚██╗ ██╔╝██╔══╝ ██╔══██╗ Nov 02 10:07:24 ███████║██║╚██████╔╝██║ ╚████║ ███████║███████╗██║ ██║ ╚████╔╝ ███████╗██║ ██║ Nov 02 10:07:24 ╚══════╝╚═╝ ╚═════╝ ╚═╝ ╚═══╝ ╚══════╝╚══════╝╚═╝ ╚═╝ ╚═══╝ ╚══════╝╚═╝ ╚═╝ started... Nov 02 10:07:24 2026-11-02T10:07:24Z Nov 02 10:07:24 2026-11-02T10:07:24Z Nov 02 10:07:24 [11/2/2026, 10:07:24:591] [Server] Server config { Nov 02 10:07:24 network: { Nov 02 10:07:24 server_listen: 'https://meet.catalystcollective.org', Nov 02 10:07:24 server_tunnel: false, Nov 02 10:07:24 trust_proxy: true, Nov 02 10:07:24 sfu: { Nov 02 10:07:24 announcedIP: '45.129.180.172', Nov 02 10:07:24 listenIP: '0.0.0.0', Nov 02 10:07:24 numWorker: 6, Nov 02 10:07:24 rtcMinPort: 25000, Nov 02 10:07:24 rtcMaxPort: 25100 Nov 02 10:07:24 }, Nov 02 10:07:24 ngrok_enabled: false Nov 02 10:07:24 }, Nov 02 10:07:24 security: { Nov 02 10:07:24 cors: { origin: '*', methods: [ 'GET', 'POST' ] }, Nov 02 10:07:24 embed: { Nov 02 10:07:24 allowedOrigins: 'any', Nov 02 10:07:24 csp: 'not set (embedding allowed from any origin)' Nov 02 10:07:24 }, Nov 02 10:07:24 jwtCfg: { JWT_EXP: '1h' }, Nov 02 10:07:24 host: { Nov 02 10:07:24 presenters: { list: [ 'admin@cloudron.local' ], join_first: true } Nov 02 10:07:24 }, Nov 02 10:07:24 ip_lookup: false, Nov 02 10:07:24 oidc: { Nov 02 10:07:24 enabled: true, Nov 02 10:07:24 baseURLDynamic: false, Nov 02 10:07:24 allowedDynamicBaseURLs: [], Nov 02 10:07:24 allow_rooms_creation_for_auth_users: true, Nov 02 10:07:24 peer_name: { force: true, email: false, name: true }, Nov 02 10:07:24 config: { Nov 02 10:07:24 issuerBaseURL: 'https://my.catalystcollective.org/openid', Nov 02 10:07:24 baseURL: 'https://meet.catalystcollective.org', Nov 02 10:07:24 clientID: 'xxxxxxx', Nov 02 10:07:24 clientSecret: 'xxxxxxx', Nov 02 10:07:24 secret: 'xxxxxxx', Nov 02 10:07:24 authRequired: false, Nov 02 10:07:24 auth0Logout: true, Nov 02 10:07:24 authorizationParams: { response_type: 'code', scope: 'openid profile email' }, Nov 02 10:07:24 routes: { callback: '/auth/callback', login: false, logout: '/logout' } Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 middleware: { IpWhitelist: false } Nov 02 10:07:24 }, Nov 02 10:07:24 api: { Nov 02 10:07:24 rest_api: { Nov 02 10:07:24 basePath: '/api/v1', Nov 02 10:07:24 docs: 'https://meet.catalystcollective.org/api/v1/docs', Nov 02 10:07:24 allowed: { Nov 02 10:07:24 stats: true, Nov 02 10:07:24 meetings: false, Nov 02 10:07:24 meeting: true, Nov 02 10:07:24 meetingEnd: false, Nov 02 10:07:24 join: true, Nov 02 10:07:24 token: false, Nov 02 10:07:24 whip: true, Nov 02 10:07:24 slack: true, Nov 02 10:07:24 mattermost: true Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 webhook: false Nov 02 10:07:24 }, Nov 02 10:07:24 media: { Nov 02 10:07:24 mediasoup: { Nov 02 10:07:24 listenInfos: [ Nov 02 10:07:24 { Nov 02 10:07:24 protocol: 'udp', Nov 02 10:07:24 ip: '0.0.0.0', Nov 02 10:07:24 announcedAddress: '45.129.180.172', Nov 02 10:07:24 portRange: { min: 25000, max: 25100 } Nov 02 10:07:24 }, Nov 02 10:07:24 { Nov 02 10:07:24 protocol: 'tcp', Nov 02 10:07:24 ip: '0.0.0.0', Nov 02 10:07:24 announcedAddress: '45.129.180.172', Nov 02 10:07:24 portRange: { min: 25000, max: 25100 } Nov 02 10:07:24 } Nov 02 10:07:24 ], Nov 02 10:07:24 worker_bin: '/app/code/node_modules/mediasoup/worker/out/Release/mediasoup-worker' Nov 02 10:07:24 }, Nov 02 10:07:24 rtmp: false, Nov 02 10:07:24 videoAI: false, Nov 02 10:07:24 server_recording: { Nov 02 10:07:24 enabled: true, Nov 02 10:07:24 uploadToS3: false, Nov 02 10:07:24 endpoint: '', Nov 02 10:07:24 dir: '../../../data/rec', Nov 02 10:07:24 maxFileSize: '1073741824', Nov 02 10:07:24 uploadTokenExp: '24h', Nov 02 10:07:24 rateLimit: { windowMs: 60000, max: 300 } Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 integrations: { Nov 02 10:07:24 discord: false, Nov 02 10:07:24 mattermost: false, Nov 02 10:07:24 slack: false, Nov 02 10:07:24 chatGPT: false, Nov 02 10:07:24 deepSeek: false, Nov 02 10:07:24 gifSearch: false, Nov 02 10:07:24 email_alerts: { Nov 02 10:07:24 alert: true, Nov 02 10:07:24 notify: false, Nov 02 10:07:24 host: 'mail', Nov 02 10:07:24 port: 2525, Nov 02 10:07:24 username: 'xxxxxxx', Nov 02 10:07:24 password: 'xxxxxxx', Nov 02 10:07:24 from: 'test@mirotalk.com', Nov 02 10:07:24 sendTo: 'admin@cloudron.local' Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 ui: { Nov 02 10:07:24 brand: { Nov 02 10:07:24 htmlInjection: true, Nov 02 10:07:24 app: { Nov 02 10:07:24 language: 'en', Nov 02 10:07:24 translationMode: 'google', Nov 02 10:07:24 name: 'MiroTalk SFU', Nov 02 10:07:24 title: '<h1>MiroTalk SFU</h1> Free browser based Real-time video calls.<br />Simple, Secure, Fast.', Nov 02 10:07:24 description: 'Start your next video call with a single click. No download, plug-in, or login is required.', Nov 02 10:07:24 joinDescription: 'Pick a room name.<br />How about this one?', Nov 02 10:07:24 joinButtonLabel: 'JOIN ROOM', Nov 02 10:07:24 customizeButtonLabel: 'CUSTOMIZE ROOM', Nov 02 10:07:24 joinLastLabel: 'Your recent room:' Nov 02 10:07:24 }, Nov 02 10:07:24 site: { Nov 02 10:07:24 title: 'MiroTalk SFU - Open Source WebRTC Video Conferencing', Nov 02 10:07:24 icon: '../images/logo.svg', Nov 02 10:07:24 appleTouchIcon: '../images/logo.svg', Nov 02 10:07:24 newRoomTitle: 'Pick name. <br />Share URL. <br />Start conference.', Nov 02 10:07:24 newRoomDescription: 'Each room has its disposable URL. Just pick a name and share.' Nov 02 10:07:24 }, Nov 02 10:07:24 meta: { Nov 02 10:07:24 description: 'Build your own Zoom alternative with MiroTalk SFU, an open-source, self-hosted WebRTC platform powered by Mediasoup for scalable video meetings.', Nov 02 10:07:24 keywords: 'webrtc, video calls, conference, screen sharing, mirotalk, sfu' Nov 02 10:07:24 }, Nov 02 10:07:24 og: { Nov 02 10:07:24 type: 'app-webrtc', Nov 02 10:07:24 siteName: 'MiroTalk SFU', Nov 02 10:07:24 title: 'MiroTalk SFU - Open Source WebRTC Video Conferencing', Nov 02 10:07:24 description: 'Build your own Zoom alternative with MiroTalk SFU, an open-source self-hosted WebRTC video conferencing platform powered by Mediasoup. Host scalable meetings, webinars, classrooms, screen sharing and real-time collaboration.', Nov 02 10:07:24 image: 'https://sfu.mirotalk.com/images/mirotalksfu.png', Nov 02 10:07:24 url: 'https://sfu.mirotalk.com' Nov 02 10:07:24 }, Nov 02 10:07:24 html: { Nov 02 10:07:24 topSponsors: true, Nov 02 10:07:24 features: true, Nov 02 10:07:24 teams: true, Nov 02 10:07:24 tryEasier: true, Nov 02 10:07:24 poweredBy: true, Nov 02 10:07:24 sponsors: true, Nov 02 10:07:24 pastSponsors: true, Nov 02 10:07:24 advertisers: true, Nov 02 10:07:24 supportUs: true, Nov 02 10:07:24 footer: true, Nov 02 10:07:24 version: true Nov 02 10:07:24 }, Nov 02 10:07:24 whoAreYou: { Nov 02 10:07:24 title: 'MiroTalk SFU - Waiting for host to start the meeting', Nov 02 10:07:24 waitingRoomHeading: 'Waiting for host...', Nov 02 10:07:24 waitingRoomDescription: "The meeting hasn't started yet.<br />You'll join automatically when the host opens the room.", Nov 02 10:07:24 waitingRoomStatus: 'Checking room status...', Nov 02 10:07:24 waitingRoomReady: 'Room is ready! Joining...', Nov 02 10:07:24 waitingRoomWaiting: 'Waiting for host to start the meeting...', Nov 02 10:07:24 waitingRoomHostLink: 'Are you the host?', Nov 02 10:07:24 waitingRoomLoginLink: 'Login here', Nov 02 10:07:24 waitingRoomElapsedJust: 'Just started waiting', Nov 02 10:07:24 waitingRoomElapsedMinutes: 'Waiting for {minutes}', Nov 02 10:07:24 waitingRoomSongUrl: '../sounds/waiting-music.mp3' Nov 02 10:07:24 }, Nov 02 10:07:24 login: { Nov 02 10:07:24 heading: 'Welcome back', Nov 02 10:07:24 description: 'Enter your credentials to continue.', Nov 02 10:07:24 buttonLabel: 'Login' Nov 02 10:07:24 }, Nov 02 10:07:24 about: { Nov 02 10:07:24 imageUrl: '../images/mirotalk-logo.gif', Nov 02 10:07:24 title: 'WebRTC SFU v2.7.11', Nov 02 10:07:24 html: '\n' + Nov 02 10:07:24 ' <div class="about-content">\n' + Nov 02 10:07:24 ' <p class="about-description">\n' + Nov 02 10:07:24 ' Self-hosted group video meetings with scalable WebRTC conferencing.\n' + Nov 02 10:07:24 ' </p>\n' + Nov 02 10:07:24 ' <a\n' + Nov 02 10:07:24 ' class="about-primary-action"\n' + Nov 02 10:07:24 ' data-umami-event="About button"\n' + Nov 02 10:07:24 ' href="https://docs.mirotalk.com/sites/sfu"\n' + Nov 02 10:07:24 ' target="_blank"\n' + Nov 02 10:07:24 ' rel="noopener noreferrer"\n' + Nov 02 10:07:24 ' >\n' + Nov 02 10:07:24 ' <i class="fas fa-info-circle" aria-hidden="true"></i>\n' + Nov 02 10:07:24 ' <span>About</span>\n' + Nov 02 10:07:24 ' </a>\n' + Nov 02 10:07:24 ' <dl class="about-details">\n' + Nov 02 10:07:24 ' <div>\n' + Nov 02 10:07:24 ' <dt>Author</dt>\n' + Nov 02 10:07:24 ' <dd>\n' + Nov 02 10:07:24 ' <a\n' + Nov 02 10:07:24 ' id="linkedin-button"\n' + Nov 02 10:07:24 ' data-umami-event="Linkedin button"\n' + Nov 02 10:07:24 ' href="https://www.linkedin.com/in/miroslav-pejic-976a07101/"\n' + Nov 02 10:07:24 ' target="_blank"\n' + Nov 02 10:07:24 ' rel="noopener noreferrer"\n' + Nov 02 10:07:24 ' >Miroslav Pejic</a>\n' + Nov 02 10:07:24 ' </dd>\n' + Nov 02 10:07:24 ' </div>\n' + Nov 02 10:07:24 ' <div>\n' + Nov 02 10:07:24 ' <dt>Email</dt>\n' + Nov 02 10:07:24 ' <dd>\n' + Nov 02 10:07:24 ' <a\n' + Nov 02 10:07:24 ' id="email-button"\n' + Nov 02 10:07:24 ' data-umami-event="Email button"\n' + Nov 02 10:07:24 ' href="mailto:miroslav.pejic.85@gmail.com?subject=MiroTalk SFU info"\n' + Nov 02 10:07:24 ' >miroslav.pejic.85@gmail.com</a>\n' + Nov 02 10:07:24 ' </dd>\n' + Nov 02 10:07:24 ' </div>\n' + Nov 02 10:07:24 ' </dl>\n' + Nov 02 10:07:24 ' <footer class="about-footer">\n' + Nov 02 10:07:24 ' © 2026 MiroTalk SFU, all rights reserved\n' + Nov 02 10:07:24 ' </footer>\n' + Nov 02 10:07:24 ' </div>\n' + Nov 02 10:07:24 ' ' Nov 02 10:07:24 }, Nov 02 10:07:24 widget: { Nov 02 10:07:24 enabled: false, Nov 02 10:07:24 roomId: 'support-room', Nov 02 10:07:24 theme: 'dark', Nov 02 10:07:24 widgetState: 'closed', Nov 02 10:07:24 widgetType: 'support', Nov 02 10:07:24 supportWidget: { Nov 02 10:07:24 position: 'bottom-right', Nov 02 10:07:24 expertImages: [ Nov 02 10:07:24 'https://photo.cloudron.pocketsolution.net/uploads/original/95/7d/a5f7f7a2c89a5fee7affda5f013c.jpeg' Nov 02 10:07:24 ], Nov 02 10:07:24 buttons: { Nov 02 10:07:24 audio: true, Nov 02 10:07:24 video: true, Nov 02 10:07:24 screen: true, Nov 02 10:07:24 chat: true, Nov 02 10:07:24 join: true Nov 02 10:07:24 }, Nov 02 10:07:24 checkOnlineStatus: false, Nov 02 10:07:24 isOnline: true, Nov 02 10:07:24 customMessages: { Nov 02 10:07:24 heading: 'Need Help?', Nov 02 10:07:24 subheading: 'Get instant support from our expert team!', Nov 02 10:07:24 connectText: 'connect in < 5 seconds', Nov 02 10:07:24 onlineText: 'We are online', Nov 02 10:07:24 offlineText: 'We are offline', Nov 02 10:07:24 poweredBy: 'Powered by MiroTalk SFU' Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 alert: { enabled: false, type: 'email' } Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 buttons: { Nov 02 10:07:24 popup: { shareRoomPopup: true, shareRoomQrOnHover: true }, Nov 02 10:07:24 main: { Nov 02 10:07:24 shareButton: true, Nov 02 10:07:24 hideMeButton: true, Nov 02 10:07:24 fullScreenButton: true, Nov 02 10:07:24 startAudioButton: true, Nov 02 10:07:24 startVideoButton: true, Nov 02 10:07:24 startScreenButton: true, Nov 02 10:07:24 swapCameraButton: true, Nov 02 10:07:24 chatButton: true, Nov 02 10:07:24 participantsButton: true, Nov 02 10:07:24 pollButton: true, Nov 02 10:07:24 speechRecButton: true, Nov 02 10:07:24 breakoutRoomButton: true, Nov 02 10:07:24 editorButton: true, Nov 02 10:07:24 raiseHandButton: true, Nov 02 10:07:24 transcriptionButton: true, Nov 02 10:07:24 whiteboardButton: true, Nov 02 10:07:24 documentPiPButton: true, Nov 02 10:07:24 snapshotRoomButton: true, Nov 02 10:07:24 emojiRoomButton: true, Nov 02 10:07:24 settingsButton: true, Nov 02 10:07:24 aboutButton: true, Nov 02 10:07:24 exitButton: true, Nov 02 10:07:24 extraButton: true Nov 02 10:07:24 }, Nov 02 10:07:24 settings: { Nov 02 10:07:24 activeRooms: true, Nov 02 10:07:24 fileSharing: true, Nov 02 10:07:24 lockRoomButton: true, Nov 02 10:07:24 unlockRoomButton: true, Nov 02 10:07:24 broadcastingButton: true, Nov 02 10:07:24 lobbyButton: true, Nov 02 10:07:24 joinLockButton: true, Nov 02 10:07:24 sendEmailInvitation: true, Nov 02 10:07:24 micOptionsButton: true, Nov 02 10:07:24 tabRTMPStreamingBtn: true, Nov 02 10:07:24 tabWhipBtn: true, Nov 02 10:07:24 tabSipPhoneBtn: true, Nov 02 10:07:24 tabNotificationsBtn: true, Nov 02 10:07:24 tabNetworkBtn: true, Nov 02 10:07:24 tabModerator: true, Nov 02 10:07:24 tabVideoAIBtn: true, Nov 02 10:07:24 tabRecording: true, Nov 02 10:07:24 host_only_recording: true, Nov 02 10:07:24 pushToTalk: true, Nov 02 10:07:24 keyboardShortcuts: true, Nov 02 10:07:24 virtualBackground: true, Nov 02 10:07:24 roomBackground: true, Nov 02 10:07:24 customNoiseSuppression: false, Nov 02 10:07:24 customNoiseSuppressionDefault: false Nov 02 10:07:24 }, Nov 02 10:07:24 producerVideo: { Nov 02 10:07:24 videoPictureInPicture: true, Nov 02 10:07:24 videoMirrorButton: true, Nov 02 10:07:24 pinVideoButton: true, Nov 02 10:07:24 fullScreenButton: true, Nov 02 10:07:24 snapShotButton: true, Nov 02 10:07:24 focusVideoButton: true, Nov 02 10:07:24 muteAudioButton: true, Nov 02 10:07:24 videoPrivacyButton: true, Nov 02 10:07:24 audioVolumeInput: true, Nov 02 10:07:24 drawingButton: true Nov 02 10:07:24 }, Nov 02 10:07:24 consumerVideo: { Nov 02 10:07:24 videoPictureInPicture: true, Nov 02 10:07:24 videoMirrorButton: true, Nov 02 10:07:24 pinVideoButton: true, Nov 02 10:07:24 fullScreenButton: true, Nov 02 10:07:24 snapShotButton: true, Nov 02 10:07:24 focusVideoButton: true, Nov 02 10:07:24 hideFromGridButton: true, Nov 02 10:07:24 sendMessageButton: true, Nov 02 10:07:24 sendFileButton: true, Nov 02 10:07:24 sendVideoButton: true, Nov 02 10:07:24 muteVideoButton: true, Nov 02 10:07:24 muteAudioButton: true, Nov 02 10:07:24 audioVolumeInput: true, Nov 02 10:07:24 geolocationButton: true, Nov 02 10:07:24 banButton: true, Nov 02 10:07:24 ejectButton: true, Nov 02 10:07:24 presenterRoleButton: true, Nov 02 10:07:24 drawingButton: true Nov 02 10:07:24 }, Nov 02 10:07:24 videoOff: { Nov 02 10:07:24 pinVideoButton: true, Nov 02 10:07:24 hideFromGridButton: true, Nov 02 10:07:24 sendMessageButton: true, Nov 02 10:07:24 sendFileButton: true, Nov 02 10:07:24 sendVideoButton: true, Nov 02 10:07:24 muteAudioButton: true, Nov 02 10:07:24 audioVolumeInput: true, Nov 02 10:07:24 geolocationButton: true, Nov 02 10:07:24 banButton: true, Nov 02 10:07:24 ejectButton: true, Nov 02 10:07:24 presenterRoleButton: true Nov 02 10:07:24 }, Nov 02 10:07:24 videoShare: { pinVideoButton: true, fullScreenButton: true }, Nov 02 10:07:24 chat: { Nov 02 10:07:24 chatPinButton: true, Nov 02 10:07:24 chatMaxButton: true, Nov 02 10:07:24 chatSaveButton: true, Nov 02 10:07:24 chatEmojiButton: true, Nov 02 10:07:24 chatGifButton: true, Nov 02 10:07:24 chatMarkdownButton: true, Nov 02 10:07:24 chatSpeechStartButton: true, Nov 02 10:07:24 chatGPT: true, Nov 02 10:07:24 deepSeek: true, Nov 02 10:07:24 chatTyping: true Nov 02 10:07:24 }, Nov 02 10:07:24 poll: { Nov 02 10:07:24 pollPinButton: true, Nov 02 10:07:24 pollMaxButton: true, Nov 02 10:07:24 pollSaveButton: true Nov 02 10:07:24 }, Nov 02 10:07:24 participantsList: { Nov 02 10:07:24 saveInfoButton: true, Nov 02 10:07:24 sendFileAllButton: true, Nov 02 10:07:24 ejectAllButton: true, Nov 02 10:07:24 sendFileButton: true, Nov 02 10:07:24 geoLocationButton: true, Nov 02 10:07:24 banButton: true, Nov 02 10:07:24 ejectButton: true, Nov 02 10:07:24 presenterRoleButton: true Nov 02 10:07:24 }, Nov 02 10:07:24 whiteboard: { whiteboardLockButton: true } Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 monitoring: { Nov 02 10:07:24 sentry: false, Nov 02 10:07:24 stats: false, Nov 02 10:07:24 system_info: { Nov 02 10:07:24 environment: 'development', Nov 02 10:07:24 os: { type: 'Linux', release: '5.15.0-130-generic', arch: 'x64' }, Nov 02 10:07:24 cpu: { cores: 6, model: 'AMD EPYC 7702P 64-Core Processor' }, Nov 02 10:07:24 memory: { total: '15.61 GB' }, Nov 02 10:07:24 isDocker: true Nov 02 10:07:24 } Nov 02 10:07:24 }, Nov 02 10:07:24 features: { survey: false, redirect: false }, Nov 02 10:07:24 moderation: { room: { maxParticipants: 1000, lobby: false } }, Nov 02 10:07:24 versions: { Nov 02 10:07:24 app: '2.7.11', Nov 02 10:07:24 node: '24.22.1', Nov 02 10:07:24 server_version: '3.32.1', Nov 02 10:07:24 client_version: '3.26.0' Nov 02 10:07:24 } Nov 02 10:07:24 } Nov 02 10:07:28 [11/2/2026, 10:07:28:657] [Server] Detected roomId --> redirect to /join?room=cos '' +4s Nov 02 10:07:28 [11/2/2026, 10:07:28:706] [Server] /join/:roomId { Nov 02 10:07:28 OIDCUserAuthenticated: false, Nov 02 10:07:28 hostUserAuthenticated: false, Nov 02 10:07:28 roomExist: false, Nov 02 10:07:28 roomCount: 0, Nov 02 10:07:28 extraInfo: { Nov 02 10:07:28 roomId: 'cos', Nov 02 10:07:28 OIDCUserEnabled: true, Nov 02 10:07:28 hostProtected: false, Nov 02 10:07:28 hostAuthenticated: true, Nov 02 10:07:28 OIDCAllowRoomCreationForAuthUsers: true Nov 02 10:07:28 }, Nov 02 10:07:28 allowRoomAccess: false Nov 02 10:07:28 } +49ms -
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storageboxAll good. A few backups have happened since the change and it all went smoothly. What has created the issue for the past few days is a mystery (since instance has been running like this for years) but thanks to you it's all back on track.
-
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storageboxFor now I've commented everything line in the working instance and rebooted the server. If there is an issue I'll re-add the ipv4 DNS. Many thanks to you two for looking into this and helping. I'll report tomorrow to let you if it's resolved.
-
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storageboxYou can always test a mount from either your local computer
Local sshfs mount work just fine.
Also, keep in mind, Hetzner Storage Boxes have a concurrent connections limit of 10.
There are only 3 concurrent connections on the box, two Cloudron instances (one mount in each) and one local.
But the specific DNS config on the broken instance might be the source of the issue?
[Resolve] DNS=46.38.225.230 46.38.252.230 2a03:4000:8000::fce6 2a03:4000:0:1::e1e6 #FallbackDNS= #Domains= LLMNR=no MulticastDNS=no DNSSEC=allow-downgrade Cache=yes DNSStubListener=yes -
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storageboxAlso without doing anything, now re running "backup now" completed just fine
. Anyway, should I just remove the specific DNS config in the broken instance?By the way, both instances have ipv6 disabled, and normally should be exactly the same network wise.
-
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storageboxare those two cloudron servers with the same VPS provider if the nameservers get set by the provider?
They are quite different actually. One seem to have a specific config, while the other doesn't. They are both netcup RS servers configured the same way so I'm not sure why they are different.
vi /etc/systemd/resolved.confgives:Broken instance:
# This file is part of systemd. # # systemd is free software; you can redistribute it and/or modify it # under the terms of the GNU Lesser General Public License as published by # the Free Software Foundation; either version 2.1 of the License, or # (at your option) any later version. # # Entries in this file show the compile time defaults. # You can change settings by editing this file. # Defaults can be restored by simply deleting this file. # # See resolved.conf(5) for details [Resolve] DNS=46.38.225.230 46.38.252.230 2a03:4000:8000::fce6 2a03:4000:0:1::e1e6 #FallbackDNS= #Domains= LLMNR=no MulticastDNS=no DNSSEC=allow-downgrade Cache=yes DNSStubListener=yesWorking instance:
# This file is part of systemd. # # systemd is free software; you can redistribute it and/or modify it under the # terms of the GNU Lesser General Public License as published by the Free # Software Foundation; either version 2.1 of the License, or (at your option) # any later version. # # Entries in this file show the compile time defaults. Local configuration # should be created by either modifying this file (or a copy of it placed in # /etc/ if the original file is shipped in /usr/), or by creating "drop-ins" in # the /etc/systemd/resolved.conf.d/ directory. The latter is generally # recommended. Defaults can be restored by simply deleting the main # configuration file and all drop-ins located in /etc/. # # Use 'systemd-analyze cat-config systemd/resolved.conf' to display the full config. # # See resolved.conf(5) for details. [Resolve] # Some examples of DNS servers which may be used for DNS= and FallbackDNS=: # Cloudflare: 1.1.1.1#cloudflare-dns.com 1.0.0.1#cloudflare-dns.com 2606:4700:4700::1111#cloudflare-dns.com 2606:4700:4700::1001#cloudflare-dns.com # Google: 8.8.8.8#dns.google 8.8.4.4#dns.google 2001:4860:4860::8888#dns.google 2001:4860:4860::8844#dns.google # Quad9: 9.9.9.9#dns.quad9.net 149.112.112.112#dns.quad9.net 2620:fe::fe#dns.quad9.net 2620:fe::9#dns.quad9.net #DNS= #FallbackDNS= #Domains= #DNSSEC=no #DNSOverTLS=no #MulticastDNS=no #LLMNR=no #Cache=no-negative #CacheFromLocalhost=no #DNSStubListener=yes #DNSStubListenerExtra= #ReadEtcHosts=yes #ResolveUnicastSingleLabel=no #StaleRetentionSec=0 -
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storagebox...wait I spoke too quickly, the backup did not complete right now. Here is the truncated log (too long otherwise):
2026-10-14T10:36:11.666Z backupupload: Backing up {"localRoot":"/home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884","layout":[]} to snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884 2026-10-14T10:36:11.669Z backuptask: upload: path snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884 site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a dataLayout {"localRoot":"/home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884","layout":[]} (node:3802437) ExperimentalWarning: The supports Web Crypto API method is an experimental feature and might change at any time (Use `node --trace-warnings ...` to show where the warning was created) (node:3802437) ExperimentalWarning: The ML-DSA-44 Web Crypto API algorithm is an experimental feature and might change at any time 2026-10-14T10:36:11.693Z shell: mounts: mountpoint -q -- /mnt/cloudronbackup 2026-10-14T10:36:11.703Z backuptask: checkPreconditions: mount point status is {"state":"active","message":""} 2026-10-14T10:36:11.703Z shell: df: df -B1 --output=source,fstype,size,used,avail,pcent,target /mnt/cloudronbackup 2026-10-14T10:36:11.720Z backuptask: checkPreconditions: getting disk usage of /home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884 2026-10-14T10:36:11.720Z shell: backuptask: du --dereference-args --summarize --block-size=1 --exclude=*.lock --exclude=dovecot.list.index.log.* /home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884 2026-10-14T10:36:11.729Z backuptask: checkPreconditions: total required=495616 available=768729284608 2026-10-14T10:36:11.730Z backupformat/rsync: upload: uploading to site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a path snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884 (encrypted: false) dataLayout {"localRoot":"/home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884","layout":[]} 2026-10-14T10:36:11.730Z shell: backupformat/rsync: find /home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884 -type d -empty 2026-10-14T10:36:11.733Z shell: backupformat/rsync: find /home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884 -type f -executable 2026-10-14T10:36:11.736Z shell: backupformat/rsync: find /home/yellowtent/appsdata/94ee96d3-7845-40a1-9abf-bc621082c884 -type l 2026-10-14T10:36:11.740Z syncer: sync: loading cache file /home/yellowtent/platformdata/backup/547c3c3f-b9ee-42ff-afce-c7c84d259d2a/94ee96d3-7845-40a1-9abf-bc621082c884.sync.cache 2026-10-14T10:36:11.743Z backupformat/rsync: sync: processing 0 deletes, 3 additions and 3 unchanged 2026-10-14T10:36:11.743Z backupformat/rsync: sync: done processing deletes. error: null 2026-10-14T10:36:11.745Z tasks: updating task 24827 with: {"percent":52.72413793103449,"message":"Uploaded 0/3 files. Current: config.json (email.collectiveownership.co.uk)"} 2026-10-14T10:36:11.825Z backupformat/rsync: sync: done processing adds. error: null 2026-10-14T10:36:11.825Z syncer: finalize: patching in integrity information into /home/yellowtent/platformdata/backup/547c3c3f-b9ee-42ff-afce-c7c84d259d2a/94ee96d3-7845-40a1-9abf-bc621082c884.sync.cache 2026-10-14T10:36:11.829Z backuptask: upload: path snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884 site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a uploaded: {"transferred":458889,"size":459061,"fileCount":6} 2026-10-14T10:36:11.852Z backupupload: upload completed. error: null 2026-10-14T10:36:11.852Z backuptask: runBackupUpload: result - {"result":{"stats":{"transferred":458889,"size":459061,"fileCount":6},"integrity":{"signature":"63fa907073cc0e71334619e2fa63f420daa7fc971c9e3a5836d2d45932b17f592af6dff0991061e09b9b6b38c352659434a13c35b73d66f57c8ce1199ac96301"}}} 2026-10-14T10:36:11.873Z backuptask: uploadAppSnapshot: email.collectiveownership.co.uk uploaded to snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884. 1.592 seconds 2026-10-14T10:36:11.876Z backuptask: backupAppWithTag: rotating email.collectiveownership.co.uk snapshot of 547c3c3f-b9ee-42ff-afce-c7c84d259d2a to path 2026-10-14-103420-487/app_email.collectiveownership.co.uk_v2.10.4 2026-10-14T10:36:11.882Z tasks: updating task 24827 with: {"percent":52.72413793103449,"message":"Copying /mnt/cloudronbackup/snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884 to /mnt/cloudronbackup/2026-10-14-103420-487/app_email.collectiveownership.co.uk_v2.10.4"} 2026-10-14T10:36:11.882Z shell: filesystem: ssh -o StrictHostKeyChecking no -i /tmp/identity_file_7e45d22e-2d28-4a03-8e72-408377dbf77e -p 23 u273486@u273486.your-storagebox.de cp -aRl /home/Catalyst/snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884 /home/Catalyst/2026-10-14-103420-487/app_email.collectiveownership.co.uk_v2.10.4 2026-10-14T10:36:12.273Z backuptask: copy: copied successfully to 2026-10-14-103420-487/app_email.collectiveownership.co.uk_v2.10.4. Took 0.391 seconds 2026-10-14T10:36:12.274Z tasks: updating task 24827 with: {"percent":52.72413793103449,"message":"Copying /mnt/cloudronbackup/snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884.backupinfo to /mnt/cloudronbackup/2026-10-14-103420-487/app_email.collectiveownership.co.uk_v2.10.4.backupinfo"} 2026-10-14T10:36:12.274Z shell: filesystem: ssh -o StrictHostKeyChecking no -i /tmp/identity_file_47b1f455-ce5a-4d17-8571-3cac4cf27c46 -p 23 u273486@u273486.your-storagebox.de cp -al /home/Catalyst/snapshot/app_94ee96d3-7845-40a1-9abf-bc621082c884.backupinfo /home/Catalyst/2026-10-14-103420-487/app_email.collectiveownership.co.uk_v2.10.4.backupinfo 2026-10-14T10:36:12.640Z backuptask: copy: copied backupinfo successfully to 2026-10-14-103420-487/app_email.collectiveownership.co.uk_v2.10.4.backupinfo 2026-10-14T10:36:12.644Z backuptask: fullBackup: app email.collectiveownership.co.uk backup finished. Took 2.498 seconds 2026-10-14T10:36:12.647Z locks: write: current locks: {"full_backup_task_547c3c3f-b9ee-42ff-afce-c7c84d259d2a":null} 2026-10-14T10:36:12.647Z locks: release: app_backup_94ee96d3-7845-40a1-9abf-bc621082c884 2026-10-14T10:36:12.647Z tasks: updating task 24827 with: {"percent":56.17241379310346,"message":"Backing up row.collectiveownership.co.uk (16/26). Waiting for lock"} 2026-10-14T10:36:12.651Z locks: write: current locks: {"full_backup_task_547c3c3f-b9ee-42ff-afce-c7c84d259d2a":null,"app_backup_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b":"24827"} 2026-10-14T10:36:12.651Z locks: acquire: app_backup_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b 2026-10-14T10:36:12.651Z tasks: updating task 24827 with: {"percent":56.17241379310346,"message":"Snapshotting app row.collectiveownership.co.uk"} 2026-10-14T10:36:12.652Z services: backupAddons: backing up ["postgresql","sendmail","redis","localstorage"] 2026-10-14T10:36:12.652Z services: Backing up postgresql pipeRequestToFile: connected with status code 200 pipeRequestToFile: success 2026-10-14T10:36:18.045Z services: Backing up redis pipeRequestToFile: connected with status code 200 pipeRequestToFile: success 2026-10-14T10:36:18.094Z backuptask: snapshotApp: row.collectiveownership.co.uk took 5.443 seconds 2026-10-14T10:36:18.094Z tasks: updating task 24827 with: {"percent":56.17241379310346,"message":"Uploading app snapshot row.collectiveownership.co.uk"} 2026-10-14T10:36:18.095Z backuptask: runBackupUpload: adjusting heap size to 2816M 2026-10-14T10:36:18.095Z shell: backuptask: /usr/bin/sudo --non-interactive -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b 547c3c3f-b9ee-42ff-afce-c7c84d259d2a {"localRoot":"/home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b","layout":[]} 2026-10-14T10:36:19.424Z backupupload: Backing up {"localRoot":"/home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b","layout":[]} to snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b 2026-10-14T10:36:19.427Z backuptask: upload: path snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a dataLayout {"localRoot":"/home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b","layout":[]} (node:3802476) ExperimentalWarning: The supports Web Crypto API method is an experimental feature and might change at any time (Use `node --trace-warnings ...` to show where the warning was created) (node:3802476) ExperimentalWarning: The ML-DSA-44 Web Crypto API algorithm is an experimental feature and might change at any time 2026-10-14T10:36:19.452Z shell: mounts: mountpoint -q -- /mnt/cloudronbackup 2026-10-14T10:36:19.462Z backuptask: checkPreconditions: mount point status is {"state":"active","message":""} 2026-10-14T10:36:19.462Z shell: df: df -B1 --output=source,fstype,size,used,avail,pcent,target /mnt/cloudronbackup 2026-10-14T10:36:19.481Z backuptask: checkPreconditions: getting disk usage of /home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b 2026-10-14T10:36:19.481Z shell: backuptask: du --dereference-args --summarize --block-size=1 --exclude=*.lock --exclude=dovecot.list.index.log.* /home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b 2026-10-14T10:36:19.781Z backuptask: checkPreconditions: total required=273408000 available=768729153536 2026-10-14T10:36:19.781Z backupformat/rsync: upload: uploading to site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a path snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b (encrypted: false) dataLayout {"localRoot":"/home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b","layout":[]} 2026-10-14T10:36:19.782Z shell: backupformat/rsync: find /home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b -type d -empty 2026-10-14T10:36:19.796Z shell: backupformat/rsync: find /home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b -type f -executable 2026-10-14T10:36:19.821Z shell: backupformat/rsync: find /home/yellowtent/appsdata/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b -type l 2026-10-14T10:36:19.836Z syncer: sync: loading cache file /home/yellowtent/platformdata/backup/547c3c3f-b9ee-42ff-afce-c7c84d259d2a/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b.sync.cache 2026-10-14T10:36:19.990Z backupformat/rsync: sync: processing 0 deletes, 4 additions and 7678 unchanged 2026-10-14T10:36:19.996Z backupformat/rsync: sync: done processing deletes. error: null 2026-10-14T10:36:19.998Z tasks: updating task 24827 with: {"percent":56.17241379310346,"message":"Uploaded 0/4 files. Current: config.json (row.collectiveownership.co.uk)"} 2026-10-14T10:36:20.317Z backupformat/rsync: sync: done processing adds. error: null 2026-10-14T10:36:20.317Z syncer: finalize: patching in integrity information into /home/yellowtent/platformdata/backup/547c3c3f-b9ee-42ff-afce-c7c84d259d2a/99de5b4d-6ad8-4f37-b08f-f6e110be4b2b.sync.cache 2026-10-14T10:36:20.410Z backuptask: upload: path snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a uploaded: {"transferred":34096594,"size":253477399,"fileCount":7682} 2026-10-14T10:36:20.474Z backupupload: upload completed. error: null 2026-10-14T10:36:20.475Z backuptask: runBackupUpload: result - {"result":{"stats":{"transferred":34096594,"size":253477399,"fileCount":7682},"integrity":{"signature":"ec763ed7a16f91c6afa7455cdbc83ad6d7b07393d7a1575a6e14999f219a2a5d9bf27fa46799203110e16fb4a70965b5e3ba6ef21a11441e3ee7bcb8b3f4cd01"}}} 2026-10-14T10:36:20.507Z backuptask: uploadAppSnapshot: row.collectiveownership.co.uk uploaded to snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b. 2.413 seconds 2026-10-14T10:36:20.509Z backuptask: backupAppWithTag: rotating row.collectiveownership.co.uk snapshot of 547c3c3f-b9ee-42ff-afce-c7c84d259d2a to path 2026-10-14-103420-487/app_row.collectiveownership.co.uk_v1.40.0 2026-10-14T10:36:20.521Z tasks: updating task 24827 with: {"percent":56.17241379310346,"message":"Copying /mnt/cloudronbackup/snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b to /mnt/cloudronbackup/2026-10-14-103420-487/app_row.collectiveownership.co.uk_v1.40.0"} 2026-10-14T10:36:20.521Z shell: filesystem: ssh -o StrictHostKeyChecking no -i /tmp/identity_file_1f662b17-d900-44e5-b6b5-51c29c075f1c -p 23 u273486@u273486.your-storagebox.de cp -aRl /home/Catalyst/snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b /home/Catalyst/2026-10-14-103420-487/app_row.collectiveownership.co.uk_v1.40.0 2026-10-14T10:36:31.461Z shell: filesystem: ssh -o StrictHostKeyChecking no -i /tmp/identity_file_1f662b17-d900-44e5-b6b5-51c29c075f1c -p 23 u273486@u273486.your-storagebox.de cp -aRl /home/Catalyst/snapshot/app_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b /home/Catalyst/2026-10-14-103420-487/app_row.collectiveownership.co.uk_v1.40.0 errored with code 255 and signal null timeout false terminated false - stdout: "" - stderr: "ssh: Could not resolve hostname u273486.your-storagebox.de: Temporary failure in name resolution \n" 2026-10-14T10:36:31.461Z backuptask: copy: copy to 2026-10-14-103420-487/app_row.collectiveownership.co.uk_v1.40.0 errored. error: SSH connection error: ssh exited with code 255 signal null 2026-10-14T10:36:31.464Z backuptask: fullBackup: app row.collectiveownership.co.uk backup finished. Took 18.813 seconds 2026-10-14T10:36:31.467Z locks: write: current locks: {"full_backup_task_547c3c3f-b9ee-42ff-afce-c7c84d259d2a":null} 2026-10-14T10:36:31.467Z locks: release: app_backup_99de5b4d-6ad8-4f37-b08f-f6e110be4b2b 2026-10-14T10:36:31.468Z tasks: setCompleted - 24827: {"result":null,"error":{"message":"SSH connection error: ssh exited with code 255 signal null","reason":"External Error","stack":"BoxError: SSH connection error: ssh exited with code 255 signal null\\n at copyInternal (file:///home/yellowtent/box/src/storage/filesystem.js:221:49)\\n at async Object.copyDir (file:///home/yellowtent/box/src/storage/filesystem.js:245:12)\\n at async Object.copy (file:///home/yellowtent/box/src/backupformat/rsync.js:148:5)"},"percent":100} 2026-10-14T10:36:31.468Z tasks: updating task 24827 with: {"completed":true,"result":null,"error":{"message":"SSH connection error: ssh exited with code 255 signal null","reason":"External Error","stack":"BoxError: SSH connection error: ssh exited with code 255 signal null\\n at copyInternal (file:///home/yellowtent/box/src/storage/filesystem.js:221:49)\\n at async Object.copyDir (file:///home/yellowtent/box/src/storage/filesystem.js:245:12)\\n at async Object.copy (file:///home/yellowtent/box/src/backupformat/rsync.js:148:5)"},"percent":100} 2026-10-14T10:36:31.470Z taskworker: Task took 131.017 seconds 2026-10-14T10:36:31.470Z BoxError: SSH connection error: ssh exited with code 255 signal null\n at copyInternal (file:///home/yellowtent/box/src/storage/filesystem.js:221:49)\n at async Object.copyDir (file:///home/yellowtent/box/src/storage/filesystem.js:245:12)\n at async Object.copy (file:///home/yellowtent/box/src/backupformat/rsync.js:148:5) 2026-10-14T10:36:31.470Z Exiting with code 0 -
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storagebox@james Thanks for this.
dig A u273486.your-storagebox.dereturns exactly that:; <<>> DiG 9.18.28-0ubuntu0.22.04.1-Ubuntu <<>> A u273486.your-storagebox.de ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 4122 ;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1 ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 65494 ;; QUESTION SECTION: ;u273486.your-storagebox.de. IN A ;; ANSWER SECTION: u273486.your-storagebox.de. 30 IN A 91.98.245.216 ;; Query time: 8 msec ;; SERVER: 127.0.0.53#53(127.0.0.53) (UDP) ;; WHEN: Wed Oct 14 10:30:49 UTC 2026 ;; MSG SIZE rcvd: 71But actually I've just tried to "run back now" and it just worked without having to remount the volume...but I bet I'm still gonna get a "fail to backup" error at 2am later on.
-
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storagebox -
Cloudron 9.0.8 Backup to site sshfs rsync hetzner storageboxHello, I seem to be facing the issue again on one instance.
One backup site on one instance throw this error (BoxError: SSH connection error: ssh exited with code 255 signal null) repeatedly on scheduled backup. When I remount the volume manually and start backup now manually it works fine, but then fail again at the next scheduled backup.
I have another instance using the exact same volume with same config (sshfs + rsync) and it works just fine. Both are on Cloudron 10.0.5.
Here is the log:
2026-10-14T00:00:01.889Z taskworker: Starting task 24823. Logs are at /home/yellowtent/platformdata/logs/tasks/24823.log (node:3648779) ExperimentalWarning: The supports Web Crypto API method is an experimental feature and might change at any time (Use `node --trace-warnings ...` to show where the warning was created) (node:3648779) ExperimentalWarning: The ML-DSA-44 Web Crypto API algorithm is an experimental feature and might change at any time 2026-10-14T00:00:01.925Z taskworker: Running task of type backup 2026-10-14T00:00:01.965Z tasks: updating task 24823 with: {"percent":4.448275862068965,"message":"Backing up pdf.catalystcollective.org (1/26). Waiting for lock"} 2026-10-14T00:00:01.977Z locks: write: current locks: {"full_backup_task_547c3c3f-b9ee-42ff-afce-c7c84d259d2a":null,"app_backup_018ee793-8184-4666-aaee-0fcfa2e9eb8d":"24823"} 2026-10-14T00:00:01.977Z locks: acquire: app_backup_018ee793-8184-4666-aaee-0fcfa2e9eb8d 2026-10-14T00:00:01.978Z tasks: updating task 24823 with: {"percent":4.448275862068965,"message":"Snapshotting app pdf.catalystcollective.org"} 2026-10-14T00:00:01.982Z services: backupAddons: backing up ["localstorage","oidc"] 2026-10-14T00:00:01.983Z backuptask: snapshotApp: pdf.catalystcollective.org took 0.005 seconds 2026-10-14T00:00:01.984Z tasks: updating task 24823 with: {"percent":4.448275862068965,"message":"Uploading app snapshot pdf.catalystcollective.org"} 2026-10-14T00:00:01.984Z backuptask: runBackupUpload: adjusting heap size to 2816M 2026-10-14T00:00:01.985Z shell: backuptask: /usr/bin/sudo --non-interactive -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d 547c3c3f-b9ee-42ff-afce-c7c84d259d2a {"localRoot":"/home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d","layout":[]} 2026-10-14T00:00:03.719Z backupupload: Backing up {"localRoot":"/home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d","layout":[]} to snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d 2026-10-14T00:00:03.721Z backuptask: upload: path snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a dataLayout {"localRoot":"/home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d","layout":[]} (node:3649474) ExperimentalWarning: The supports Web Crypto API method is an experimental feature and might change at any time (Use `node --trace-warnings ...` to show where the warning was created) (node:3649474) ExperimentalWarning: The ML-DSA-44 Web Crypto API algorithm is an experimental feature and might change at any time 2026-10-14T00:00:03.751Z shell: mounts: mountpoint -q -- /mnt/cloudronbackup 2026-10-14T00:00:03.766Z backuptask: checkPreconditions: mount point status is {"state":"active","message":""} 2026-10-14T00:00:03.766Z shell: df: df -B1 --output=source,fstype,size,used,avail,pcent,target /mnt/cloudronbackup 2026-10-14T00:00:03.787Z backuptask: checkPreconditions: getting disk usage of /home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d 2026-10-14T00:00:03.787Z shell: backuptask: du --dereference-args --summarize --block-size=1 --exclude=*.lock --exclude=dovecot.list.index.log.* /home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d 2026-10-14T00:00:03.792Z backuptask: checkPreconditions: total required=356352 available=768645791744 2026-10-14T00:00:03.793Z backupformat/rsync: upload: uploading to site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a path snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d (encrypted: false) dataLayout {"localRoot":"/home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d","layout":[]} 2026-10-14T00:00:03.793Z shell: backupformat/rsync: find /home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d -type d -empty 2026-10-14T00:00:03.799Z shell: backupformat/rsync: find /home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d -type f -executable 2026-10-14T00:00:03.803Z shell: backupformat/rsync: find /home/yellowtent/appsdata/018ee793-8184-4666-aaee-0fcfa2e9eb8d -type l 2026-10-14T00:00:03.809Z syncer: sync: loading cache file /home/yellowtent/platformdata/backup/547c3c3f-b9ee-42ff-afce-c7c84d259d2a/018ee793-8184-4666-aaee-0fcfa2e9eb8d.sync.cache 2026-10-14T00:00:03.813Z backupformat/rsync: sync: processing 0 deletes, 2 additions and 11 unchanged 2026-10-14T00:00:03.814Z backupformat/rsync: sync: done processing deletes. error: null 2026-10-14T00:00:03.817Z tasks: updating task 24823 with: {"percent":4.448275862068965,"message":"Uploaded 0/2 files. Current: config.json (pdf.catalystcollective.org)"} 2026-10-14T00:00:03.865Z backupformat/rsync: sync: done processing adds. error: null 2026-10-14T00:00:03.866Z syncer: finalize: patching in integrity information into /home/yellowtent/platformdata/backup/547c3c3f-b9ee-42ff-afce-c7c84d259d2a/018ee793-8184-4666-aaee-0fcfa2e9eb8d.sync.cache 2026-10-14T00:00:03.870Z backuptask: upload: path snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d site 547c3c3f-b9ee-42ff-afce-c7c84d259d2a uploaded: {"transferred":7672,"size":254217,"fileCount":13} 2026-10-14T00:00:03.893Z backupupload: upload completed. error: null 2026-10-14T00:00:03.894Z backuptask: runBackupUpload: result - {"result":{"stats":{"transferred":7672,"size":254217,"fileCount":13},"integrity":{"signature":"5c31c321a9f85da989a030297e542fe6f4d6879ae5ce5356179077e9a0ce3d89e7a0b9d613c6edd34c355a91cdf06fd664c73a5a316942b5e3532f5c2bc2b40b"}}} 2026-10-14T00:00:03.922Z backuptask: uploadAppSnapshot: pdf.catalystcollective.org uploaded to snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d. 1.938 seconds 2026-10-14T00:00:03.925Z backuptask: backupAppWithTag: rotating pdf.catalystcollective.org snapshot of 547c3c3f-b9ee-42ff-afce-c7c84d259d2a to path 2026-10-14-000001-930/app_pdf.catalystcollective.org_v2.44.0 2026-10-14T00:00:03.942Z tasks: updating task 24823 with: {"percent":4.448275862068965,"message":"Copying /mnt/cloudronbackup/snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d to /mnt/cloudronbackup/2026-10-14-000001-930/app_pdf.catalystcollective.org_v2.44.0"} 2026-10-14T00:00:03.942Z shell: filesystem: ssh -o StrictHostKeyChecking no -i /tmp/identity_file_22cca67b-0dc8-421d-bcf2-f27d3bf2008e -p 23 u273486@u273486.your-storagebox.de cp -aRl /home/Catalyst/snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d /home/Catalyst/2026-10-14-000001-930/app_pdf.catalystcollective.org_v2.44.0 2026-10-14T00:00:03.979Z shell: filesystem: ssh -o StrictHostKeyChecking no -i /tmp/identity_file_22cca67b-0dc8-421d-bcf2-f27d3bf2008e -p 23 u273486@u273486.your-storagebox.de cp -aRl /home/Catalyst/snapshot/app_018ee793-8184-4666-aaee-0fcfa2e9eb8d /home/Catalyst/2026-10-14-000001-930/app_pdf.catalystcollective.org_v2.44.0 errored with code 255 and signal null timeout false terminated false - stdout: "" - stderr: "ssh: Could not resolve hostname u273486.your-storagebox.de: Temporary failure in name resolution \n" 2026-10-14T00:00:03.979Z backuptask: copy: copy to 2026-10-14-000001-930/app_pdf.catalystcollective.org_v2.44.0 errored. error: SSH connection error: ssh exited with code 255 signal null 2026-10-14T00:00:03.981Z backuptask: fullBackup: app pdf.catalystcollective.org backup finished. Took 2.004 seconds 2026-10-14T00:00:03.984Z locks: write: current locks: {"full_backup_task_547c3c3f-b9ee-42ff-afce-c7c84d259d2a":null} 2026-10-14T00:00:03.984Z locks: release: app_backup_018ee793-8184-4666-aaee-0fcfa2e9eb8d 2026-10-14T00:00:03.984Z tasks: setCompleted - 24823: {"result":null,"error":{"message":"SSH connection error: ssh exited with code 255 signal null","reason":"External Error","stack":"BoxError: SSH connection error: ssh exited with code 255 signal null\\n at copyInternal (file:///home/yellowtent/box/src/storage/filesystem.js:221:49)\\n at process.processTicksAndRejections (node:internal/process/task_queues:104:5)\\n at async Object.copyDir (file:///home/yellowtent/box/src/storage/filesystem.js:245:12)\\n at async Object.copy (file:///home/yellowtent/box/src/backupformat/rsync.js:148:5)"},"percent":100} 2026-10-14T00:00:03.984Z tasks: updating task 24823 with: {"completed":true,"result":null,"error":{"message":"SSH connection error: ssh exited with code 255 signal null","reason":"External Error","stack":"BoxError: SSH connection error: ssh exited with code 255 signal null\\n at copyInternal (file:///home/yellowtent/box/src/storage/filesystem.js:221:49)\\n at process.processTicksAndRejections (node:internal/process/task_queues:104:5)\\n at async Object.copyDir (file:///home/yellowtent/box/src/storage/filesystem.js:245:12)\\n at async Object.copy (file:///home/yellowtent/box/src/backupformat/rsync.js:148:5)"},"percent":100} 2026-10-14T00:00:03.987Z taskworker: Task took 2.103 seconds 2026-10-14T00:00:03.987Z BoxError: SSH connection error: ssh exited with code 255 signal null\n at copyInternal (file:///home/yellowtent/box/src/storage/filesystem.js:221:49)\n at process.processTicksAndRejections (node:internal/process/task_queues:104:5)\n at async Object.copyDir (file:///home/yellowtent/box/src/storage/filesystem.js:245:12)\n at async Object.copy (file:///home/yellowtent/box/src/backupformat/rsync.js:148:5) 2026-10-14T00:00:03.987Z Exiting with code 0 -
Wrong directory for previewcleanup cron jobIn addition to this, I also think that preview images should not really be in
/app/data/.
They are not really worth being included in the backup since they can be regenerated at any time.
With the new Cloudron versions there is now persistentDirs so we should move them outside of/app/data/.Yes please! NC previews can be a nightmare with rsync backups because it adds so many small files.
-
Does cubby do file versioning?Question is in the title
-
What's coming in 10.2@girish Great to hear regarding a group mailing list feature. I have mentioned it quite a few times on here (again in what's coming in Cloudron 10 thread), and group mapping between cloudron groups and a mailing list would be super useful so people get added / removed automatically from the list as they get added / removed from a group.
Though I'm not sure what the difference is between that and a Google Group (i.e. between your option 1 and 2)?
-
BigCapital - An open-source alternative to QuickBooksGiven the architecture of the app, does it look easy / difficult to package for Cloudron?