Adguard crashing from time to time: "driver failed programming external connectivity on endpoint"

[necrevistonnezr]

Every few days Adguard crashes (is not running).
When I try to restart the app I get the following error:

Docker Error: (HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (caa121580d7aa7d32e4b7f6d91ac3d559a3127e819968f3b2c8fdb98049cf26c): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address

Another attempt to restart is usually successful.

In the app logs, I have entries like this:

2023-12-14T05:53:34.879Z box:apptask run: app error for state pending_restart: BoxError: (HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address at Object.restartContainer (/home/yellowtent/box/src/docker.js:444:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async restart (/home/yellowtent/box/src/apptask.js:683:9) { reason: 'Docker Error', details: {}, nestedError: Error: (HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address at /home/yellowtent/box/node_modules/docker-modem/lib/modem.js:315:17 at getCause (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:345:7) at Modem.buildPayload (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:314:5) at IncomingMessage.<anonymous> (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:286:14) at IncomingMessage.emit (node:events:525:35) at endReadableNT (node:internal/streams/readable:1359:12) at process.processTicksAndRejections (node:internal/process/task_queues:82:21) { reason: 'server error', statusCode: 500, json: { message: 'Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address' } } }
2023-12-14T05:53:34.907Z box:taskworker Task took 0.655 seconds
2023-12-14T05:53:34.908Z box:tasks setCompleted - 14975: {"result":null,"error":{"stack":"BoxError: (HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address \n    at Object.restartContainer (/home/yellowtent/box/src/docker.js:444:50)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async restart (/home/yellowtent/box/src/apptask.js:683:9)","name":"BoxError","reason":"Docker Error","details":{},"message":"(HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address ","nestedError":{"stack":"Error: (HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address \n    at /home/yellowtent/box/node_modules/docker-modem/lib/modem.js:315:17\n    at getCause (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:345:7)\n    at Modem.buildPayload (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:314:5)\n    at IncomingMessage.<anonymous> (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:286:14)\n    at IncomingMessage.emit (node:events:525:35)\n    at endReadableNT (node:internal/streams/readable:1359:12)\n    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)","name":"Error","reason":"server error","message":"(HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address "}}}
2023-12-14T05:53:34.908Z box:tasks update 14975: {"percent":100,"result":null,"error":{"stack":"BoxError: (HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address \n    at Object.restartContainer (/home/yellowtent/box/src/docker.js:444:50)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async restart (/home/yellowtent/box/src/apptask.js:683:9)","name":"BoxError","reason":"Docker Error","details":{},"message":"(HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address ","nestedError":{"stack":"Error: (HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc (6d7cd2ee04b394685a44e3cf455e285734fed000e5ef7475a07064f74aaba022): Error starting userland proxy: listen tcp6 [2001:6c8:451a:at87:6c71:71fd:febc:e0a0]:53: bind: cannot assign requested address \n    at /home/yellowtent/box/node_modules/docker-modem/lib/modem.js:315:17\n    at getCause (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:345:7)\n    at Modem.buildPayload (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:314:5)\n    at IncomingMessage.<anonymous> (/home/yellowtent/box/node_modules/docker-modem/lib/modem.js:286:14)\n    at IncomingMessage.emit (node:events:525:35)\n    at endReadableNT (node:internal/streams/readable:1359:12)\n    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)","name":"Error","reason":"server error","message":"(HTTP code 500) server error - Cannot restart container d75gjcf8-56f5-4d0e-ad76-f85aab4089bc: driver failed programming external connectivity on endpoint d75gjcf8-56f5-4d0e-ad76-f85aab4089bc 

[girish]

Is it possible that your server's IPv4 or IPv6 addresses changes ?

[necrevistonnezr]

Yes, it's a server @ home with dynamic IPs

[nebulon]

It is a known issue, with adguard container attaching to the internal IP, which now has changed. The container needs to be rebuilt, not just restarted in such situations, which the repair will do.

One solution is to give the Cloudron a static ipv4 and ipv6 (if used)

[nebulon]

To avoid this situation we will stop binding to ipv6 for adguard with the next release https://git.cloudron.io/cloudron/box/-/commit/5ac9a7f1ef6a49310cb6c865f5fa4b69530a48e0

[necrevistonnezr]

@nebulon said in Adguard crashing from time to time: "driver failed programming external connectivity on endpoint":

One solution is to give the Cloudron a static ipv4 and ipv6 (if used)

That’s referring to the IP provided by my ISP (and thus not possible in my case), correct?

BTW I didn’t have this issue under the same setup until a few weeks ago - did something change in the package then?

[girish]

@necrevistonnezr Could be something changed in your ISP regarding IPv6 rotation. But @nebulon and I see this pretty consistently in our home servers (in Berlin, where they seem to rotate IPv6 for some reason).