We were able to resolve this. The root cause was the missing unbound-anchor ubuntu package. After intstalling this it worked.
More info on that issue is at https://forum.cloudron.io/topic/12496/unbound-anchor-not-found-in-ubuntu-24-04?_=1727881329798