DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN

[micmc]

I move Cloudron to another server, but updated to 8.0.4 just before.
When I restored my last backup, all DNS changes went through, except a few that I had to manually change the IP address of the TLD only while the subdomains all changed automatically.

And yes, all AAAA records with the correct IP6 address are well set.

The thing is all apps and emails are working correctly and running from the new server, since the restore has been made yesterday evening and thus all DNS changes occurred several hours ago.

However, for the majority of the "My Apps" page on this Cloudron the button is RED with showing ERROR on mouseover and when we click on the app we get to the Repair page and see this:
"Task Error
If a configuration, update, restore or backup action resulted in an error, you can retry the task.

An error occurred during the restore operation: (RED)DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN"

And the Button show that says "Retry Restore Task" though it seems it want to retry the restore the backup however I DO NOT WANT TO as everything works correctly and well the backup is almost 24h old now so I sure do NOT want to overwrite my server's files with 24h old files...

There must be a way to fix this without restoring again?

[nebulon]

If you check the DNS record with host -t AAAA <domain> from SSH on your server, do they resolve correctly to the value which should be also shown in the app task logs?

[girish]

@micmc if you have the CLI tool set up, you can cloudron configure --app appid . Otherwise, if you reach out on support@ , we can fix it up.

[micmc]

@nebulon said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

If you check the DNS record with host -t AAAA <domain> from SSH on your server, do they resolve correctly to the value which should be also shown in the app task logs?

Hi, thanks, yeah I'm using Cloudflare and as we can imagine sending the proposed command does not show the real IP even with domains showing the green light.

@girish Seems like even through CLI Cloudron does not allow any changes in "error state"

$ cloudron configure --app af720f6a-af3d-xxxx-85d8-29dcf4e14010
Enter new location (default: sub.domain.com): 
Failed to configure app: 409 message: Not allowed in error state

Anything else I can try before emailing support?
Regards,
Andy

[micmc]

Under CLI when I "list" the apps I see their status as "error (pending restore)" for those showing as red in the UI.

[girish]

@micmc yes, can you try cloudron repair --app af720f6a-af3d-xxxx-85d8-29dcf4e14010 . However, this command requires you to run this from the package repo (it needs the manifest to repair). So:

git clone https://git.cloudron.io/cloudron/<appname>-app.git
cd <appname>-app
cloudron repair --app xx

[girish]

@micmc I made a note to fix the repair flow in such situations in next release. Not ideal to have to run some CLI tool (but also this is kind of rare to hit, which is why it's unfixeD).

[micmc]

@girish said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

@micmc yes, can you try cloudron repair --app af720f6a-af3d-xxxx-85d8-29dcf4e14010 . However, this command requires you to run this from the package repo (it needs the manifest to repair). So:

git clone https://git.cloudron.io/cloudron/<appname>-app.git
cd <appname>-app
cloudron repair --app xx

Well, thanks, actually your repository requires a mandatory 2FA and it's absolutely NOT obvious to use with git at all.

$ git clone https://git.cloudron.io/cloudron/mindmap-app.git
Cloning into 'mindmap-app'...
Username for 'https://git.cloudron.io': xxxx
Password for 'https://xxxx@git.cloudron.io': 
remote: HTTP Basic: Access denied. The provided password or token is incorrect or your account has 2FA enabled and you must use a personal access token instead of a password. See https://git.cloudron.io/help/topics/git/troubleshooting_git#error-on-git-fetch-http-basic-access-denied
fatal: Authentication failed for 'https://git.cloudron.io/cloudron/mindmap-app.git/'

So, once I have created that personal access token how would you apply it with the git command you suggest, because the suggested link is absolutely not explicit at all, to finally access the files because I've about 15 domain to fix and it seems to get long to fix now. lol

Yeah, certainly a very rare bug, I've personally never seen such thing, but cannot be fixed until it comes out as you say so, and a good idea to fix in advance to prevent it to happen again.

Especially as some might start to panic seeing such thing loll

[girish]

@micmc yes, thanks for testing. Not overly convenient, agreed....

[micmc]

@micmc said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

So, once I have created that personal access token how would you apply it with the git command you suggest,

@girish said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

@micmc yes, thanks for testing. Not overly convenient, agreed....

Well, I'm actually NOT only testing but I'm still stuck with this problem and my above comment was a question sorry it went through and doesn't look like it.

See, I cannot git into your repository and so I still CANNOT REPAIR the glitch, because your repository FORCES me to set a 2FA. And according to the error message I've quoted above I need to create a personal access token. DONE.

Now, HOW do I apply the command to repair each apps as you suggest (there's almost 30)

git clone https://git.cloudron.io/cloudron/<appname>-app.git
cd <appname>-app
cloudron repair --app xx

with using my personal access token so it works?
I've tried different combinations with not much success.
I mean, I'm certainly not the only one who'd need to access the repo somehow and thus would need that token too...

[girish]

@micmc said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

$ git clone https://git.cloudron.io/cloudron/mindmap-app.git

Is this a real repo? It's a 404 here. I thought you were giving an example... What is the mindmap app?

Try git clone https://git.cloudron.io/cloudron/nextcloud-app.git for example. It works fine here without any token.

[micmc]

@girish said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

@micmc said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

$ git clone https://git.cloudron.io/cloudron/mindmap-app.git

Is this a real repo? It's a 404 here. I thought you were giving an example... What is the mindmap app?

Try git clone https://git.cloudron.io/cloudron/nextcloud-app.git for example. It works fine here without any token.

Arrghh, loll you're right lol I assumed here the sub-domain as the -app name duh... and me asking myself why are they making this so complicated...

Okay, talking about mindmap the app is TLDraw which nevertheless still does not exist anymore in the repo? That means in the case of such apps the glitch won't be reparable?

Now, indeed it goes through with the RIGHT -app name I get the repo copy, however maybe there is something missing in the command you suggest as when I launch cloudron repair --app <appid> I now get the following

No image found, please run `cloudron build` first or use --image

I get the above error no matter the app for example here it's Trilium and WordPress unmanaged.

[girish]

@micmc said in DNS Error: DNS AAAA Record is not synced yet: ETRYAGAIN:

Okay, talking about mindmap the app is TLDraw which nevertheless still does not exist anymore in the repo? That means in the case of such apps the glitch won't be reparable?

https://git.cloudron.io/cloudron/tldraw-app

No image found, please run cloudron build first or use --image

ugh. I have fixed this issue in the CLI tool. If you upgrade to CLI v5.9.0, you don't need to git clone and all that. Just cloudron repair --app mindmap and it should work. Can you please try?

[micmc]

@girish Yeah, let me try this indeed just got notified of a new version.
Will report back ...

[micmc]

@girish Okay, yet another thing the CLI seems to NOT really updating OR is presenting a false version number after being called. See:
$ sudo npm install -g cloudron@5.9.0
changed 107 packages in 2s
21 packages are looking for funding
run npm fund for details
$ cloudron -V
5.4.1
WTF?

[micmc]

@girish moreover, the package.json on my WS indicates the version installed as being "version": "5.9.0"so then I still tried from the git directory and I still get:

No image found, please run `cloudron build` first or use --image

Now, when I try without the git to the repo then I get:
App repair error: No CloudronManifest.json found
Ho my...