Solved MySQL Unresponsive!

[A Former User]

This appeared to happen after a restart. SSHing in and restarting both mysql and box don't seem to help. I restarted the machine as well, no luck

I leave for my honeymoon (2 weeks) tomorrow and was made aware of this issue just now.

I've been a bit of a bother with support lately but am hoping @staff can save the day. Thanks in advance guys! (also SSH access is up and I sent in a ticket)

[A Former User]

My guess is its corrupted. Not entirely sure how this would have happened but I can try a fresh install of cloudron and restoring. I also just tried the steps from the troubleshooting guide in the docs and its seemingly still an issue. At a loss and in a panic !_!

[girish]

The exact error seems to be :

2021-09-30T21:51:49.217687Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.23-0ubuntu0.20.04.1) starting as process 12
2021-09-30T21:51:49.222399Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-09-30T21:51:49.608795Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for reading partial data failed.
2021-09-30T21:51:49.608911Z 1 [ERROR] [MY-012642] [InnoDB] Tried to read 1024 bytes at offset 0, but was only able to read 0
2021-09-30T21:51:49.608981Z 1 [ERROR] [MY-012592] [InnoDB] Operating system error number 5 in a file operation.
2021-09-30T21:51:49.609050Z 1 [ERROR] [MY-012596] [InnoDB] Error number 5 means 'Input/output error'
2021-09-30T21:51:49.609185Z 1 [ERROR] [MY-012646] [InnoDB] File cache_messages.ibd: 'read' returned OS error 105. Cannot continue operation
2021-09-30T21:51:49.609259Z 1 [ERROR] [MY-012981] [InnoDB] Cannot continue operation.

[A Former User]

Oh my... I interpret that as part of the DB is definitely corrupted. I also noticed some weird permissions issues trying to initialize the db while following the Recover MySQL guide. I just ended up backtracking the steps I did take to get back to where I was originally

[girish]

@atridad indeed, it seems two of the databases/apps are corrupt. I just restored them from a backup and they are running again now. Can you please check?

[A Former User]

@girish I just sent this via email but its worth having here if anyone else runs into this. They both seem to work now, thank you!

As for the addon, how did you end up getting that going?

Also, would you suggest I test a reboot to see how things come back up or would you advise against tempting fate this way?

[A Former User]

Update: a restart worked just fine without issues. I'm going to make sure I start a backup now

[girish]

I put some docs on how to fix the mysql addon here - https://docs.cloudron.io/troubleshooting/#mysql-addon . It's not "complete" but it's very hard to write those docs since there's a lot of things that can go wrong with mysql....