Fix for kernel bug in Ubuntu 20.04 causing various issues
-
@p44 said in Fix for kernel bug in Ubuntu 20.04 causing various issues:
"cron jobs don't work anymore" problem is still there.
Seems to have gone for me. Previously my Nextclouds were giving me warnings about that, but they aren't doing that anymore.
-
@jdaviescoates Thank's a lot, I'll do more accurate tests ... it seems only few cron jobs are executed, in external cron panel
-
@girish said in Fix for kernel bug in Ubuntu 20.04 causing various issues:
I upgraded all our servers from Ubuntu 18 to 20 and all of them just completely hosed
Interesting.... I upgraded one server from 16 > 18 > 20 and two more servers from 18 > 20 using the Cloudron guides and never had a problem. I was going to upgrade to 22 thinking it'll all be easy but a little more unsure now.
-
@avatar1024 I think it's some issue with the DO apt mirrors. Something is out of rsync. I test out upgrading in vultr/linode and they seem perfect.
-
-
At least on vultr Ubuntu 20.04 repository mirrors, the new fixed kernel is already available via security updates. You can check if this is the same in your instance by running:
apt-get update && apt list --upgradable | grep "\-security"
If it lists
linux-generic/focal-updates,focal-security 5.4.0.135.133 amd64 [upgradable from: 5.4.0.132.132]
then you have to unhold the previously hold packages and eventually it will normally update:apt-mark unhold linux-generic linux-image-generic linux-headers-generic
-
@p44 this seems to have come to our servers atleast. So, yes, go ahead an unmark the holds.
Start-Date: 2022-12-03 06:10:57 Commandline: /usr/bin/unattended-upgrade Install: linux-image-5.4.0-135-generic:amd64 (5.4.0-135.152, automatic), linux-headers-5.4.0-135:amd64 (5.4.0-135.152, automatic), linux-modules-extra-5.4.0-135-generic:amd64 (5.4.0-135.152, automatic), linux-modules-5.4.0-135-generic:amd64 (5.4.0-135.152, automatic), linux-headers-5.4.0-135-generic:amd64 (5.4.0-135.152, automatic) Upgrade: linux-headers-generic:amd64 (5.4.0.132.132, 5.4.0.135.133), linux-image-generic:amd64 (5.4.0.132.132, 5.4.0.135.133), linux-generic:amd64 (5.4.0.132.132, 5.4.0.135.133) End-Date: 2022-12-03 06:12:14
-
-
-
-
@nebulon Should we have to reverse also this step?
- Edit /etc/default/grub . Find the line GRUB_DEFAULT=0. Change this to GRUB_DEFAULT="Advanced options for Ubuntu>Ubuntu, with Linux 5.4.0-131-generic" . Important you get this line right, otherwise your server may not boot
-
@girish said in Fix for kernel bug in Ubuntu 20.04 causing various issues:
@p44 I put in instructions to reverse in the original post.
Thanks.
I tried to implement the instructions to reverse. For me, this didn't work. I followed the steps, did the reboot, and uname -nar still shows 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
I tried to follow the steps suggested by @nebulon here: https://forum.cloudron.io/post/57470
When checking for updates, it provided the following output:
Hit:1 http://no.archive.ubuntu.com/ubuntu focal InRelease Hit:2 http://no.archive.ubuntu.com/ubuntu focal-updates InRelease Hit:3 http://no.archive.ubuntu.com/ubuntu focal-backports InRelease Hit:4 http://no.archive.ubuntu.com/ubuntu focal-security InRelease Reading package lists... Done WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
Maybe it was wrong, but I unholded the previously hold packages.
Then I rebooted and waited a few hours. Nothing happened, I was still on 5.4.0-131-generic
So I tried the next step I could find, by following the instructions here (as best as I could understand): https://forum.cloudron.io/post/57552
At command line, I typed sudo /usr/bin/unattended-upgrade
Again, I rebooted and again I was still on 5.4.0-131 when I checked today.
So now, I tried to follow the new instructions you put on top of this post.
First, the unhold command gave the output that the change already had been unholded.
Second, when doing sudo unattended-upgrade -d, I got a huge output, but nothing in that output said anything about 5.4.0-135 generic. (I pasted the full output below, sorry if it becomes a long post).
I continued to follow the instructions as best as I could, so I edited /etc/default/grub like it says in the reverse instruction post, did a reboot, and checked uname -nar again. Still on 5.4.0-131 generic.
I have not apt removed 5.4.0.131 (as I thought that perhaps would be a bad idea since I apparently don't have a newer), and I have not restored /etc/default/grub to default 0.
Could you offer any assistance, perhaps? Is this easily fixable, or do I have to clean install the whole Cloudron and restore from backup?
I am on Ubuntu 20.04 and I self host.
Thank you!
edit: I have to reply to this post, because the output is too long for the editor:
-
@odie Here's the full log output (part 1):
sudo unattended-upgrade -d Could not figure out development release: Distribution data outdated. Please check for an update for distro-info-data. See /usr/share/doc/distro-info-data/README.Debian for details. Starting unattended upgrades script Allowed origins are: o=Ubuntu,a=focal, o=Ubuntu,a=focal-security, o=UbuntuESMApps,a=focal-apps-security, o=UbuntuESM,a=focal-infra-security Initial blacklist: Initial whitelist (not strict): Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_universe_i18n_Translation-en' a=focal-backports,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=54888 ID:19> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_universe_binary-amd64_Packages' a=focal-backports,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=109628 ID:18> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_main_i18n_Translation-en' a=focal-backports,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=143564 ID:17> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_main_binary-amd64_Packages' a=focal-backports,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=262545 ID:16> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_multiverse_i18n_Translation-en' a=focal-updates,c=multiverse,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=40183 ID:15> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_multiverse_binary-amd64_Packages' a=focal-updates,c=multiverse,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=152417 ID:14> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_universe_i18n_Translation-en' a=focal-updates,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=1933703 ID:13> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_universe_binary-amd64_Packages' a=focal-updates,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=5823472 ID:12> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_restricted_i18n_Translation-en' a=focal-updates,c=restricted,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=3928873 ID:11> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_restricted_binary-amd64_Packages' a=focal-updates,c=restricted,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=8982186 ID:10> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_main_i18n_Translation-en' a=focal-updates,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=8135480 ID:9> with -32768 pin Marking not allowed <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_main_binary-amd64_Packages' a=focal-updates,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=12360070 ID:8> with -32768 pin Applying pinning: PkgFilePin(id=19, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_universe_i18n_Translation-en' a=focal-backports,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=54888 ID:19> Applying pinning: PkgFilePin(id=18, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_universe_binary-amd64_Packages' a=focal-backports,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=109628 ID:18> Applying pinning: PkgFilePin(id=17, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_main_i18n_Translation-en' a=focal-backports,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=143564 ID:17> Applying pinning: PkgFilePin(id=16, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-backports_main_binary-amd64_Packages' a=focal-backports,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=262545 ID:16> Applying pinning: PkgFilePin(id=15, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_multiverse_i18n_Translation-en' a=focal-updates,c=multiverse,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=40183 ID:15> Applying pinning: PkgFilePin(id=14, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_multiverse_binary-amd64_Packages' a=focal-updates,c=multiverse,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=152417 ID:14> Applying pinning: PkgFilePin(id=13, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_universe_i18n_Translation-en' a=focal-updates,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=1933703 ID:13> Applying pinning: PkgFilePin(id=12, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_universe_binary-amd64_Packages' a=focal-updates,c=universe,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=5823472 ID:12> Applying pinning: PkgFilePin(id=11, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_restricted_i18n_Translation-en' a=focal-updates,c=restricted,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=3928873 ID:11> Applying pinning: PkgFilePin(id=10, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_restricted_binary-amd64_Packages' a=focal-updates,c=restricted,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=8982186 ID:10> Applying pinning: PkgFilePin(id=9, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_main_i18n_Translation-en' a=focal-updates,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='' site='no.archive.ubuntu.com' IndexType='Debian Translation Index' Size=8135480 ID:9> Applying pinning: PkgFilePin(id=8, priority=-32768) Applying pin -32768 to package_file: <apt_pkg.PackageFile object: filename:'/var/lib/apt/lists/no.archive.ubuntu.com_ubuntu_dists_focal-updates_main_binary-amd64_Packages' a=focal-updates,c=main,v=20.04,o=Ubuntu,l=Ubuntu arch='amd64' site='no.archive.ubuntu.com' IndexType='Debian Package Index' Size=12360070 ID:8> Using (^linux-.*-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^kfreebsd-.*-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^gnumach-.*-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^.*-modules-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^.*-kernel-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^linux-.*-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^kfreebsd-.*-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^gnumach-.*-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^.*-modules-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$|^.*-kernel-[1-9][0-9]*\.[0-9]+\.[0-9]+-[0-9]+(-.+)?$) regexp to find kernel packages Using (^linux-.*-5\.4\.0\-131\-generic$|^linux-.*-5\.4\.0\-131$|^kfreebsd-.*-5\.4\.0\-131\-generic$|^kfreebsd-.*-5\.4\.0\-131$|^gnumach-.*-5\.4\.0\-131\-generic$|^gnumach-.*-5\.4\.0\-131$|^.*-modules-5\.4\.0\-131\-generic$|^.*-modules-5\.4\.0\-131$|^.*-kernel-5\.4\.0\-131\-generic$|^.*-kernel-5\.4\.0\-131$|^linux-.*-5\.4\.0\-131\-generic$|^linux-.*-5\.4\.0\-131$|^kfreebsd-.*-5\.4\.0\-131\-generic$|^kfreebsd-.*-5\.4\.0\-131$|^gnumach-.*-5\.4\.0\-131\-generic$|^gnumach-.*-5\.4\.0\-131$|^.*-modules-5\.4\.0\-131\-generic$|^.*-modules-5\.4\.0\-131$|^.*-kernel-5\.4\.0\-131\-generic$|^.*-kernel-5\.4\.0\-131$) regexp to find running kernel packages Checking: alsa-ucm-conf ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: alsa-ucm-conf=1.2.2-1ubuntu0.8 Checking: apport ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: apport=2.20.11-0ubuntu27.24 Checking: apt ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: apt=2.0.6 Checking: apt-utils ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: apt-utils=2.0.6 Checking: base-files ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: base-files=11ubuntu5.3 Checking: bolt ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: bolt=0.8-4ubuntu1 Checking: cloud-init ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: cloud-init=22.2-0ubuntu1~20.04.3 Checking: cloud-initramfs-copymods ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: cloud-initramfs-copymods=0.45ubuntu1 Checking: cloud-initramfs-dyn-netconf ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: cloud-initramfs-dyn-netconf=0.45ubuntu1 Checking: command-not-found ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: command-not-found=20.04.4 Checking: distro-info-data ([<Origin component:'main' archive:'focal-updates' origin:'Ubuntu' label:'Ubuntu' site:'no.archive.ubuntu.com' isTrusted:True>]) adjusting candidate version: distro-info-data=0.43ubuntu1.10