GRUB failing to load kernel on Intel Atom boards (Intel NM10 chipset) #3305

HAPSagan · 2024-04-12T10:19:53Z

Describe the issue you are experiencing

I see GNU GRUB with 4 options - Slot A, Slot B, Slot A rescue shell, Slot B rescue shell.
Selecting any of them results in a message that it's unable to boot.
I dont get any CLI options.
I have used Linux Reader to download the backups from the disk and have then tried to do a fresh installation with OS12.2. The result is the same as after the update - unable to boot from any slot. After that I did a fresh install with OS 12.1 and everything started fine again.

What operating system image do you use?

generic-x86-64 (Generic UEFI capable x86-64 systems)

What version of Home Assistant Operating System is installed?

12.1

Did you upgrade the Operating System.

Yes

Steps to reproduce the issue

Do a fresh install with OS 12.2 or update to OS 12.2 and it's unable to boot.

...

Anything in the Supervisor logs that might be useful for us?

Can´t get a log.

Anything in the Host logs that might be useful for us?

Can´t get a log.

System information

No response

Additional information

No response

ahmetem · 2024-04-12T11:32:24Z

same problem . HA OS doesn't boot when updating from 12.1 to 12.2

Mpgod80 · 2024-04-12T12:10:45Z

Same issue here. Going from 12.1 to 12.2 then I can´t boot.

Onepamopa · 2024-04-12T12:17:35Z

Same here... When the VM reboots after the update - it selects "Slot B" which has "unknown filesystem".
I have to manually select "Slot A" to boot - it boots 12.1 w/o an update.

agners · 2024-04-12T12:51:58Z

@HAPSagan @ahmetem @Mpgod80 you all are running on native x86-64 hardware? What hardware are you using?

@Onepamopa can you open a new issue along with information of your virtualization environment? It also seems yours behaved different as the old boot slot still worked (unlike the case OP reported).

ahmetem · 2024-04-12T13:04:42Z

Its features are below. It was working smoothly until the last update.
tried to do a fresh installation with OS12.2. but the result did not change.
Slot A, Slot B, Slot A rescue shell, Slot B rescue shell .none of them work.

MacBook Air (11-inch, Mid 2011) a1370
64GB flash storage
1.6GHz dual-core Intel Core i5
2GB of 1333MHz DDR3 onboard memory
Advanced Intel HD Graphics 3000.

agners · 2024-04-12T13:12:56Z

On a new installation, what happens exactly when you choose Slot A with HAOS 12.2? Anything written on the screen? Black screen? Reset?

Mpgod80 · 2024-04-12T13:15:06Z

@agners
The hardware both me and HAPSagan is runing on is:

Intel Atom CPU D2500 @ 1,86Ghz 4,0 Gb RAM 60gb SSD.
Runing HAOS img directly on the SSD drive with an image flashed in Balena Etcher.

ahmetem · 2024-04-12T13:17:25Z

When I try to make a new installation, the same list appears.
Slot A (OK=0 TRY=0)
Slot B (OK=0 TRY=0) and after the selection is made, a line flashes on the screen.

henrikcaesar · 2024-04-12T19:59:33Z

Same here 😱 Also running an old Intel atom with cpu integrated on the motherboard. Can’t get any info out of the system. If it would help I can get a live Linux usb.

ahmetem · 2024-04-12T20:07:12Z

i boot ha with Super Grub2 Disk image on usb disk. show all boot menu. and selected slot a. it open normaly. but i dont know How do I make this permanent? or fix it.
i think re install grub. or maybe downgrade 12.1 fix it.

coc · 2024-04-12T22:06:08Z

Same problem on a ThinkCentre m93p.

SellSan · 2024-04-13T06:51:27Z

I Have HP T610 and the same issue. The only I can do I can run command from this window and can edit these 4 options parameters.

Mpgod80 · 2024-04-13T06:57:53Z

I Have HP T630 and the same issue. The only I can do I can run command from this window and can edit these 4 options parameters.

I have the same screen but when I select "Slot A" it boots into 12.1. Have you tried?

Tried that but that wont work for me :/

SellSan · 2024-04-13T06:58:20Z

I Have HP T630 and the same issue. The only I can do I can run command from this window and can edit these 4 options parameters.

I have the same screen but when I select "Slot A" it boots into 12.1. Have you tried?

I tried, none of the options worked...

JitteryDoodle · 2024-04-13T09:00:44Z

I have an Intel NUC D54250WYK and also experienced this issue when upgrading to 12.2. Luckily, selecting Slot A booted back into 12.1.

Omri-Kleynhans · 2024-04-13T14:24:30Z

Even downloading haos_generic-x86-64-12.2.img and created new installation does not work. Boot not possible. Same error as afterupgrade from 12.1 to 12.2

agners · 2024-04-13T18:19:39Z

It sounds like a GRUB2 issue of some kind. That got updated from GRUB 2.06 to 2.12 as far as I can tell.

FWIW, the rc (and release) versions have been tested and are working fine on various Intel NUC systems. It seems a particular hardware/BIOS which causes issue.

It kinda reminds me of that bug fix we added in 8.0.rc4 (#1830 (comment)), but it seems that is applied upstream in GRUB 2.12 today, so that should no longer be the problem 🤔

Can you replace the U-Boot binary (on the first partition of the disk at /EFI/BOOT/bootx64.efi) with the version from HAOS 12.1 and see if this boots?

Omri-Kleynhans · 2024-04-13T18:46:05Z

It sounds like a GRUB2 issue of some kind. That got updated from GRUB 2.06 to 2.12 as far as I can tell.

FWIW, the rc (and release) versions have been tested and are working fine on various Intel NUC systems. It seems a particular hardware/BIOS which causes issue.

It kinda reminds me of that bug fix we added in 8.0.rc4 (#1830 (comment)), but it seems that is applied upstream in GRUB 2.12 today, so that should no longer be the problem 🤔

Can you replace the U-Boot binary (on the first partition of the disk at /EFI/BOOT/bootx64.efi) with the version from HAOS 12.1 and see if this boots?

Yes have done that, replaced all files at `/EFI/BOOT/'. It does work. Server can boot again HAS back up. Thanks

SellSan · 2024-04-13T19:54:15Z

It sounds like a GRUB2 issue of some kind. That got updated from GRUB 2.06 to 2.12 as far as I can tell.
FWIW, the rc (and release) versions have been tested and are working fine on various Intel NUC systems. It seems a particular hardware/BIOS which causes issue.
It kinda reminds me of that bug fix we added in 8.0.rc4 (#1830 (comment)), but it seems that is applied upstream in GRUB 2.12 today, so that should no longer be the problem 🤔
Can you replace the U-Boot binary (on the first partition of the disk at /EFI/BOOT/bootx64.efi) with the version from HAOS 12.1 and see if this boots?

Yes have done that, replaced all files at `/EFI/BOOT/'. It does work. Server can boot again HAS back up. Thanks

Hi, could you share where from I can download that file?

pierrepaap · 2024-04-13T19:58:22Z

same issue.
hardware : Intel D525MW motherboard (bios from 2010)
a bit more history there https://community.home-assistant.io/t/os-12-2-upgrade-left-ha-on-grub-menu-unbootable/715974/17

I'm surprised though that the 'backup' entry also does not start. I would assume that the EFI file would still be from 12.1 ?

pierrepaap · 2024-04-14T18:36:07Z

So... any viable solution to update to 12.2 ? Or we should wait for 12.3..

well...
after replacing the uboot efi with the one of the 12.1 image I am now in 12.2
Obivously a hassle. So 'im going to stay like this until this bug is fixed

 Core 2024.4.2
Supervisor 2024.04.0
Operating System 12.2
Frontend 20240404.1

EDIT: corrected typo 'I am now in 12.2'

pierrepaap · 2024-04-14T21:27:24Z

So... any viable solution to update to 12.2 ? Or we should wait for 12.3..

well... after replacing the uboot efi with the one of the 12.1 image I am not in 12.2 Obivously a hassle. So 'im going to stay like this until this bug is fixed
 Core 2024.4.2
Supervisor 2024.04.0
Operating System 12.2
Frontend 20240404.1
Ugh.... it says you're on 12.2 ?

typo... I am NOW in 12.2

agners · 2024-04-15T07:41:04Z

I'm surprised though that the 'backup' entry also does not start. I would assume that the EFI file would still be from 12.1 ?

We only ship a single boot loader. In a way, we rely on the bootloader to implement the backup boot method. But if that new bootloader fails in some ways, it is essentially game over 😢

Hi, could you share where from I can download that file?

These are the two U-Boot boot loader files from HAOS 12.1 (replace the existing ones in /EFI/BOOT on the first boot partition with these files):
grub-2.06-haos-12.1.zip

Are those affected UEFI BIOS'es maybe 32-bit BIOSes? E.g. can someone check if only replacing bootia32.efi helps (so maybe this is related to #1752)?

sairon · 2024-08-14T13:06:44Z

@ChernyaevAN Right, I know what's wrong 🤦 I will create a patch for that, however, that means the original patch only works on D525 😬 Unfortunately, no one with the affected boards answered my call for testing or tried the RC builds of 13.0.

@ChernyaevAN

Report from @ChernyaevAN in [1] revealed it's 13829424153406670433 in decimal, which means the endianness was wrong for the CPUs I didn't have available for testing. [1] #3305 (comment)

ChernyaevAN · 2024-08-14T13:25:53Z

@ChernyaevAN Right, I know what's wrong 🤦 I will create a patch for that, however, that means the original patch only works on D525 😬 Unfortunately, no one with the affected boards answered my call for testing or tried the RC builds of 13.0.

Sorry, but I'm not so advanced to try RC's.
Do I understand correctly that I need just to wait patch and manual?

@ChernyaevAN

Report from @ChernyaevAN in [1] revealed it's 13829424153406670433 in decimal, which means the endianness was wrong for the CPUs I didn't have available for testing. [1] #3305 (comment)

sairon · 2024-08-14T15:44:34Z

@ChernyaevAN It's a bit more complicated, since the current GRUB installed on your machine is faulty. You will need to connect the drive to a different PC, or boot any live USB distro on your Atom, and copy the files from the following archive to overwrite those in /EFI/BOOT folder in the boot partition of HAOS.

grub2-nm10-fixed.zip

Sorry for the complications 😢

ChernyaevAN · 2024-08-14T16:10:54Z

@ChernyaevAN It's a bit more complicated, since the current GRUB installed on your machine is faulty. You will need to connect the drive to a different PC, or boot any live USB distro on your Atom, and copy the files from the following archive to overwrite those in /EFI/BOOT folder in the boot partition of HAOS.

grub2-nm10-fixed.zip

Sorry for the complications 😢

This is not the problem. I will post after installation.

ahmetem · 2024-08-14T16:25:24Z

The same problem occurred with 13.0. There was no problem with version 12.4.
i boot ha with Super Grub2 Disk image on usb disk. show all boot menu. and selected slot a. it open normaly.
after downgrade 12.4.boot is normaly start again.

MacBook Air (11-inch, Mid 2011) a1370
64GB flash storage
1.6GHz dual-core Intel Core i5
2GB of 1333MHz DDR3 onboard memory
Advanced Intel HD Graphics 3000.

ChernyaevAN · 2024-08-14T20:07:15Z

@ChernyaevAN It's a bit more complicated, since the current GRUB installed on your machine is faulty. You will need to connect the drive to a different PC, or boot any live USB distro on your Atom, and copy the files from the following archive to overwrite those in /EFI/BOOT folder in the boot partition of HAOS.

grub2-nm10-fixed.zip

Sorry for the complications 😢

It works after patching but offers me to upgrade. Do I just need to wait for the new operation system version?

sairon · 2024-08-14T20:37:46Z

@ChernyaevAN It should be safe to select the other boot slot with OS 13.0 in GRUB boot menu, or run ha os boot-slot other. But definitely don't upgrade to OS 13.0 again, wait at least for 13.1.rc1 which should fix that.

@ahmetem Can you please also follow the instructions above to get the processor ID?

randallzapata · 2024-08-18T00:06:34Z

I am able to get into grub, but I can't get HAOS to boot linux.

I installed
https://os-artifacts.home-assistant.io/13.1.dev20240816/haos_generic-x86-64-13.1.dev20240816.img.xz

Also, I tried the grub patch, and it looked the same as what I have.

I am running on an AtomMan X7 Ti with a Intel® Core™ Ultra 9 processor 185H.

smbios --type 4 --get-qword 8
13829424153407129252

When I am in debug mode, this is what I get.

loader/efi/linux.c:218:linux: * linux command line:
BOOT_IMAGE=(hd0,gpt2)/bzImage root=PARTUUID=8d3d53a9-6d49-4c38-8349-aff6859e82fd rootwait zram.enabled=1
zram.num_devices=3 systemd.machine_id= fsck.repair=yes
systemd.condition=first-boot=true systemd.firstboot=tty0 rauc.slot=A debug'
loader/efi/linux.c:238:linux: starting image 0x5e9fad18

It just does nothing after this.

sairon · 2024-08-20T09:10:30Z

@randallzapata It's a modern system, so I don't expect it to have problems with the EFI kernel loader. It looks rather like this issue, you can try disabling VT-d in the BIOS settings too. Let's follow up there if it helps, or please create a new issue for your system.

ChernyaevAN · 2024-08-22T17:31:20Z

I have updated to HAOS 13.1. Everything works fine. Thank you.

VerbruggenBart · 2024-08-23T13:54:30Z

Just wanted to let you know I still had this problem with the latest update and a Lenovo Thinkpad [11e (Type 20D9, 20DA)]

I used the download above (grub-2.06-haos-12.1.zip together with a debian live usb stick to copy both files to the BOOT directory, which seems to have fixed it again (temporarily)...

pitzer · 2024-09-11T22:53:02Z

I also ran into this issue on my 2011 Mac Mini running Generic x86-64 when updating HAOS a week ago. It runs a 2.3GHz dual-core Intel Core i5 CPU. Reverting grub via bootable USB solved the issue. Thank you for the pointers in this thread!

agners · 2024-09-12T07:58:27Z

@VerbruggenBart hm, looking at this datasheet, that seems a Celeron CPU from the same era. Can you run the commands @sairon pointed out in #3305 (comment)?

sairon · 2024-09-12T10:38:57Z

@pitzer Could you please also send me the CPU ID reported on the Mac Mini, using the smbios command from the above post? It is probably the same platform as @ahmetem reported earlier it's having issues but no one shared the required information so far.

ahmetem · 2024-09-17T13:37:17Z

@sairon i try smbios --type 4 --get-qword 8 but give error.
error : cant find command 'smbios' maybe situation is different for Mac.

agners · 2024-09-18T10:10:32Z

@ahmetem did you run the command from the GRUB2 command line? Note you need to install the HAOS 13.0 version to get the smbios command.

ahmetem · 2024-09-18T10:15:15Z

yes i run GRUB2 command line but my HAOS 12.4 version. i will update and try again.

ahmetem · 2024-09-19T10:39:57Z

@sairon smbios --type 4 --get-qword 8
13829424153406604967

Fix loading issues on this Intel-based platform as well. As described in the patch commit message, there will be likely bigger collateral effect by referring just to the CPU ID but it shouldn't have major detrimental effects. [1] #3305 (comment)

KnzHz · 2024-09-27T12:29:03Z

I had this issue updating to 13.1 last week on a Dell Wyse 5070. Using the rescue files mentioned here fixed it. Need any data from me Og can I safely try to upgrade again?

I tried to go from 12.4 to 13.1.

okh-mzny · 2024-09-28T22:50:08Z

I too have a broken UEFI platform that doesnt load the kernel.
HP T640 Thin Client with Ryzen Embedded R1505G CPU.

grub> smbios --type 4 --get-qword 8
1696726757278814081

MYF540 · 2024-11-20T18:37:28Z

Same here, Lenovo ThinkCentre M715q with a Ryzen 5 2400GE

grub> smbios --type 4 --get-qword 8
1696726757278813968

HAPSagan added the bug label Apr 12, 2024

agners added the board/generic-x86-64 Generic x86-64 Boards (like Intel NUC) label Apr 12, 2024

This comment was marked as off-topic.

Sign in to view

sairon mentioned this issue Aug 14, 2024

Fix CPU ID for D2xxx/N2xxx in GRUB2 loader patch #3526

Merged

a4mkd9 mentioned this issue Aug 22, 2024

Reboot Fails after OS Update boot screen stuck at Slot A (OK=1 Try=3) and flickers. #3153

Open

sairon mentioned this issue Aug 23, 2024

HP t520 fails to load kernel on 13.1 #3557

Closed

sairon mentioned this issue Sep 25, 2024

Use GRUB2 legacy loader for Macbook Air A1370 #3593

Merged

MYF540 mentioned this issue Nov 22, 2024

Use GRUB2 legacy loader for 2 older Chips #3692

Open

GRUB failing to load kernel on Intel Atom boards (Intel NM10 chipset) #3305

GRUB failing to load kernel on Intel Atom boards (Intel NM10 chipset) #3305

Comments

HAPSagan commented Apr 12, 2024

Describe the issue you are experiencing

What operating system image do you use?

What version of Home Assistant Operating System is installed?

Did you upgrade the Operating System.

Steps to reproduce the issue

Anything in the Supervisor logs that might be useful for us?

Anything in the Host logs that might be useful for us?

System information

Additional information

ahmetem commented Apr 12, 2024

Mpgod80 commented Apr 12, 2024

Onepamopa commented Apr 12, 2024

agners commented Apr 12, 2024

ahmetem commented Apr 12, 2024

agners commented Apr 12, 2024

Mpgod80 commented Apr 12, 2024 • edited Loading

ahmetem commented Apr 12, 2024 • edited Loading

This comment was marked as off-topic.

henrikcaesar commented Apr 12, 2024

ahmetem commented Apr 12, 2024

coc commented Apr 12, 2024

SellSan commented Apr 13, 2024 • edited Loading

This comment was marked as off-topic.

Mpgod80 commented Apr 13, 2024

SellSan commented Apr 13, 2024

JitteryDoodle commented Apr 13, 2024

Omri-Kleynhans commented Apr 13, 2024

This comment was marked as off-topic.

agners commented Apr 13, 2024

Omri-Kleynhans commented Apr 13, 2024 • edited Loading

SellSan commented Apr 13, 2024

pierrepaap commented Apr 13, 2024 • edited Loading

This comment was marked as off-topic.

pierrepaap commented Apr 14, 2024 • edited Loading

This comment was marked as off-topic.

pierrepaap commented Apr 14, 2024

agners commented Apr 15, 2024 • edited Loading

sairon commented Aug 14, 2024

ChernyaevAN commented Aug 14, 2024

sairon commented Aug 14, 2024

ChernyaevAN commented Aug 14, 2024

ahmetem commented Aug 14, 2024

ChernyaevAN commented Aug 14, 2024

sairon commented Aug 14, 2024

randallzapata commented Aug 18, 2024

sairon commented Aug 20, 2024

ChernyaevAN commented Aug 22, 2024

VerbruggenBart commented Aug 23, 2024

pitzer commented Sep 11, 2024

agners commented Sep 12, 2024

sairon commented Sep 12, 2024

ahmetem commented Sep 17, 2024

agners commented Sep 18, 2024

ahmetem commented Sep 18, 2024

ahmetem commented Sep 19, 2024 • edited Loading

KnzHz commented Sep 27, 2024 • edited Loading

okh-mzny commented Sep 28, 2024

MYF540 commented Nov 20, 2024 • edited Loading

Mpgod80 commented Apr 12, 2024 •

edited

Loading

ahmetem commented Apr 12, 2024 •

edited

Loading

SellSan commented Apr 13, 2024 •

edited

Loading

Omri-Kleynhans commented Apr 13, 2024 •

edited

Loading

pierrepaap commented Apr 13, 2024 •

edited

Loading

pierrepaap commented Apr 14, 2024 •

edited

Loading

agners commented Apr 15, 2024 •

edited

Loading

ahmetem commented Sep 19, 2024 •

edited

Loading

KnzHz commented Sep 27, 2024 •

edited

Loading

MYF540 commented Nov 20, 2024 •

edited

Loading