this post was submitted on 16 Aug 2023
16 points (100.0% liked)

Linux

48190 readers
1270 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
 

This is a reference for the situation:

https://www.tomshardware.com/news/intel-nukes-alder-lake-avx-512-now-fuses-it-off-in-silicon

Basically some Alder's had the instruction available. I would like to check if my comp has the possibility. It is not in the bootloader. Maybe there is a way in KeyTool or another way? I don't know if I would need to set affinity or if the CFS has a way to detect software running with the instruction and keep it running on P cores.

I'm mainly looking to try to enable this for the largest LLMs I am running. llama.cpp is looking for this instruction and subset already.

top 6 comments
sorted by: hot top controversial new old
[–] [email protected] 4 points 1 year ago (1 children)

This makes me really dislike Intel. Why even use a fuse? Just rip it out of the silicon. Has the fuse thing been confirmed? Sounds like bs to me

[–] [email protected] 1 points 1 year ago (1 children)

Speculatively, I think it has more to do with CPU schedulers in kernels. Junk like windows is super inflexible when it comes to the kernel. Like Windows 11 had to be made just because of the Intel asymmetric cores. Changing the scheduler in W10 just wasn't viable. Likely having Alder different makes issues because Microsoft is so inflexible with their tiny OS.

I don't know how Linux is handling the scheduler for intel exactly. I've watched most of the Linux Plumbers conference about the changes to the scheduler from 2021, but I don't recall details about this.

People saying all it takes is disabling the efficiency cores hints that it is a scheduler issue though. I remember someone mentioning that the way cores get spun up and the time it takes to get to full speed is complicated and that management overhead was required, so I'm not sure if the scheduler is the only factor, but I think it is likely the primary.

I'm hoping someone comes along that can identify the mechanism that detects the available instructions and how this can be tested or altered in practice.

[–] [email protected] 2 points 1 year ago (1 children)

What does the avx512 instruction set have to do with scheduling?

[–] [email protected] 1 points 1 year ago

It isn't a direct line to connect, sorry if I am bad at explaining it. The P and E cores mix are the issue. The P cores are Xeon designs that (may) have the extra instructions. The E cores do not. If simply turning off the E cores has made the P cores show up with AVX512 on some systems, I imagine it may have to do with the scheduler. I could be wrong.

The CPU scheduler will require some kind of management function that could bind the process to a core with the extra AVX instructions without manual intervention. This would need to override availability, kernel threads, and things like power efficiency or spin up optimisation. I haven't taken a super deep dive into how the scheduler is working on a 12th gen. I can say it appears to pin processes more, but I still see a regular rotation of most running processes across cores when they have no affinity or isolation settings, like when I am running a large LLM.

[–] [email protected] 2 points 1 year ago (1 children)

Back when it worked, you just needed to disable the e cores in the bios.

[–] [email protected] 1 points 1 year ago

I wonder if the kernel parameters for CPU isolation were set, if it would enable this.