-O3 Compiler Optimization Level Still Deemed Too Unsafe For The Linux Kernel

[F.Ultra]

Where is this train of thought going? That it was not Trump either? That it was not <insert-your-idolised-leadership-here> but all the workers, voters or soldiers doing it? ... Torvalds has got the responsibility over the Linux project and he is the one bickering about a lack of care. The end. There is no need to derail this and to turn this into a brown-nosing competition for fear of your idols being called out for the dumb shit they talk. Everybody talks shit and Torvalds is no exception.

It's not Trumps fault if some rouge soldier down the line does something evil, once it becomes known however it's his damn responsibility to make sure that the matter is investigated, that the person(s) responsible are duly punished and that measures are taken (if possible) to make sure that it won't happen again.

Likewise it's not the fault of neither Torvalds nor Greg regardless of how little you like them, that some subsystem maintainers accepted a few less than stellar patches. Once Greg discovered that it happened though he took immediate action so this is a very stupid case to bring up if you want to throw shit at Linus or Greg.

[CochainComplex]

I have just built xanmod 5.12.9 cacule against clang 12 under pop os 20.04
with fuillto
march=skylake
O3 is enabled by default on xanmod kernels

....wow thats blazing fast......downside as always with nvidia...is nvidia.

Super responsive that system.

Later I will try it on my gaming rig

[Naib]

How did you notice it?

I am asking, because I use the proprietary driver and it compiled as an out-of-tree module with LTO just fine. You should get to see the following at the end when building the kernel modules for Nvidia:

...
LTO [M] /usr/src/nvidia/nvidia-drm.lto.o
LTO [M] /usr/src/nvidia/nvidia-ib-peermem-stub.lto.o
LTO [M] /usr/src/nvidia/nvidia-modeset.lto.o
LTO [M] /usr/src/nvidia/nvidia-peermem.lto.o
LTO [M] /usr/src/nvidia/nvidia-uvm.lto.o
LTO [M] /usr/src/nvidia/nvidia.lto.o
...

As a test have I run vkcube and nvenc and these seem to work just fine as always.

What can happen is that when you build the kernel modules for the Nvidia driver and it checks the compiler version against the running kernel then it can bail with a warning. You then need to set an environment variable export IGNORE_CC_MISMATCH=1 for the installer to ignore the conflict, or build the modules after you have booted with the new kernel.

But do let me know if I have missed something.

Well I started the process of going full CLANG last night and once I had the toolchain built with itself I then moved on. Kernel built fine but when attempting to build the nvidia driver I got the tell tail signs that it was going to be a package that does not support LTO. It wasn't a warning, it was outright errors.
The fact that you are saying it can gives me hope...

Thinking about this a bit more ... it might not be the actual kernel driver that has failed but more the userland libraries and thus I have the likes of MESA and co that needs to be rebuilt

[sdack]

Only downside is if you are an Nvidia driver user. The driver cannot be built LTO and as a result the kernel cannot be built LTO

How did you notice it?

I am asking, because I use the proprietary driver (465.31) and it compiled as an out-of-tree module with LTO just fine. You should get to see the following at the end when building the kernel modules for Nvidia:

...
LTO [M] /usr/src/nvidia/nvidia-drm.lto.o
LTO [M] /usr/src/nvidia/nvidia-ib-peermem-stub.lto.o
LTO [M] /usr/src/nvidia/nvidia-modeset.lto.o
LTO [M] /usr/src/nvidia/nvidia-peermem.lto.o
LTO [M] /usr/src/nvidia/nvidia-uvm.lto.o
LTO [M] /usr/src/nvidia/nvidia.lto.o
...

As a test have I run vkcube and nvenc and these seem to work just fine as always.

What can happen is that when you build the kernel modules for the Nvidia driver and it checks the compiler version against the running kernel then it can bail with a warning. You then need to set an environment variable export IGNORE_CC_MISMATCH=1 for the installer to ignore the conflict, or build the modules after you have booted with the new kernel.

But do let me know if I have missed something.

[Naib]

Forget -O3. Build the kernel with Clang and enable LTO. Simply pass LLVM=1 and LLVM_IAS=1 as arguments to make and you should be able to switch on LTO optimisation (works so far for x86 and 64-bit Arm, with a few exceptions, see arch/Kconfig for details).

$ make LLVM=1 LLVM_IAS=1 gconfig

Compiling the kernel, normal or as a cross-compile, works in the same way:

make LLVM=1 LLVM_IAS=1 all

or

make ARCH=arm CROSS_COMPILE=arm-linux-gnueabihf- LLVM=1 LLVM_IAS=1 all

It is so simple, even Michael should be able to do it.

Only downside is if you are an Nvidia driver user. The driver cannot be built LTO and as a result the kernel cannot be built LTO

[sdack]

Who are you?

I am your next idol and future obsession. I am the conscience you wish you had. *lol*

[foobaz]

(GCC) possibly generating bad code with the "-O3" compiler optimization level

In my experience as a developer, the most common problem with -O3 is not bad compilers, but bad code. It's not too hard to accidentally write C code that depends on undefined behavior. Such code can work as expected with -O2 but fail under -O3. It can even work fine for years with -O3, until some minor change to seemingly unrelated code tips the optimizer into behaving differently and it breaks. Or updates to the compiler can change optimization behavior and break programs which previously worked but are technically invalid.

I've seen -O3 bugs with LLVM as well as with GCC. It's easy to say "well just don't write bad code then" but historically this strategy has not been shown to be effective with C programming.

[smitty3268]

Ok, I'm now getting attacked by both sides for being too defensive of Linus, and for not sucking up to him enough.

There's way too many dumb people in this thread, I'm officially out. Have fun.

[moilami]

I'm no Torvalds defender. He frequently says stupid shit and it's dumb when people try to make him out to be some god.

But your comments here are equally dumb. This had jack shit to do with Torvalds, and trying to bring him into it makes you look silly.

Ah, you sound like an angry millenial? Linus is from times when carebears used diapers and sucked their momma's titties.

[moilami]

It does not matter what he does when he talks shit about other projects, but runs his own and his projects fucks up. There is no excuse for ignorance.

Who are you?