Analyzing Geekbench 6 under Intel's BOT

(geekbench.com)

19 points | by hajile 3 hours ago

6 comments

  • userbinator 2 hours ago
    This suggests the checksum is used to identify whether the binary is known to BOT, and thus whether BOT can optimize the binary.

    I do wonder what this "optimize" step actually entails; does it just replace the binary with one that Intel themselves carefully decompiled and then hand-optimised? If it's a general "decompile-analyse-optimise-recompile" (perhaps something similar to what the https://en.wikipedia.org/wiki/Transmeta_Crusoe does), why restrict it?

  • boomanaiden154 2 hours ago
    Post link optimization (PLO) tools have been around for quite a while. In particular, Meta’s BOLT (fully upstream in LLVM) and Google’s Propeller (somewhat upstream in LLVM, but fully open source) have been around for 5+ years at this point.

    It doesn’t seem like Intel’s BOT delivers more performance gains, and it is closed source.

    • tyushk 2 hours ago
      Intel BOT seems to be patches for specific binaries (hence why they didn't see a difference for Geekbench 6.7), unlike BOLT/Propeller which are for arbitrary programs. The second image from their help page [1] showcases this.

      [1] https://www.intel.com/content/www/us/en/support/articles/000...

    • trynumber9 2 hours ago
      Question: do those vectorize code as in the example here? I was of the understanding they performed a more limited subset of optimizations.
      • boomanaiden154 2 hours ago
        Propeller can’t really do many instruction level modifications due to how it works (constructs a layout file that then gets passed to the linker).

        BOLT could do this, but does not as far as I’m aware.

        Most of vectorization like this is also probably better done in a compiler middle end. At least in LLVM, the loop vectorizer and especially the SLP Vectorizer do a decent job of picking up most of the gains.

        You might be able to pick up some gains by doing it post-link at the MC level, but writing an IR level SLP Vectorizer is already quite difficult.

  • tyushk 2 hours ago
    quack3.exe again in a way. If it's been done for years on GPU shaders, then why not CPU code?
    • consp 31 minutes ago
      While highly specific optimisations might give you a tiny bit of advantage, the main boost here is vector code which would work on any processor supporting the instructions. They could have looked at the vendor bits and use those to flag for optimization in any cpu but they didn't and limited it to a small subset of programs and cpus. It tingles the "PR above all else must have highest score" sense.
  • whatever1 1 hour ago
    Can we also end user tune our cpus for specific tasks we do?
  • refulgentis 2 hours ago
    > BOT optimizations are poorly documented, aggressive in scope, and damage comparability with other CPUs. For example, BOT allows Intel processors to run vector instructions while other processors continue to run scalar instructions. This provides an unfair advantage to Intel

    Wait until they hear about branch predictors.