Maxwell：通过重写二进制文件加速 Whisper、LTX-2 等 AI 模型的新模型

Maxwell: a new model that speeds up AI models like Whisper and LTX-2 by rewriting their binaries [D]

AI 导读

名为 Maxwell 的新模型可在程序运行时修改其二进制文件，根据硬件与数据情况即时加速 Whisper、LTX-2 等 AI 模型，且不改动源代码。其思路类似 JIT，但由模型而非固定编译器启发式决定改动，并借助形式化验证证明优化后版本行为一致。

正文

Came across this today and haven't seen it discussed here yet. It's apparently a new type of model (called Maxwell) that sits under a running program and speeds it up on the fly based on what it sees (hardware and data). The cool thing is that it doesn't change the source code, but instead it modifies the binaries (during runtime!). So kind of like a JIT, except it's a model working out what to change instead of a fixed set of compiler heuristics.

What got me is that they seem to be using formal verification to prove the optimized version still does the same thing, which I guess is the only way you could let something like this loose with no one checking it. No idea how that holds up with floating point or anything nondeterministic, to be honest

submitted by /u/EvilHackFar
[link] [留言]