Chubby♨️· @kimmonismus · X·· 1 小时前AI 评分65
AI 导读
DeepSeek 将其内部推理框架 DeepInfer 完全开源，该框架支撑 DeepSeek-V4.1-Flash 的大规模高吞吐低延迟服务，代码已发布在 github.com/deepseek-ai/DeepInfer。转发者指出，仅靠模型权重并不能降低 AI 运行成本，共享生产级推理栈有助于开源模型规模化提效，并提到该框架除 Nvidia 外也可运行在华为芯片上。
正文
Let’s go: DeepSeek just open-sourced DeepInfer, the inference engine behind its production services.
Sharing this makes open models efficient at scale is a big deal: model weights alone don’t make AI cheap to run. But *this* helps.
Also notable: it runs on Huawei chips, not just Nvidia.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4在 X 查看被引用的帖子
来源：Chubby♨️ · x.com