跳到正文
AI at Meta· @AIatMeta · X·· 2 小时前AI 评分50
AI 导读

Meta 发布 Muse Spark Open,为提升先进模型的可及性,该模型针对两台 Apple M5 Ultra Mac Studio 与最新 MLX 框架做了优化。它同时可在 SGLang、vLLM、TensorRT-LLM、Hugging Face Transformers、llama.cpp 和 Unsloth 等主流推理引擎上运行,并针对 AMD、Apple、Intel 和 NVIDIA 芯片做了优化。开发者还可用 PyTorch 进一步定制模型,包括用 TorchTitan 进行微调。

正文

To help make advanced models more accessible, Muse Spark Open is optimized to run on two Apple M5 Ultra Mac Studios with the latest MLX framework.

It also runs on leading inference engines like SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, llama.cpp, and Unsloth with optimizations for AMD, Apple, Intel, and NVIDIA silicon.

Developers can further customize the model with PyTorch, including TorchTitan for fine-tuning.

来源:AI at Meta · x.com