跳到正文
r/LocalLLaMA· /u/Express_Quail_1493·· 3 小时前AI 评分17

Qwen3.8-27b 用户实测:q3_k_xl 超低量化完成 OpenWebUI 配置与调试

Qwen3.8-27b appreciation moment

AI 导读

用户实测 Qwen3.8-27b 的 q3_k_xl 量化版本,称其完成了 OpenWebUI 配置、Trillium 服务启动、bug 修复、pi-web-ui 搭建和 Cloudflare tunnel 调试等任务,甚至能调用更小的 LLM 来验证自己创建的工具。

正文

q3.8-27b q3_k_xl this thing have done everything i possibly needed from him he wired up my openwebui spawned trillium service fix all my bugs set up pi-web-ui and debug my cloudflare tunnel it even spawned smaller LLMs to make the LLM use the toole he created to ensure it will work. I haven’t had a real-world task that i needed from it that failed yet. Im pretty sure if im building large-scale production code with tons of lines of code it will struggle but as a utility to make all my scripts and diagnostics on my micro-services this thing is unstoppable. Weirdly im not even using q4 im using q3_k_xl appreciation to unsloth also for making such reliable ultra low quantisation. His UD3.0 style of quantisation is PURE magic 🪄 sometimes i go down to q2_k_xl if i need extra context window and that thing STILL delivers 🎉🎉 alibaba had handed down Prometheus fire to common men like you and i. Can’t wait for qwen4-27b

submitted by /u/Express_Quail_1493
[link] [留言]

来源:r/LocalLLaMA · reddit.com