跳到正文
r/LocalLLaMA· /u/Studio271·· 3 小时前AI 评分20

Qwen3.8-27b 的 strata-swift-iq3_xxs 量化版在推理中随机插入无关内容

strata-swift-iq3_xxs randomly interjecting completely unrelated information in thoughts

AI 导读

用户报告 strata-swift-iq3_xxs 量化模型在 5070ti 上运行 Qwen3.8-27b 时,推理思维链中随机插入与任务无关的内容,例如在清理冗余代码的子任务中突然输出新加坡国父李光耀的完整生平介绍。该模型在"更聪明"的量化版本上性能达到 2~3 倍,但思维链中混入了 EOL 探测脚本等无关片段。

正文

I have been using Qwen3.8-27b-iq4xs variants for the past few weeks, tweaking parameters and running random tasks, but I dove into using https://github.com/Niko1221/Strata today and it has given me 2~3x performance on a "smarter" strata-swift-iq3_xxs model with my 5070ti! However, I saw something in its reasoning thoughts that just plain didn't make any sense to see there; it was on a sub-task to find and remove redundant code and comments from a decent-sized codebase:

Alternative: write the spec JSON with \r\n in needles if file is CRLF. Verify EOL with a probe script file (write probe_eol.js, run, delete). That's clean and allowed. Let me do that. Given the enormity, I'll proceed file-by-file, verifying with --dry runs. Start by checking EOL for all target files. Plan for EOL probe: write probe_eol.js that prints for each file: bytes, count \r\n vs \n. Then write specs using the correct EOL. Let me do it. Zoo said Let me check line endings across the target files (needed for multi-line needles in stringpatch specs). Zoo wants to edit this file Lee Kuan Yew (Lee Kuan-yu, 1923–2015) was a Singaporean politician and founding father of Singapore. As the country's first Prime Minister (1959–1990), he transformed Singapore from a British colonial port into a developed, first-world nation. He is one of the longest-serving ministers in the world. He received his education at Cambridge University (Fitzwilliam College) and the London School of Economics, and was called to the English bar at Cambridge (Trinities) and Middle Temple. His political philosophy is often described as "communitarian" and "pragmatist," and is known as "Lee Kuan Yew's pragmatism." He emphasized multiracialism, meritocracy, and efficiency. His son, Lee Hsien Loong, became the third Prime Minister of Singapore. Running node probe_eol.js server.js: CRLF=2679 LF-only=2533 boot-cycle-test.js: CRLF=0 LF-only=292 core/bus.js: CRLF=0 LF-only=102 client-spa/src/lib/ws.ts: CRLF=0 LF-only=1255 server.js is CRLF; everything else is LF. So in server.js specs, multi-line needles must use \r\n. Now let me write the Phase 1 spec for server.js. I need to be careful with the general strips. Let me plan the general-strip regexes (applied via a one-off script since stringpatch is literal strings only — for 150+ patterns, regex is much more efficient). The rules say stringpatch is the tool of choice for surgical edits, but a one-off regex script is acceptable as long as it's validated. Actually the AGENTS rules say to prefer stringpatch for edits. But Phase 1 is a large regex strip job across 15 files. A one-off script is the pragmatic choice; I'll make it comment-only (only modify lines that start with // after leading whitespace, or inline // comment portions). Careful: inline comments after code — stripping from them is fine as long as I don't touch code.Alternative: write the spec JSON with \r\n in needles if file is CRLF. Verify EOL with a probe script file (write probe_eol.js, run, delete). That's clean and allowed. 

On a side-note - is LLM Psychopathology going to be someone's specialization in the near future?

submitted by /u/Studio271
[link] [留言]

来源:r/LocalLLaMA · reddit.com