开源仓库收录 20 项 Next-Concept Modeling 与 Transformer 可解释性探索研究
Exploring Next-Concept Modeling (NCM) & Transformer Interpretability: Repository of 20 Exploratory Studies & Controls [P]
一个独立开源仓库收录了 20 项探索性研究，聚焦 Next-Concept Modeling（NCM）、GPT-2 中的机制可解释性（如 IOI）以及模型控制实验。
Hi everyone,
I wanted to share an open-source repo collecting 20 exploratory studies focused on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls.
Link: https://github.com/Quantix-eng/ncm-experiment-notes
This is an independent project documenting empirical experiments on how transformers process and edit internal features. No performance breakthroughs here—just honest documentation of observations alongside rigorous controls.
The repo covers NCM on structured tasks (like Sudoku), mechanistic interpretability in GPT-2, and toy parallel models. I've included all source code, saved results, and interpretations for every run.
For full transparency, I’ve categorized every outcome, including the mixed and completely negative results. AI tools were also heavily used during the planning and coding phases.
Would love to get your feedback on the setups or interpretation limits.
submitted by /u/BedFalse6021
[link] [留言]
来源：r/MachineLearning · reddit.com