r/LocalLLaMA· /u/Comfortable-Rock-498·· 3 小时前AI 评分42
用 40 万合成样本微调 1.5B Qwen，bash 命令生成达到 GPT-4o 水平并开源数据集
Finetuned 1.5B Qwen to generate bash commands at gpt-4o level using 400k synthetic examples + Fully opensource finetune dataset
AI 导读
有人用约 40 万条全合成数据微调 1.5B Qwen，使其生成 bash 命令的能力达到 GPT-4o 水平，训练流程基本自动化，属个人业余项目。该项目的微调数据集已完全开源，可自由用于训练或使用。
正文
Purely a hobby side project to see how far I can push a really small model, using (mostly) automated training pipelines
Full synthetic data: https://huggingface.co/datasets/dirac-run/ec-training-data
Models: https://huggingface.co/dirac-run/ec-1.5b-gguf and https://huggingface.co/dirac-run/ec-0.6b-gguf
Cli https://github.com/dirac-run/ec
feel free to train/use the data as you wish.
submitted by /u/Comfortable-Rock-498
[link] [留言]
来源：r/LocalLLaMA · reddit.com