Google DeepMind 等机构提出一种新的 AI 检测器 IdeaLens，判断的是 AI 生成的想法而非文字或图像。在 AI 依据人的完整提纲写作时，IdeaLens 只标记 7% 为 AI，Pangram 4 标记 92%；在 50 篇人依据 AI 提纲写成的故事中，IdeaLens 标记 68%，Pangram 4 标记 8%。
Great paper from Google DeepMind and other top labs.
Proposes a new kind of AI detector, for AI-generated ideas rather than text/image.
When AI wrote from a person's full outline, IdeaLens flagged 7% as AI and Pangram 4 flagged 92%. On 50 stories people wrote from AI-made outlines, IdeaLens flagged 68% and Pangram 4 flagged 8%.
They find that reading a document's outline instead of its words lets a detector tell whether the ideas came from a person or AI.
A detector that reads only a document's outline can tell whether a person or an AI came up with the ideas, so rules about original thinking can't rely on detectors that only judge wording.
Tools like Pangram judge who wrote the words, so they often flag AI-polished human work and miss AI ideas that people write up themselves.
IdeaLens judges a short list of the points a document makes, and was trained on paraphrased lists so wording couldn't help it.
来源：Rohan Paul · x.com