aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google DeepMind 与 UPenn 研究用可读写作特征解释 AI 文本检测结果

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

这项研究从 Gemma-2-2B 检测器内部提取特征,再用语言模型为特征命名,并只保留标签能较好预测其行为的特征。所得检测器在同领域测试中取得 96.8 F1,接近黑箱检测器的 98.0;在未见过的测试数据上,采用基础模型特征的版本取得 92.2 F1,黑箱检测器为 75.2。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

New Google DeepMind + UPenn paper shows that an AI-text detector can explain its verdicts with readable writing features and still match a black-box detector.

suggests that anyone deploying AI-text detectors should be able to read and remove the specific cues a detector relies on.

The best AI-text detectors are black-box classifiers, yet they flag student essays and peer reviews. Readable stylometric detectors exist but trail them by wide margins.

They trained sparse autoencoders on a Gemma-2-2B detector's internals to split its activity into features, then had an LLM label each one. They kept only features whose labels predicted their behavior well and fed those into a simple classifier.

With only well-labeled features, the detector kept 96.8 F1 in-domain, close to the black box's 98.0. On unseen test data, a version built on base-model features scored 92.2 F1 against 75.2 for the black box.

If your detector's decisions affect people, build it on labeled features so reviewers can see and drop cues they consider unfair.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错