aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

伊利诺伊大学研究提出按论点判断 AI 生成研究构想的新颖性

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

研究发现,一种已部署的新颖性检查虽识别出全部 380 个伪装的复制构想,却也否决了 96% 后来由研究人员发表的构想。研究团队提出 ClaimNov,将提案拆成若干论点,逐一比对既有论文;在材料所述测试中,它识别出 97% 的复制构想,而对后来发表构想的否决比例为 1.5%。

原帖引用 · 原文

@rohanpaul_ai

New University of Illinois paper finds that when AI decides if a research idea is new enough to work on, it often says no to ideas that human scientists later publish.

AI scientist pipelines run a novelty check to decide which generated ideas get compute. These checks judge a whole proposal at once, though most real papers build on some earlier contributions.

They built ClaimNov, which splits a proposal into a few claims, matches each against claims from prior papers, and gives a judge the claim-by-claim evidence.

A deployed check caught all 380 disguised copies but also rejected 96% of ideas researchers later published. ClaimNov caught 97% of copies while rejecting only 1.5% of those ideas.

If your pipeline filters ideas for novelty, score claims separately and keep proposals that build on 1 known result instead of discarding them.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错