aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分40

多伦多大学与 Google 论文提出统一网页影响 AI 回答的评测规则

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

网页所有者会修改内容,争取被 AI 助手引用或推荐。多伦多大学与 Google 的论文指出,现有评测允许的修改方式不同,分数难以直接比较;研究建议统一修改规则,同时报告曝光度、回答质量和规则遵守情况。论文未做实验,依据是对 11 种已发表方法的梳理。

原帖引用 · 原文

@rohanpaul_ai

New University of Toronto and Google paper argues that picking an AI assistant may be the last big decision people make, since that assistant then makes the decisions that follow.

Argues that tests of how websites game AI answers need shared editing rules, or scores can't be compared.

Content owners now edit web pages so AI assistants cite or recommend them, a practice called generative engine optimization, or GEO. Current GEO benchmarks allow different edits, so a method that rewrites whole pages can look better than one that only appends a line.

They propose labeling every GEO edit by where the page changes, how it changes, and which cue it targets, such as authority. Tests would fix the allowed edits and report visibility, answer quality, and rule-following together.

The paper runs no experiments. Its evidence is a mapping of 11 published GEO methods, showing that each covers a different slice of the possible edits.

When comparing GEO methods or AI systems, check which edits each score allowed and whether answer quality was measured.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错