aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score40

University of Toronto and Google paper proposes common rules for evaluating web edits that influence AI answersMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

Website owners edit pages to increase their chances of being cited or recommended by AI assistants. A University of Toronto and Google paper argues that current benchmarks allow different kinds of edits, making scores hard to compare. It proposes fixed editing rules and joint reporting of visibility, answer quality and rule compliance. The paper runs no experiments; its evidence maps 11 published methods.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

New University of Toronto and Google paper argues that picking an AI assistant may be the last big decision people make, since that assistant then makes the decisions that follow.

Argues that tests of how websites game AI answers need shared editing rules, or scores can't be compared.

Content owners now edit web pages so AI assistants cite or recommend them, a practice called generative engine optimization, or GEO. Current GEO benchmarks allow different edits, so a method that rewrites whole pages can look better than one that only appends a line.

They propose labeling every GEO edit by where the page changes, how it changes, and which cue it targets, such as authority. Tests would fix the allowed edits and report visibility, answer quality, and rule-following together.

The paper runs no experiments. Its evidence is a mapping of 11 published GEO methods, showing that each covers a different slice of the possible edits.

When comparing GEO methods or AI systems, check which edits each score allowed and whether answer quality was measured.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction