aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score40

University of Toronto and Google paper proposes common rules for evaluating GEOMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

Website owners edit pages to get AI assistants to cite or recommend them, a practice known as generative engine optimization (GEO). The paper argues that existing benchmarks allow different kinds of edits, making scores hard to compare. Its authors propose labeling the edits allowed in each test and reporting visibility, answer quality, and rule-following together. The paper runs no experiments; its evidence is a mapping of 11 published GEO methods.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

– https://t.co/PF6UQF6NkA

Title: "Humanity's Last Choice: A Common Evaluation Standard for Generative Engine Optimization"

ReplyRohan Paul@rohanpaul_ai
New University of Toronto and Google paper argues that picking an AI assistant may be the last big decision people make, since that assistant then makes the decisions that follow. Argues that tests of how websites game AI answers need shared editing rules, or scores can't be compared. Content owners now edit web pages so AI assistants cite or recommend them, a practice called generative engine optimization, or GEO. Current GEO benchmarks allow different edits, so a method that rewrites whole pages can look better than one that only appends a line. They propose labeling every GEO edit by where the page changes, how it changes, and which cue it targets, such as authority. Tests would fix the allowed edits and report visibility, answer quality, and rule-following together. The paper runs no experiments. Its evidence is a mapping of 11 published GEO methods, showing that each covers a different slice of the possible edits. When comparing GEO methods or AI systems, check which edits each score allowed and whether answer quality was measured.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction