aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

RAG 检索污染测试:重复用户问题即可干扰文档排序

AI 导读

一则关于 RAG 检索污染研究的介绍称,研究者在 623 个查询中,为每个查询加入最多 5 份重复问题文字的文档,测试关键词、语义及 BGE-small 检索器。仅 5 份文档、约占语料库 0.1%,就使传统检索器的排序质量下降 40.2% 至 61.5%;拦截重复问题文档的过滤器虽能阻挡攻击文档,却也降低了 NFCorpus 上正常查询的排序质量。

原帖引用 · 原文

@rohanpaul_ai

– https://t.co/B1EwwzDgLe

Title: "Reliability Stress Testing of RAG Retrieval under Query-Relevant Corpus Poisoning"

回复Rohan Paul@rohanpaul_ai
New Google paper on RAG poisoning. Shows that poisoning a RAG system mostly depends on copying the query, since adding an attack payload barely changed which documents got retrieved. fake documents only need to repeat a user’s question to be picked up by AI systems that search before answering, and adding hidden attack instructions barely changed that. RAG systems pull documents from sources that outsiders can sometimes write to. Before any hidden instruction can act, the poisoned page first has to get past the retriever. For each test query, they added up to 5 documents repeating its text, with or without an attack payload. They tested classic keyword and semantic retrievers plus the dense embedding model BGE-small on 623 queries. Just 5 documents, about 0.1% of the corpus, cut classic retrievers' ranking quality by 40.2% to 61.5%. A filter that rejects query-echoing documents blocked them but halved clean ranking quality on NFCorpus, from 0.267 to 0.134. If your RAG index accepts outside content, flag documents that mirror user queries, and measure any filter's cost on clean queries too.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错