aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

CALLIOPE 用关键词生成隐私保护的 AI 使用主题图

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

一则对 Google DeepMind 论文的介绍称,CALLIOPE 让语言模型为文档标注关键词,经加噪保留常见词后生成主题,用于分析用户向聊天机器人提出的问题。在测试中最严格的隐私设置下,人工评审在全部三个数据集上更偏好 CALLIOPE,而其 token 用量是对比方法的 2 至 5 倍。

原帖引用 · 原文

@rohanpaul_ai

– https://t.co/cpGSwQRB7m

Title: "CALLIOPE: Private Insights into AI Use, Without Embeddings"

回复Rohan Paul@rohanpaul_ai
New Google DeepMind paper finds that having an LLM build topic trees from keywords, not embeddings, gives clearer topic maps under strict privacy. Teams want to know what users ask chatbots without exposing anyone. The usual private approach clusters embeddings with added noise, and under strict privacy it returns too few clusters with weak names. CALLIOPE has an LLM tag each document with a few keywords and adds noise so only common keywords survive. The LLM then proposes topics from them and sorts documents into those topics. At the strictest privacy setting tested, human raters preferred CALLIOPE over the embedding-based URANIA on all 3 datasets, by up to 76% versus 18%. The method uses 2 to 5 times more tokens. For privacy-safe usage reports, start with LLM-built topics and budget for that cost.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错