aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分20

Sam Altman 质疑用 token 数衡量企业获得的价值

AI 导读

Sam Altman 称,token 可以计数,但数量无法告诉企业花钱后得到了什么。材料还提出一种信息论上的辩护:模型输出仍混有冗余信息;若去除这些浪费,token 数量会接近传递实际信息所需的最低值。

原帖引用 · 原文

@rohanpaul_ai

Sam Altman calls tokens “a kind of fake unit”: you can count them, but a token count does not tell a business what it got for the money.

The one defense of tokens is information-theoretic: models still stream noise along with signal, and once that waste is removed, token counts approach Shannon’s floor, the minimum needed to carry the actual information.

---- Full video on "Cheeky Pint" YouTube channel, (link in comment)

来源:Rohan Paul · x.com

观点
发现内容有误?提交纠错