aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

卡内基梅隆大学论文报告:Opus 5.5 在 AI 系统构建基准中超过人工基线

AI 导读

Singularity-Bench 让智能体完成预训练流程、推理引擎等六项端到端任务,并在相同 GPU 上与生产系统比较。材料称,Opus 5.5 的综合指数为 1.25,人工基线为 1;其构建的服务引擎每 GPU 小时收入为 11.52 美元,SGLang 为 8.18 美元。

原帖引用 · 原文

@rohanpaul_ai

New Carnegie Mellon paper finds that Opus 5.5 + Claude Code built a pre-training pipeline, an inference engine, and a cluster orchestrator that matched or beat production tools like SGLang and NVIDIA Dynamo on the same GPUs.

Singularity-Bench gives agents 6 end-to-end jobs, from pre-training a model to building a serving engine. Each result is scored against a production system, such as SGLang or Claude Code, on the same GPUs.

Opus 5.5 scored a Singularity-Index of 1.25, where 1 equals the human baselines, while the other 10 agents averaged 0.58. Its serving engine earned 11.52 USD per GPU-hour against 8.18 for SGLang.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错