aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分33

Parasail 宣布将规模部署 Positron Titan 服务器,首期为 5MW

AI 导读

推理云服务商 Parasail 宣布将率先规模部署 Positron 的 Titan 服务器,首期规模为 5MW。材料称,Titan 使用普通 DRAM 存放大型模型,单台服务器可容纳至多 32 万亿参数的模型;相关计算能力预计到 2027 年末上线。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

Memory capacity per watt is becoming one of the most useful ways to judge AI hardware.

Positron Titan runs multi-trillion-parameter models on commodity DRAM, and @parasail_io is the first inference cloud putting it online at scale.

Parasail, an inference cloud that already runs several chip types behind one API, just announced it will be the first to deploy Positron’s next-gen Titan servers at scale, starting with 5MW.

Titan keeps giant models in cheap smartphone-style memory instead of scarce high-bandwidth memory (HBM), so one server can hold a model of up to 32 trillion parameters.

引用Mike Henry@mikehenry8484
Positron's Titan is joining the Parasail fleet. 5MW. Trillions of tokens a day of cost-optimized compute by late 2027. @parasail_io @positron_ai @parasail_io is the first multi-silicon inference cloud that routes your prompts to the best chip for the job, serving trillions of tokens a day to hundreds of customers. Positron fills a vital part of compute spectrum on the cost optimized side: 4X better cost-per token than next gen NVIDIA/AMD systems which is perfect for large-scale agent swarms, background agents, and physical AI. Positron has done incredible work building a chip and system that orchestrates across DRAM and SRAM allowing for massively scalable memory pools with commodity memory giving the best of both worlds for memory capacity and bandwidth. We've been excited to partner with them in the early days through the launch of their Atlas chip and now big capacity plans with Titan. @positron_ai
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

行业
发现内容有误?提交纠错