aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score33

Parasail announces plans to deploy Positron Titan servers at scale, starting with 5MWMachine translation

AI introduction

Inference cloud Parasail announced plans to be the first to deploy Positron’s Titan servers at scale, starting with 5MW. The material says Titan uses commodity DRAM to hold large models and that one server can hold a model of up to 32 trillion parameters. The associated compute capacity is projected for late 2027.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

Memory capacity per watt is becoming one of the most useful ways to judge AI hardware.

Positron Titan runs multi-trillion-parameter models on commodity DRAM, and @parasail_io is the first inference cloud putting it online at scale.

Parasail, an inference cloud that already runs several chip types behind one API, just announced it will be the first to deploy Positron’s next-gen Titan servers at scale, starting with 5MW.

Titan keeps giant models in cheap smartphone-style memory instead of scarce high-bandwidth memory (HBM), so one server can hold a model of up to 32 trillion parameters.

QuoteMike Henry@mikehenry8484
Positron's Titan is joining the Parasail fleet. 5MW. Trillions of tokens a day of cost-optimized compute by late 2027. @parasail_io @positron_ai @parasail_io is the first multi-silicon inference cloud that routes your prompts to the best chip for the job, serving trillions of tokens a day to hundreds of customers. Positron fills a vital part of compute spectrum on the cost optimized side: 4X better cost-per token than next gen NVIDIA/AMD systems which is perfect for large-scale agent swarms, background agents, and physical AI. Positron has done incredible work building a chip and system that orchestrates across DRAM and SRAM allowing for massively scalable memory pools with commodity memory giving the best of both worlds for memory capacity and bandwidth. We've been excited to partner with them in the early days through the launch of their Atlas chip and now big capacity plans with Titan. @positron_ai
View this post on X ↗

Source: Rohan Paul · x.com

Industry
Found an error? Send a correction