aifollow.news
返回 TechCrunch AI 报道
TechCrunch AI 报道· · 原发布时间 AI 评分40

Google 发布两款新 TPU,分别面向机密计算和大容量推理

AI 辅助摘要

Google 推出第八代 TPU 的两个新型号:与 AMD 共同设计的 TPU 8tx 面向敏感数据和模型权重的隔离保护;TPU 8i Max 将两颗 TPU 8i 的能力整合在单个封装中,使内存容量、处理能力和带宽翻倍。两款芯片分别瞄准机密模型训练与运行,以及需要处理更多查询信息的 AI 模型。

正文 · 原文

Google is notching up its chipmaking game as the company seeks to reduce its dependence on chips made by other companies for its cloud computing business. Google on Monday unveiled two new variants of its tensor processing units (TPUs), in-house developed chips meant for AI workloads, that broaden its chip portfolio to additional use cases: confidential inference and more memory capacity for large workloads.

The new units, TPU 8tx and TPU 8i Max, are part of the company’s eighth generation of chips introduced in April this year, and build on what those chips offered, which was more inference capacity and support for large training requirements.

TPU 8tx, designed with AMD, is based on the TPU 8t chip, and is geared specifically for confidentially training and running AI models, Google said in a blog post. The chip “builds security directly into the hardware layer, keeping sensitive data and model weights protected and isolated even while in active use,” the company wrote.

The chip also has a custom inferencing network that lets it run reasoning alongside training, so it can be used to distill and train small models on the fly. That ability, according to Google, could prove useful for cases where a company might want to train a model on its proprietary data without having to move the data between devices.

Meanwhile, TPU 8i Max basically combines two of the inference-focused TPU 8i chips the company launched in April, doubling the memory capacity, processing power and bandwidth, but in a single package. The result is a chip that lets AI models handle a larger range of information during queries.

The chip launch comes as hyperscalers like Microsoft , Amazon , and even AI labs like OpenAI and Anthropic are working on their own lines of AI-specific semiconductors and accompanying software in order to reduce their reliance on the dominance of Nvidia.

The news also comes at a particularly vulnerable moment for Nvidia, whose CEO Jensen Huang over the weekend admitted to having an affair with someone alleged to be a Chinese spy.

发现内容有误?提交纠错