aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Microsoft 与清华研究发现:多数 GPU 内核库故障源于编译、构建或运行环境

AI 导读

研究团队分析了 FlashAttention、Triton 等 7 个 GPU 内核库的 300 条已关闭 GitHub 问题报告,其中 60.33% 归因于编译与构建系统或运行环境,39.67% 归因于内核库本身。驱动、CUDA、框架和软件包之间的不兼容是最大单类原因,占 76 条(25.33%)。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

New Microsoft and Tsinghua paper finds that most GPU kernel library failures in LLM systems come from compilers, builds, and environment mismatches, not kernel code.

LLM training and serving depend on GPU kernel libraries like FlashAttention, Triton, and CUTLASS. When they break, jobs can crash, hang, or silently produce wrong outputs, and the cause is hard to trace.

The team read 300 closed GitHub issue reports from 7 of these libraries, including the discussions and fixes. They labeled each one by what the user saw and what caused it.

Of the 300 issues, 60.33% traced to the compiler and build system or the runtime environment, and 39.67% to the kernel library. The largest single cause was software incompatibility among drivers, CUDA, frameworks, and packages, at 76 issues or 25.33%.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错