aifollow.news
Back vLLM 官方博客
vLLM 官方博客· · Original publication time AI score40

vLLM Adds Day-0 Support for Thinking Machines’ Inkling 2 SmallMachine translation

vLLM 首日支持 Thinking Machines 的 Inkling 2 Small

AI-assisted summary

vLLM supports Thinking Machines’ Inkling 2 Small from day 0, including attention residuals, a new decode kernel for relative-bias attention, all-reduce fused with surrounding operations, and DSpark speculative decoding. The update is mainly relevant to model deployment developers.

This source permits summary display only.

Read at the original source
Found an error? Send a correction