vLLM Adds Day-0 Support for Thinking Machines’ Inkling 2 SmallMachine translation
vLLM 首日支持 Thinking Machines 的 Inkling 2 Small
vLLM supports Thinking Machines’ Inkling 2 Small from day 0, including attention residuals, a new decode kernel for relative-bias attention, all-reduce fused with surrounding operations, and DSpark speculative decoding. The update is mainly relevant to model deployment developers.
This source permits summary display only.
Read at the original source