Infrastructure & deployment
Serving LLMs on Tenstorrent Hardware: Inside the vLLM TT Plugin
The vLLM team describes a plugin that adds Tenstorrent hardware support using vLLM extension points.
Why it matters: The plugin provides a path to serve models on a non-GPU hardware backend.