Hacker Next
VLLM: Easy, Fast, and Cheap LLM Serving with PagedAttentionblog.vllm.ai
20 points by jxmorris12 3 days ago | 5 comments