vLLM: Anatomy of a High-Throughput LLM Inference System

hackernews · оригинал

Заголовок: vLLM: Anatomy of a High-Throughput LLM Inference System