Notes on Fu, Xue & Huang et al., ServerlessLLM: Low-Latency Serverless Inference for Large Language Models

Large Language Models (LLMs)

vLLM serviceless

https://www.youtube.com/watch?v=beBTI7oyleg