即将离开知乎

您即将离开知乎，请注意您的帐号和财产安全。

https://www.anyscale.com/blog/continuous-batching-llm-inference#benchmarking-results:-throughput