The CAP Principle for LLM Serving

Authors

Pai Zeng, Zhenyu Ning, Jieru Zhao, Weihao Cui, Mengwei Xu, Liwei Guo, Xusheng Chen, Yizhou Shan.

Published

18 May 2024

Publication details

Working paper

Links