Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs

Recommended citation: Yixuan Mei, Zikun Li, Zixuan Chen, Shiqi Pan, Mengdi Wu, Xupeng Miao, Zhihao Jia, K. V. Rashmi
Download Paper