Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs

Recommended citation: Yixuan Mei and Zikun Li and Zixuan Chen and Shiqi Pan and Mengdi Wu and Xupeng Miao and Zhihao Jia and K. V. Rashmi