PAME: Precision-Aware Multi-Exit DNN Serving for Reducing Latencies of Batched Inferences

Conference

Authors

Shulai Zhang, Weihao Cui, Quan Chen, Zhengnian Zhang, Yue Guan, Jingwen Leng, Chao Li, Minyi Guo.