Enable Simultaneous DNN Services Based on Deterministic Operator Overlap and Precise Latency Prediction
Conference
Weihao Cui, Han Zhao, Quan Chen, Ningxin Zheng, Jingwen Leng, Jieru Zhao, Zhuo Song, Tao Ma, Yong Yang, Chao Li, Minyi Guo.
14 November 2021
SC