Publications

Yuhan Liu, Hanchen Li, Yihua Cheng, Siddhant Ray, Yuyang Huang, Qizheng Zhang, Kuntai Du, Jiayi Yao, Shan Lu, Ganesh Ananthanarayanan, Michael Maire, Henry Hoffmann, Ari Holtzman, Junchen Jiang (2024). CacheGen: KV Cache Compression and Streaming for Fast Language Model Serving. In SIGCOMM'24.

Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang (2024). Eloquent: A More Robust Transmission Scheme for LLM Token Streaming. NAIC ‘24.

Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang (2024). CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion. Arxiv preprint.

Yihua Cheng, Ziyi Zhang, Hanchen Li, Anton Arapin, Yue Zhang, Qizheng Zhang, Yuhan Liu, Kuntai Du, Xu Zhang, Francis Y. Yan, Amrita Mazumdar, Nick Feamster, Junchen Jiang (2024). GRACE: Loss-Resilient Real-Time Video through Neural Codecs. In NSDI'24.

PDF Cite Code Slides

Yuhan Liu, Chengcheng Wan, Kuntai Du, Anton Arapin, Henry Hoffmann, Qizheng Zhang, Junchen Jiang, Shan Lu, Michael Maire (2024). Automatic and Efficient Customization of Neural Networks for ML Applications. In OSDI'24.

Kuntai Du, Yihua Cheng, Peder Olsen, Shadi Noghabi, Ranveer Chandra, Junchen Jiang (2024). Earth+: on-board satellite imagery compression leveraging historical earth observations. Arxiv preprint.

Xu Zhang, Hanchen Li, Paul Schmitt, Marshini Chetty, Nick Feamster, Junchen Jiang (2023). VidPlat: A Tool for Fast Crowdsourcing of Quality-of-Experience Measurements. Arxiv preprint.

Chengcheng Wan, Yuhan Liu, Kuntai Du, Henry Hoffmann, Junchen Jiang, Michael Maire, Shan Lu (2023). Run-Time Prevention of Software Integration Failures of Machine Learning APIs. In OOPSLA'23.

Yihua Cheng, Hui Zhang, Junchen Jiang (2023). Online Profiling and Adaptation of Quality Sensitivity for Internet Video. In SoCC'23.

Kuntai Du, Yuhan Liu, Yitian Hao, Qizheng Zhang, Haodong Wang, Yuyang Huang, Ganesh Ananthanarayanan, Junchen Jiang (2023). OneAdapt: Fast Adaptation for Deep Learning Applications via Backpropagation. In SoCC'23.

Yihua Cheng, Xu Zhang, Junchen Jiang (2023). Enabling Perception-Driven Optimization in Networking. Workshop on Measurements for Self-Driving Networks(SIGMETRICS 2023).

Henry Milner, Yihua Cheng, Jibin Zhan, Hui Zhang, Vyas Sekar, Junchen Jiang, Ion Stoica (2023). Raising the Level of Abstraction for Time-State Analytics With the Timeline Framework. In CIDR'23.

Kuntai Du, Qizheng Zhang, Anton Arapin, Haodong Wang, Zhengxu Xia, Junchen Jiang (2022). AccMPEG: Optimizing Video Encoding for Video Analytics. In MLSys'22.

Zhengxu Xia, Yajie Zhou, Francis Y. Yan, Junchen Jiang (2022). Automatic Curriculum Generation for Learning Adaptation in Networking. In SIGCOMM'22.

Xu Zhang, Yiyang Ou, Siddhartha Sen, Junchen Jiang (2021). SENSEI: Aligning Video Streaming Quality with Dynamic User Sensitivity. In NSDI'21.

PDF Cite Slides Video