Song Bian

Email: biansonghz AT gmail DOT com
Linkedin
Google Scholar

Biography

I am a Research Scientist at NVIDIA Research working with Prof. Song Han.

I earned my PhD at the University of Wisconsin-Madison, advised by Prof. Shivaram Venkataraman. I completed my M.Phil. at The Chinese University of Hong Kong, advised by Prof. Jeffrey Xu Yu, and my B.S. at Zhejiang University, advised by Prof. Yunjun Gao.

My research interests lies in Large Language Models and Machine Learning Systems.

Manuscripts

         
Evolving Infra: Agent-Adaptive LLM Serving at Scale
Hao Kang, Weili Xu, Ziyang Li, Zheng Du, Hanchen Li, Tian Xia, Song Bian, Tushar Krishna, Huizi Mao, Ion Stoica, Song Han
Technical Report, 2026. [paper]

Deep Personalization: Continuous Context Observation for Local Proactive Agents
Yijia Shao, Song Bian, Junxian Guo, Jindong Jiang, Zhen Dong, Huizi Mao, Diyi Yang, Song Han
Technical Report, 2026. [paper]

Humanize: Judgement Engineering for Agentic Coding
Sihao Liu, Ligeng Zhu, Zijian Zhang, Dongyun Zou, Zhengyang Zhang, Changye Li, Song Bian, Song Han, Tony Nowatzki
Technical Report, 2026. [paper]

Selected Publications [Google Scholar]

         
Scaling Laws Meet Model Architecture: Toward Inference-Efficient LLMs
Song Bian, Tao Yu, Shivaram Venkataraman, Youngsuk Park
The International Conference on Learning Representations, (ICLR), 2026. [paper][blog]

Scaling Inference-Efficient Language Models
Song Bian*, Minghao Yan*, Shivaram Venkataraman
International Conference on Machine Learning, (ICML), 2025. [paper][code][model]

Does Compressing Activations Help Model Parallel Training?
Song Bian*, Dacheng Li*, Hongyi Wang, Eric P. Xing, Shivaram Venkataraman
Proceedings of Machine Learning and Systems (MLSys), 2024. [paper][code]


© Song Bian | Last updated: Nov 2026