My name is Xingcheng Yao (姚星丞). Welcome to my homepage!

I'm a first-year PhD student in computer science at UCLA, advised by Prof.Kai-Wei Chang. Prior to UCLA, I worked as a researcher at Moonshot AI, a startup that develops KimiChat. I received my Bachelor's degree from IIIS (well known as Yao Class), Tsinghua University, where I was fortunate to work with Prof. Danqi Chen and Prof. Zhilin Yang. I'm currently working to accelerate the arrival of artifical super intelligence (ASI)

Email: sxyao At cs dOt ucla Dot edu

Publications

* for equal contribution

• Muon is Scalable For LLM Training
  Jingyuan Liu, Jianlin Su, Xingcheng Yao, Zhejun Jiang, Guokun Lai, Yulun Du, Yidao Qin, Weixin Xu, Enzhe Lu, Junjie Yan, Yanru Chen, Huabin Zheng, Yibo Liu, Shaowei Liu, Bohong Yin, Weiran He, Han Zhu, Yuzhi Wang, Jianzhou Wang, Mengnan Dong, Zheng Zhang, Yongsheng Kang, Hao Zhang, Xinran Xu, Yutao Zhang, Yuxin Wu, Xinyu Zhou, Zhilin Yang

• QLASS: Boosting Language Agent Inference via Q-Guided Stepwise Search
  Zongyu Lin*, Yao Tang*, Xingcheng Yao*, Da Yin*, Ziniu Hu, Yizhou Sun, Kai-Wei Chang

• Automatic Truss Design with Reinforcement Learning
  Weihua Du, Jinglun Zhao, Chao Yu, Xingcheng Yao, Zimeng Song, Siyang Wu, Ruifeng Luo, Zhiyuan Liu, Xianzhong Zhao, Yi Wu

• NLP From Scratch Without Large-Scale Pre-training: A Simple and Efficient Framework
  Xingcheng Yao*, Yanan Zheng*, Xiaocong Yang, Zhilin Yang

• SimCSE: Simple Contrastive Learning of Sentence Embeddings
  Tianyu Gao*, Xingcheng Yao*, Danqi Chen

• CogDL: A Comprehensive Library for Graph Deep Learning
  Yukuo Cen, Zhenyu Hou, Yan Wang, Qibin Chen, Yizhen Luo, Xingcheng Yao, Aohan Zen, Shiguang Guo, Peng Zhang, Guohao Dai, Yu Wang, Chang Zhou, Hongxia Yang, Jie Tang