Hi:wave:, I am Zhaoyi (Joey) Li, a computer science Ph.D. student at University of Science and Technology of China and City University of Hong Kong, co-adviced by Dr. Ying Wei, Dr. Defu Lian and Dr. Linqi Song. Previously, I got my Bachelor degree in Computer Science and Technology at University of Science and Technology of China in 2022.

My research goal is about building trustworthy and transparent AI models that achieve human-like reasoning and systematic generalization. Specifically, I want to make human beings and neural network systems better understand each other (i.e., high interpretability and good generalization of blackbox deep models). I currently focus on investigating the compositionality of language models, which is about the mechanism that language models decompose complex questions and concepts into primitive ones and re-compose them step-by-step to grasp the complex semantic meaning. I am super curious about whether the end-to-end trained large-scale deep models are able to grok human-like reasoning skills or not and how to demonstrate it both empirically and theoretically. I would love to discuss on related topics should anyone is interested (always feel free to drop me an email: lizhaoyi777\(AT\)mail.ustc.edu.cn)!

πŸ”₯ News

  • 2026.01: Β πŸŽ‰πŸŽ‰ Two papers were accepted by ICLR 2026.
  • 2025.12: I started an internship journey in Meituan LongCat Team.
  • 2025.08: Β πŸŽ‰πŸŽ‰ One paper was accepted by EMNLP 2025.
  • 2025.02: Β πŸŽ‰πŸŽ‰ One paper was accepted by ICLR 2025.
  • 2024.09: Β πŸŽ‰πŸŽ‰ One paper was accepted by Machine Learning Journal.
  • 2024.09: Β πŸŽ‰πŸŽ‰ One paper was accepted by EMNLP 2024.
  • 2024.05: Β πŸŽ‰πŸŽ‰ Two papers were accepted by ACL 2024.
  • 2023.05: Β πŸŽ‰πŸŽ‰ My first paper was accepted by ACL 2023.

πŸ“ Selected Papers

* indicates co-first authorship

Preprint 2026
On the Role of Reasoning Patterns in the Generalization Discrepancy of Long Chain-of-Thought Supervised Fine-Tuning
Zhaoyi Li*, Xiangyu Xi*, Zhengyu Chen, Wei Wang, Gangwei Jiang, Ranran Shen, Linqi Song, Ying Wei and Defu Lian
ICLR 2026
Scaling Reasoning Hop Exposes Weaknesses: Demystifying and Improving Hop Generalization in Large Language Models
Zhaoyi Li, Jiatong Li, Gangwei Jiang, Linqi Song, Defu Lian and Ying Wei
Preprint 2025
Learning to Substitute Components for Compositional Generalization
Zhaoyi Li, Gangwei Jiang, Chenwang Wu, Ying Wei, Defu Lian and Enhong Chen
EMNLP 2024
Mitigating the Language Mismatch and Repetition Issues in LLM-based Machine Translation via Model Editing
Weichuan Wang*, Zhaoyi Li*, Defu Lian, Chen Ma, Linqi Song and Ying Wei
ACL 2024 Findings
Understanding and Patching Compositional Reasoning in LLMs
Zhaoyi Li, Gangwei Jiang, Hong Xie, Linqi Song, Defu Lian and Ying Wei
ACL 2024
Benchmarking and Improving Compositional Generalization of Multi-aspect Controllable Text Generation
Tianqi Zhong*, Zhaoyi Li*, Quan Wang, Linqi Song, Ying Wei, Defu Lian and Zhendong Mao
ACL 2023 Oral Presentation
Learning to Substitute Spans towards Improving Compositional Generalization
Zhaoyi Li, Ying Wei and Defu Lian

πŸ† Honors and Awards

πŸ“– Educations

  • 2023.09 - now, PhD student, Department of Computer Science, City University of Hong Kong.
  • 2022.09 - now, PhD student, School of Computer Science and Technology, University of Science and Technology of China.
  • 2018.09 - 2022.07, Undergraduate, School of Computer Science and Technology, University of Science and Technology of China.

πŸ’» Internships

πŸŽ– Services

πŸˆβ€β¬› Special Links

  • Here is the link to the homepage of my girlfriend: Ranran Shen.