Mengyu Ye

Ph.D. student @ Tohoku University Fundamental AI lab.

prof_pic.jpg

ye.mengyu.s1 [at] dc.tohoku.ac.jp

I am currently a 2nd year Ph.D. student in NLP at Fundamental AI lab (member of Tohoku NLP Group), Tohoku University, advised by Prof. Jun Suzuki.

My research interests lie in Natural Language Processing (NLP) and Machine Learning (ML). My previous work has focused on the interpretability of large language models (LLMs), driven by the goal of developing neural systems that are fully controllable and mechanistically understandable through a deep analysis of the algorithms they have learned.

More recently, my research has expanded to diffusion language models, where I explore the combination of post-training methods and tailored inference-time algorithms to enhance their performance. In parallel, I have also been working on building agent systems capable of operating effectively under real-world conditions.

news

Sep 19, 2025 The paper demonstrating that the interpretability of key-value memories closely matches that of sparse autoencoders has been accepted to NeurIPS 2025.
May 16, 2025 The paper on evaluating input attribution methods under ICL setting has been accepted to ACL 2025 (Findings).
Nov 11, 2024 Our proposal for Gemma 2 Academic Research Program has been accepted.
Oct 04, 2024 Personal homepage updated! :sunny:
Aug 07, 2024 I received a fellowship from BOOST, a Japanese national strategic program supporting excellent PhD students.

previous news