Jun-Yu Ma (马君瑜) Ph.D. Student National Engineering Research Center of Speech and Language Information Processing Department of Electronic Engineering and Information Science University of Science and Technology of China Email: mjy1999@mail.ustc.edu.cn       [Education] [Experience] [Publications] [Shared Tasks] [Service]

Hi there! My name is Jun-Yu Ma.
I am currently a fourth-year Ph.D. student at University of Science and Technology of China, supervised by Prof. Zhen-Hua Ling.
My main research interests lie within deep learning for natural language processing, and I am particularly interested in multilinguality, information extraction and model editing.

• Ph.D. Student
  2021.09 - 2026.06 (Expected): School of Information Science and Technology, University of Science and Technology of China
• Bachelor's Degree
  2017.09 - 2021.06: School of Information Science and Technology, University of Science and Technology of China

• Untying the Reversal Curse via Bidirectional Language Model Editing.
  Jun-Yu Ma, Jia-Chen Gu, Zhen-Hua Ling, Quan Liu, Cong Liu
  (Preprint)
[arxiv] [code]


• Recall with Reasoning: Chain-of-Thought Distillation for Mamba's Long-Context Memory and Extrapolation.
  Jun-Yu Ma, Tianqing Fang, Zhisong Zhang, Hongming Zhang, Haitao Mi, Dong Yu.
  (Preprint)
[arxiv]


• EchoScore: Echo-Guided Purge and Imprint for Unstructured Knowledge Editing.
  Hao-Xiang Xu, Ziqi Peng, Jun-Yu Ma, Zhen-Hua Ling, Jia-Chen Gu.
  (Preprint)
[arxiv] [code]


• WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback.
  Minda Hu, Tianqing Fang, Jianshu Zhang, Junyu Ma, Zhisong Zhang, Jingyan Zhou, Hongming Zhang, Haitao Mi, Dong Yu, Irwin King.
  (Preprint)
[arxiv]


• Perturbation-Restrained Sequential Model Editing.
  Jun-Yu Ma, Hong Wang, Hao-Xiang Xu, Zhen-Hua Ling, Jia-Chen Gu
  The Thirteenth International Conference on Learning Representations (ICLR 2025)
[arxiv] [code]


• Constraining Sequential Model Editing with Editing Anchor Compression.
  Hao-Xiang Xu*, Jun-Yu Ma*, Zhen-Hua Ling, Ningyu Zhang, Jia-Chen Gu
  2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL 2025 Findings)
[arxiv] [code]


• Neighboring Perturbations of Knowledge Editing on Large Language Models.
  Jun-Yu Ma, Jia-Chen Gu, Ningyu Zhang, Zhen-Hua Ling
  The Forty-first International Conference on Machine Learning (ICML 2024)
[arxiv] [code]


• SHINE: Syntax-augmented Hierarchical Interactive Encoder for Zero-shot Cross-lingual Information Extraction.
  Jun-Yu Ma, Jia-Chen Gu, Zhen-Hua Ling, Quan Liu, Cong Liu, Guoping Hu
  (IEEE/ACM Transactions on Audio, Speech, and Language Processing (IEEE TASLP)
[arxiv] [code]


• Model Editing Harms General Abilities of Large Language Models:Regularization to the Rescue.
  Jia-Chen Gu, Hao-Xiang Xu, Jun-Yu Ma, Pan Lu, Zhen-Hua Ling, Kai-Wei Chang, Nanyun Peng
  The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024 Main Conference)
[arxiv] [code]


• USTC-NELSLIP at SemEval-2023 Task 2: Statistical Construction and Dual Adaptation of Gazetteer for Multilingual Complex NER.
  Jun-Yu Ma, Jia-Chen Gu, Jiajun Qi, Zhen-Hua Ling, Quan Liu, Xiaoyi Zhao
  The 17th International Workshop on Semantic Evaluation at 2023 Annual Meeting of the Association for Computational Linguistics (SemEval at ACL 2023)
[paper] [arxiv] [code]


• Wider & Closer: Mixture of Short-channel Distillers for Zero-shot Cross-lingual Named Entity Recognition.
  Jun-Yu Ma*, Beiduo Chen*, Jia-Chen Gu, Zhenhua Ling, Wu Guo, Quan Liu, Zhigang Chen and Cong Liu
  The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022 Main Conference)
[paper] [arxiv] [code]


• USTC-NELSLIP at SemEval-2022 Task 11: Gazetteer-Adapted Integration Network for Multilingual Complex Named Entity Recognition.
  Beiduo Chen, Jun-Yu Ma, Jiajun Qi, Wu Guo, Zhen-Hua Ling, Quan Liu
  The 16th International Workshop on Semantic Evaluation at 2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics (SemEval at NAACL 2022)
[paper] [arxiv] [code] [slides] [poster]

• "Knowledge Editing for Large Language Models" at MLLM. [Slides].

• 2023   Rank 1st on one track (Hindi) in SemEval-2023 Task 2 MultiCoNER II.

• 2022   Rank 1st on three tracks (Chinese, Code-mixed and Bangla), and rank 2nd on the other ten tracks in SemEval-2022 Task 11 MultiCoNER .

• External program committee/reviewing:
  • Conference: EMNLP 2022
• Teaching assistant:
  • Natural Language Processing (210712, 210712.01, USTC), 2022
  • Natural Language Processing (210712, 210712.02, USTC), 2023