Weipeng Jiang (降伟鹏)

About me

I am a fifth-year Ph.D. student at the School of Cyber Science and Engineering, Xi'an Jiaotong University, advised by Prof. Chao Shen. I am also very fortunate to work closely with Prof. Shiqing Ma at University of Massachusetts Amherst. Previously, I was a visiting Ph.D. student at Singapore Management University (SMU), under the supervision of Prof. Xiaofei Xie.

My research interests encompass Intersection of Software Engineering and AI (AI4SE, SE4AI) and Trustworthy AI. Specifically, I am actively involved in the following topics:

• Effective and Efficient Red Teaming and Auditing for LLM Safety, Fairness, and Privacy;

• Deep Evaluation on CodeLLM/Code Agent in Various Software Engineering Tasks;

• Software Quality Assurance and Security Analysis for DL (particularly LLM) Infrastructure;

News

• [Feb 2025] Two papers are accepted by AAAI 2026.

• [Feb 2025] Fortunate to serve on the Program Committee for The 1st International Workshop on Large Language Model Supply Chain Analysis (LLMSC 2025).

• [Jan 2025] Our paper about LLM Jailbreaking is accepted by NAACL Findings 2025.

• [Dec 2024] Invited to serve as a reviewer for ICML 2025.

• [Aug 2024] Invited to serve as a reviewer for ICLR 2025.

• [Aug 2024] Invited to serve as a program committee of Artifact Evaluation Track for ICSE 2025.

• [June 2024] New preprint is online From Effectiveness to Efficiency: Comparative Evaluation of Code Generated by LCGMs for Bilingual Programming Questions.

• [May 2024] Invited to serve as a reviewer for NeurIPS 2024.

• [Feb 2024] Our paper about Embedding-Service Testing is accepted by FSE'24.

Research Publications

1. The Foundation Cracks: A Comprehensive Study on Bugs and Testing Practices in LLM Libraries

   Weipeng Jiang, Xiaoyu Zhang, Xiaofei Xie, Jiongchi Yu, Yuhan Zhi, Shiqing Ma, Chao Shen
   Arxiv. Paper

2. From Effectiveness to Efficiency: Uncovering Linguistic Bias in Large Language Model-based Code Generation

   Weipeng Jiang, Xuanqi Gao, Juan Zhai, Shiqing Ma, Xiaoyu Zhang, Ziyan Lei, Chao Shen
   Arxiv. Paper

1. From Chaos to Clarity: A Knowledge Graph-Driven Audit Dataset Generation Framework for LLM Unlearning

   Weipeng Jiang, Juan Zhai, Shiqing Ma, Ziyan Lei, Xiaofei Xie, Yige Wang, Chao Shen
   The Fortieth AAAI Conference on Artificial Intelligence (AAAI'26). Paper

2. MoMoREC: A Multi-agent Motivation Generation Framework for Residual Semantic ID-Aware Recommendation

   Yige Wang, Mingming Li, Li Wang, Kaichen Zhao, Wangming Li, Weipeng Jiang, Xueying LI
   The Fortieth AAAI Conference on Artificial Intelligence (AAAI'26)

3. The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation

   Xiaoyu Zhang, Juan Zhai, Shiqing Ma, Qingshuang Bao, Weipeng Jiang, Chao Shen, Yang Liu
   Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL'25). Paper

4. An Optimizable Suffix Is Worth A Thousand Templates: Efficient Black-box Jailbreaking without Affirmative Phrases via LLM as Optimizer

   Weipeng Jiang, Zhenting Wang, Juan Zhai, Shiqing Ma, Zhengyu Zhao, Chao Shen
   Findings of American Chapter of the Association for Computational Linguistics Findings (NAACL Findings'25) Paper Code

5. STAFF: Speculative Coreset Selection for Task-Specific Fine-tuning

   Xiaoyu Zhang, Juan Zhai, Shiqing Ma, Chao Shen, Tianlin Li, Weipeng Jiang, Yang Liu
   The 13rd International Conference on Learning Representations (ICLR'25) Paper Code

6. Efficient DNN-Powered Software with Fair Sparse Models

   Xuanqi Gao, Weipeng Jiang, Juan Zhai, Shiqing Ma, Xiaoyu Zhang, Chao Shen
   The 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA'24) Paper Code

7. COSTELLO: Contrastive Testing for Embedding-based Large Language Model as a Service Embeddings

   Weipeng Jiang, Juan Zhai, Shiqing Ma, Xiaoyu Zhang, Chao Shen
   ACM International Conference on the Foundations of Software Engineering (FSE'24) Paper Code

8. Black-Box Fairness Testing with Shadow Models

   Weipeng Jiang, Chao Shen, Chenhao Lin, Jingyi Wang, Jun Sun, Xuanqi Gao
   The 23rd International Conference on Information and Communications Security (ICICS'23) Paper Code

1. Deep Learning Library Testing: Definition, Methods and Challenges

   Xiaoyu Zhang, Weipeng Jiang, Chao Shen, Qi Li, Qian Wang, Chenhao Lin, Xiaohong Guan
   ACM Computing Surveys, 2025. (CSUR) Paper

2. Fairness in Machine Learning: Definition, Testing, Debugging and Application

   Xuanqi Gao, Chao Shen, Weipeng Jiang, Chenhao Lin, Qian Li, Qian Wang, Qi Li, Xiaohong Guan
   Science China Information Sciences, Volume 67, article number 191201, 2024. (SCIS) Paper

Academic Services

Conference Reviewer

• 2026: ICLR, AAAI

• 2025: ICLR, ICML, AISTATS, ICSE Artifact Evaluation, LLMSC Workshop

• 2024: NeurIPS

Journal Reviewer

• Journal of Software: Evolution and Process

Honors and Awards

• [2024] First-Class Scholarship for Ph.D. Candidates, Xi'an Jiaotong University

• [2024] ACM SIGSOFT Travel Grants

• [2021] Outstanding Graduates, Xi'an Jiaotong University

• [2019] Lu-Shidi Scholarship (Top-5 students in Computer Science School), Xi'an Jiaotong University and Qihoo 360

• [2018, 2019] Silver Award in Collegiate Computer Systems & Programming Contest (CCSP), China Computer Federation

• [2018, 2019] Silver Award in The International Collegiate Programming Contest of Asia Regional (ACM-ICPC), Association for Computing Machinery