Portrait of Weipeng Jiang

Ph.D. Candidate · Xi'an Jiaotong University

Weipeng Jiang 降伟鹏

Software Engineering Trustworthy AI LLM Testing

I study the intersection of software engineering and AI, with a focus on testing, evaluating, and improving trustworthy AI systems and large language models.

Current focus. I am particularly interested in building automated, verifiable, and scalable frameworks for agentic task synthesis to evaluate the capability boundaries of LLM agents and support their post-training.

01

About me

I am a final-year Ph.D. student at the Faculty of Electronic and Information Engineering, Xi'an Jiaotong University, advised by Prof. Chao Shen. I am also very fortunate to work closely with Prof. Shiqing Ma at University of Massachusetts Amherst. Previously, I was a visiting Ph.D. student at Singapore Management University (SMU), under the supervision of Prof. Xiaofei Xie.

My research interests encompass Intersection of Software Engineering and AI (AI4SE, SE4AI) and Trustworthy AI.

LLM Evaluation Software Testing AI for SE

02

News

  • One paper is accepted by ACL 2026 Main Conference as an Oral presentation.
  • Two papers are accepted by AAAI 2026.
  • Honored to serve on the PC for LLMSC 2025.
  • Our paper about LLM Jailbreaking is accepted by NAACL Findings 2025.
  • Invited to serve as a reviewer for ICML 2025.
  • Invited to serve as a reviewer for ICLR 2025.
  • Invited to serve on the Artifact Evaluation Program Committee for ICSE 2025.
  • Invited to serve as a reviewer for NeurIPS 2024.
  • Our paper about Embedding-Service Testing is accepted by FSE'24.

03

Publications

* indicates equal contribution.

2026

  1. Towards Automatic Software Faults Analysis
    Jiongchi Yu*, Weipeng Jiang*, Xiaoyu Zhang, Qiang Hu, Xiaofei Xie, Chao Shen
    The 48th International Conference on Software Engineering ICSE 2026Poster
  2. From Chaos to Clarity: A Knowledge Graph-Driven Audit Dataset Generation Framework for LLM Unlearning
    Weipeng Jiang, Juan Zhai, Shiqing Ma, Ziyan Lei, Xiaofei Xie, Yige Wang, Chao Shen
    The Fortieth AAAI Conference on Artificial Intelligence AAAI 2026
  3. MoMoREC: A Multi-agent Motivation Generation Framework for Residual Semantic ID-Aware Recommendation
    Yige Wang, Mingming Li, Li Wang, Kaichen Zhao, Wangming Li, Weipeng Jiang, Xueying Li
    The Fortieth AAAI Conference on Artificial Intelligence AAAI 2026
  4. New frontiers in large code language model security: a review of emerging adversarial threats and countermeasures
    Y Yang, H Fan, C Lin, W Jiang, S Wang, Q Li, Z Zhao, C Zhang, X Guan
    Science China Information Sciences SCIS 2026

2025

  1. The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation
    Xiaoyu Zhang, Juan Zhai, Shiqing Ma, Qingshuang Bao, Weipeng Jiang, Chao Shen, Yang Liu
    Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics ACL 2025Main
  2. An Optimizable Suffix Is Worth A Thousand Templates: Efficient Black-box Jailbreaking without Affirmative Phrases via LLM as Optimizer
    Weipeng Jiang, Zhenting Wang, Juan Zhai, Shiqing Ma, Zhengyu Zhao, Chao Shen
    Findings of the Association for Computational Linguistics NAACL 2025Findings
  3. STAFF: Speculative Coreset Selection for Task-Specific Fine-tuning
    Xiaoyu Zhang, Juan Zhai, Shiqing Ma, Chao Shen, Tianlin Li, Weipeng Jiang, Yang Liu
    The 13th International Conference on Learning Representations ICLR 2025
  4. Deep Learning Library Testing: Definition, Methods and Challenges
    Xiaoyu Zhang, Weipeng Jiang, Chao Shen, Qi Li, Qian Wang, Chenhao Lin, Xiaohong Guan
    ACM Computing Surveys CSUR 2025
  5. The Foundation Cracks: A Comprehensive Study on Bugs and Testing Practices in LLM Libraries
    Weipeng Jiang, Xiaoyu Zhang, Xiaofei Xie, Jiongchi Yu, Yuhan Zhi, Shiqing Ma, Chao Shen
    Preprint arXiv 2025

2024

  1. Efficient DNN-Powered Software with Fair Sparse Models
    Xuanqi Gao, Weipeng Jiang, Juan Zhai, Shiqing Ma, Xiaoyu Zhang, Chao Shen
    The 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis ISSTA 2024
  2. COSTELLO: Contrastive Testing for Embedding-based Large Language Model as a Service Embeddings
    Weipeng Jiang, Juan Zhai, Shiqing Ma, Xiaoyu Zhang, Chao Shen
    ACM International Conference on the Foundations of Software Engineering FSE 2024
  3. Fairness in Machine Learning: Definition, Testing, Debugging and Application
    Xuanqi Gao, Chao Shen, Weipeng Jiang, Chenhao Lin, Qian Li, Qian Wang, Qi Li, Xiaohong Guan
    Science China Information Sciences, Volume 67 SCIS 2024
  4. From Effectiveness to Efficiency: Uncovering Linguistic Bias in Large Language Model-based Code Generation
    Weipeng Jiang, Xuanqi Gao, Juan Zhai, Shiqing Ma, Xiaoyu Zhang, Ziyan Lei, Chao Shen
    Preprint arXiv 2024

2023

  1. Black-Box Fairness Testing with Shadow Models
    Weipeng Jiang, Chao Shen, Chenhao Lin, Jingyi Wang, Jun Sun, Xuanqi Gao
    The 23rd International Conference on Information and Communications Security ICICS 2023

04

Academic Services

Conference Reviewer

  • 2026: ICLR, AAAI
  • 2025: ICLR, ICML, AISTATS, ICSE Artifact Evaluation, LLMSC Workshop
  • 2024: NeurIPS

Journal Reviewer

  • Journal of Software: Evolution and Process

05

Honors and Awards

  • [2024] First-Class Scholarship for Ph.D. Candidates, Xi'an Jiaotong University.
  • [2024] ACM SIGSOFT Travel Grants.
  • [2021] Outstanding Graduates, Xi'an Jiaotong University.
  • [2019] Lu-Shidi Scholarship (Top-5 students), Xi'an Jiaotong University.
  • [2018, 2019] Silver Award in CCSP, China Computer Federation.
  • [2018, 2019] Silver Award in ACM-ICPC Asia Regional.