avatar

Jianyi Zhang

PI & Ph.D.
Duke University
Center for Computational Evolutionary Intelligence
jianyi.zhang@duke.edu


Selected Papers [Google Scholar]

  1. NeurIPS
    SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Models
    Jianyi Zhang, Da-Cheng Juan, Cyrus Rashtchian, Chun-Sung Ferng, Heinrich Jiang, Yiran Chen
    Thirty-eighth Conference on Neural Information Processing Systems (NeurIPS), 2024
    PDF Code Project Page BibTex

  2. WACV
    ARTIST: Improving the Generation of Text-rich Images with Disentangled Diffusion Models and Large Language Models
    Jianyi Zhang*, Yufan Zhou*, Jiuxiang Gu, Curtis Wigington, Tong Yu, Yiran Chen, Tong Sun, Ruiyi Zhang
    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025
    PDF BibTex Oral Presentation

  3. preprint
    H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking
    Martin Kuo, Jianyi Zhang, Aolin Ding, Qinsi Wang, Louis DiValentin, Yujia Bao, Wei Wei, Hai Li, Yiran Chen
    Technical report, 2025.
    PDF Code Project Page BibTex

  4. ICLR
    Sufficient Context: A New Lens on Retrieval Augmented Generation Systems
    Hailey Joren, Jianyi Zhang, Chun-Sung Ferng, Da-Cheng Juan, Ankur Taly, Cyrus Rashtchian
    The Thirteenth International Conference on Learning Representations (ICLR), 2025
    PDF BibTex

  5. ICLR
    Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utility
    Martin Kuo, Jingyang Zhang, Jianyi Zhang, Minxue Tang, Louis DiValentin, Aolin Ding, Jingwei Sun, William Chen, Amin Hass, Tianlong Chen, Yiran Chen, Hai Li
    The Thirteenth International Conference on Learning Representations (ICLR), 2025
    PDF

  6. ICLR
    Min-K%++: Improved Baseline for Detecting Pre-Training Data from Large Language Models
    Jingyang Zhang, Jingwei Sun, Eric Yeats, Yang Ouyang, Martin Kuo, Jianyi Zhang, Hao Yang, Hai Li
    The Thirteenth International Conference on Learning Representations (ICLR), 2025
    PDF Code Project Page BibTex

  7. preprint
    CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Activation
    Qinsi Wang, Saeed Vahidian, Hancheng Ye, Jianyang Gu, Jianyi Zhang, Yiran Chen
    Technical report, 2024.
    PDF Code Project Page BibTex

  8. WACV
    MLLM-LLaVA-FL: Multimodal Large Language Model Assisted Federated Learning
    Jianyi Zhang, Frank Yang, Ang Li, Xin Guo, Pu Wang, Haiming Wang, Yiran Chen, Hai Li
    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025
    PDF BibTex

  9. ECCV
    Unlocking the potential of federated learning: The symphony of dataset distillation via deep generative latents
    Yuqi Jia, Saeed Vahidian, Jingwei Sun, Jianyi Zhang, Vyacheslav Kungurtsev, Neil Zhenqiang Gong, Yiran Chen
    The 18th European Conference on Computer Vision (ECCV), 2024.
    PDF Code BibTex

  10. ICASSP
    Towards Building the Federated GPT: Federated Instruction Tuning
    Jianyi Zhang, Saeed Vahidian, Martin Kuo, Chunyuan Li, Ruiyi Zhang, Tong Yu, Yufan Zhou, Guoyin Wang, Yiran Chen
    FL@FM-NeurIPS’23 Oral Presentation, ICASSP 2024
    PDF Code BibTex Oral Presentation

  11. ACL
    ReAugKD: Retrieval-augmented knowledge distillation for pre-trained language models
    Jianyi Zhang, Aashiq Muhamed, Aditya Anantharaman, Guoyin Wang, Changyou Chen, Kai Zhong, Qingjun Cui, Yi Xu, Belinda Zeng, Trishul Chilimbi, Yiran Chen
    The 61st Annual Meeting of the Association for Computational Linguistics (ACL), 2023
    PDF BibTex Oral Presentation

  12. ICML
    Fed-CBS: A Heterogeneity-Aware Client Sampling Mechanism for Federated Learning via Class-Imbalance Reduction
    Jianyi Zhang, Ang Li, Minxue Tang, Jingwei Sun, Xiang Chen, Fan Zhang, Changyou Chen, Yiran Chen, Hai Li
    Fortieth International Conference on Machine Learning (ICML), 2023
    PDF BibTex

  13. NeurIPS
    Why do we need large batch sizes in contrastive learning? A gradient-bias perspective
    Changyou Chen, Jianyi Zhang, Yi Xu, Liqun Chen, Jiali Duan, Yiran Chen, Son Tran, Belinda Zeng, Trishul Chilimbi
    Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS), 2022
    PDF BibTex

  14. CIC
    Next Generation Federated Learning for Edge Devices: An Overview
    Jianyi Zhang, Zhixu Du, Jingwei Sun, Ang Li, Minxue Tang, Yuhao Wu, Zhihui Gao, Martin Kuo, Hai-Helen Li, Yiran Chen
    2022 IEEE 8th International Conference on Collaboration and Internet Computing, (CIC 2022)
    PDF BibTex Invited Research Vision Paper

  15. ICDM
    Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer
    Jianyi Zhang, Yiran Chen, Jianshu Chen
    2022 IEEE International Conference on Data Mining (ICDM), 2022
    PDF BibTex

  16. KDD
    FLOP: Federated Learning on Medical Datasets using Partial Networks
    Qian Yang, Jianyi Zhang, Weituo Hao, Gregory Spell, Lawrence Carin
    Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining (KDD), 2021
    PDF BibTex

  17. CVPR
    Towards Fair Federated Learning with Zero-Shot Data Augmentation
    Weituo Hao, Mostafa El-Khamy, Jungwon Lee, Jianyi Zhang, Kevin J Liang, Changyou Chen, Lawrence Carin
    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    PDF BibTex

  18. ICML
    Variance reduction in stochastic particle-optimization sampling
    Jianyi Zhang, Yang Zhao, Ruiyi Zhang, Lawrence Carin, Changyou Chen
    Proceedings of the 37th International Conference on Machine Learning (ICML), 2020
    PDF BibTex

  19. AISTATS
    Stochastic particle-optimization sampling and the non-asymptotic convergence theory
    Jianyi Zhang, Ruiyi Zhang, Lawrence Carin, Changyou Chen
    Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics (AISTATS), 2020
    PDF BibTex

  20. ICLR
    Cyclical stochastic gradient MCMC for Bayesian deep learning
    Ruqi Zhang, Chunyuan Li, Jianyi Zhang, Changyou Chen, Andrew Gordon Wilson
    Eighth International Conference on Learning Representations (ICLR), 2020
    PDF BibTex Oral Presentation

  21. AAAI
    Self-adversarially learned bayesian sampling
    Yang Zhao, Jianyi Zhang, Changyou Chen
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2020
    PDF BibTex