Yujia Qin (秦禹嘉)
yujiaqin16 <at> gmail.com

I am a Ph.D. student at Tsinghua, advised by Prof. Zhiyuan Liu . I have broad interests in natural language processing and machine learning, with a focus on pre-trained language models and their applications in information extraction and question answering .

Google Scholar  /  Twitter

Education

B.E. Electronic Information Science and Technology, Tsinghua University, 2016-2020

Ph.D. Computer Science, Tsinghua University, 2020-2025 (expected)

Selected Publication
(*indicates equal contribution)
ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
Yujia Qin*, Shihao Liang*, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, Sihan Zhao, Runchu Tian, Ruobing Xie, Jie Zhou, Mark Gerstein, Dahai Li, Zhiyuan Liu, and Maosong Sun
Preprint
paper  /  code
WebCPM: Interactive Web Search for Chinese Long-form Question Answering
Yujia Qin, Zihan Cai, Dian Jin, Lan Yan, Shihao Liang, Kunlun Zhu, Yankai Lin, Xu Han, Ning Ding, Huadong Wang, Ruobing Xie, Fanchao Qi, Zhiyuan Liu, Maosong Sun and Jie Zhou
ACL 2023
paper  /  code
Recyclable Tuning for Continual Pre-training
Yujia Qin, Cheng Qian, Xu Han, Yankai Lin, Huadong Wang, Ruobing Xie, Zhiyuan Liu, Maosong Sun and Jie Zhou
Findings of ACL 2023
paper  /  code
Tool Learning with Foundation Models
Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, Yi Ren Fung, Yusheng Su, Huadong Wang, Cheng Qian, Runchu Tian, Kunlun Zhu, Shihao Liang, Xingyu Shen, Bokai Xu, Zhen Zhang, Yining Ye, Bowen Li, Ziwei Tang, Jing Yi, Yuzhang Zhu, Zhenning Dai, Lan Yan, Xin Cong, Yaxi Lu, Weilin Zhao, Yuxiang Huang, Junxi Yan, Xu Han, Xian Sun, Dahai Li, Jason Phang, Cheng Yang, Tongshuang Wu, Heng Ji, Zhiyuan Liu, Maosong Sun
preprint
paper  /  code
Exploring Mode Connectivity for Pre-trained Language Models
Yujia Qin*, Cheng Qian*, Jing Yi*, Weize Chen, Yankai Lin, Xu Han, Zhiyuan Liu, Maosong Sun and Jie Zhou
EMNLP 2022
paper  /  code
Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Parameter-Efficient Tuning
Jing Yi*, Weize Chen*, Yujia Qin*, Yankai Lin, Ning Ding, Xu Han, Zhiyuan Liu, Maosong Sun and Jie Zhou
Findings of EMNLP 2022
paper  /  code
FPT: Improving Prompt Tuning Efficiency via Progressive Training
Yufei Huang*, Yujia Qin*, Huadong Wang, Yichun Yin, Maosong Sun, Zhiyuan Liu, Qun Liu
Findings of EMNLP 2022, Short Paper
paper  /  code
Moderate-fitting as a Natural Backdoor Defender for Pre-trained Language Models
Biru Zhu*, Yujia Qin*, Ganqu Cui, Yangyi Chen, Weilin Zhao, Chong Fu, Yangdong Deng, Zhiyuan Liu, Jingang Wang, Wei Wu, Maosong Sun, Ming Gu
NeurIPS 2022
paper  /  code
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
Ning Ding*, Yujia Qin*, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, Maosong Sun
Nature Machine Intelligence
paper  /  code
Exploring Universal Intrinsic Task Subspace via Prompt Tuning
Yujia Qin*, Xiaozhi Wang*, Yusheng Su, Yankai Lin, Ning Ding, Zhiyuan Liu, Juanzi Li, Lei Hou, Peng Li, Maosong Sun, Jie Zhou
previously accepted by findings of ACL 2022, and findings of EMNLP 2022
paper  /  code
Pass off Fish Eyes for Pearls: Attacking Model Selection of Pre-trained Models
Biru Zhu*, Yujia Qin*, Fanchao Qi, Yangdong Deng, Zhiyuan Liu, Maosong Sun, Ming Gu
ACL 2022, main conf
paper  /  code
ELLE: Efficient Lifelong Pre-training for Emerging Data
Yujia Qin*, Jiajie Zhang*, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
ACL 2022, findings
paper  /  code
Knowledge Inheritance for Pre-trained Language Models
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
NAACL 2022 (oral)
paper  /  code
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou
ACL-IJCNLP 2021 (oral)
paper  /  code
Learning from Explanations with Neural Execution Tree
Ziqi Wang*, Yujia Qin*, Wenxuan Zhou, Jun Yan, Qinyuan Ye, Leonardo Neves, Zhiyuan Liu, Xiang Ren
ICLR 2020
paper  /  code  /  Project NExT
Improving Sequence Modeling Ability of Recurrent Neural Networks via Sememes
Yujia Qin*, Fanchao Qi*, Sicong Ouyang, Zhiyuan Liu, Cheng Yang, Yasheng Wang, Qun Liu, Maosong Sun
TASLP 2020
paper  /  code
Internship

Pattern recognition group, @Tencent.Wechat, Beijing, Summer Research Intern hosted by Dr. Peng Li and Dr. Yankai Lin, 2020.5 - 2020.9

Laboratory of Multimedia and Information Processing, Tsinghua University (Thesis), Research Intern advised by Prof. Ji Wu, 2019.9 - 2020.6

Intelligence and Knowledge Discovery Research Lab, USC, Research Intern hosted by Prof. Xiang Ren , 2019.6 - 2019.9

Laboratory of Natural Language Processing, Tsinghua University, advised by Prof. Zhiyuan Liu , 2018.5 - 2019.6

Pacific Century CyberWorks, Hong Kong, Summer 2018

Award

First Prize Scholarship of 2021 Tencent Rhino-Bird Research Elite Program

Reviewer

ACL Rolling Review, EMNLP, SIGIR, AAAI, COLING


The design of this website is borrowed from Jon Barron, last updated: 2022.7