Yujia Qin (秦禹嘉)

Yujia Qin (秦禹嘉)
yujiaqin16 <at> gmail.com

I am a Ph.D. student at Tsinghua, advised by Prof. Zhiyuan Liu . I have broad interests in natural language processing and machine learning, with a focus on pre-trained language models and their applications in information extraction and question answering .

Google Scholar / Twitter

Education

B.E. Electronic Information Science and Technology, Tsinghua University, 2016-2020

Ph.D. Computer Science, Tsinghua University, 2020-2025 (expected)

Selected Publication

(*indicates equal contribution)

WebCPM: Interactive Web Search for Chinese Long-form Question Answering
Yujia Qin, Zihan Cai, Dian Jin, Lan Yan, Shihao Liang, Kunlun Zhu, Yankai Lin, Xu Han, Ning Ding, Huadong Wang, Ruobing Xie, Fanchao Qi, Zhiyuan Liu, Maosong Sun and Jie Zhou
ACL 2023
paper / code

Recyclable Tuning for Continual Pre-training
Yujia Qin, Cheng Qian, Xu Han, Yankai Lin, Huadong Wang, Ruobing Xie, Zhiyuan Liu, Maosong Sun and Jie Zhou
Findings of ACL 2023
paper / code

Tool Learning with Foundation Models
Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, Yi Ren Fung, Yusheng Su, Huadong Wang, Cheng Qian, Runchu Tian, Kunlun Zhu, Shihao Liang, Xingyu Shen, Bokai Xu, Zhen Zhang, Yining Ye, Bowen Li, Ziwei Tang, Jing Yi, Yuzhang Zhu, Zhenning Dai, Lan Yan, Xin Cong, Yaxi Lu, Weilin Zhao, Yuxiang Huang, Junxi Yan, Xu Han, Xian Sun, Dahai Li, Jason Phang, Cheng Yang, Tongshuang Wu, Heng Ji, Zhiyuan Liu, Maosong Sun
preprint
paper / code

Exploring Mode Connectivity for Pre-trained Language Models
Yujia Qin*, Cheng Qian*, Jing Yi*, Weize Chen, Yankai Lin, Xu Han, Zhiyuan Liu, Maosong Sun and Jie Zhou
EMNLP 2022
paper / code

Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Parameter-Efficient Tuning
Jing Yi*, Weize Chen*, Yujia Qin*, Yankai Lin, Ning Ding, Xu Han, Zhiyuan Liu, Maosong Sun and Jie Zhou
Findings of EMNLP 2022
paper / code

FPT: Improving Prompt Tuning Efficiency via Progressive Training
Yufei Huang*, Yujia Qin*, Huadong Wang, Yichun Yin, Maosong Sun, Zhiyuan Liu, Qun Liu
Findings of EMNLP 2022, Short Paper
paper / code

Moderate-fitting as a Natural Backdoor Defender for Pre-trained Language Models
Biru Zhu*, Yujia Qin*, Ganqu Cui, Yangyi Chen, Weilin Zhao, Chong Fu, Yangdong Deng, Zhiyuan Liu, Jingang Wang, Wei Wu, Maosong Sun, Ming Gu
NeurIPS 2022
paper / code

Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
Ning Ding*, Yujia Qin*, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, Maosong Sun
Nature Machine Intelligence
paper / code

Exploring Universal Intrinsic Task Subspace via Prompt Tuning
Yujia Qin*, Xiaozhi Wang*, Yusheng Su, Yankai Lin, Ning Ding, Zhiyuan Liu, Juanzi Li, Lei Hou, Peng Li, Maosong Sun, Jie Zhou
previously accepted by findings of ACL 2022, and findings of EMNLP 2022
paper / code

Pass off Fish Eyes for Pearls: Attacking Model Selection of Pre-trained Models
Biru Zhu*, Yujia Qin*, Fanchao Qi, Yangdong Deng, Zhiyuan Liu, Maosong Sun, Ming Gu
ACL 2022, main conf
paper / code

ELLE: Efficient Lifelong Pre-training for Emerging Data
Yujia Qin*, Jiajie Zhang*, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
ACL 2022, findings
paper / code

Knowledge Inheritance for Pre-trained Language Models
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
NAACL 2022 (oral)
paper / code

ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou
ACL-IJCNLP 2021 (oral)
paper / code

Learning from Explanations with Neural Execution Tree
Ziqi Wang*, Yujia Qin*, Wenxuan Zhou, Jun Yan, Qinyuan Ye, Leonardo Neves, Zhiyuan Liu, Xiang Ren
ICLR 2020
paper / code / Project NExT

Improving Sequence Modeling Ability of Recurrent Neural Networks via Sememes
Yujia Qin*, Fanchao Qi*, Sicong Ouyang, Zhiyuan Liu, Cheng Yang, Yasheng Wang, Qun Liu, Maosong Sun
TASLP 2020
paper / code

Internship

Pattern recognition group, @Tencent.Wechat, Beijing, Summer Research Intern hosted by Dr. Peng Li and Dr. Yankai Lin, 2020.5 - 2020.9

Laboratory of Multimedia and Information Processing, Tsinghua University (Thesis), Research Intern advised by Prof. Ji Wu, 2019.9 - 2020.6

Intelligence and Knowledge Discovery Research Lab, USC, Research Intern hosted by Prof. Xiang Ren , 2019.6 - 2019.9

Laboratory of Natural Language Processing, Tsinghua University, advised by Prof. Zhiyuan Liu , 2018.5 - 2019.6

Pacific Century CyberWorks, Hong Kong, Summer 2018

Award

First Prize Scholarship of 2021 Tencent Rhino-Bird Research Elite Program

Reviewer

ACL Rolling Review, EMNLP, SIGIR, AAAI, COLING

The design of this website is borrowed from Jon Barron, last updated: 2022.7