Yujia Qin (秦禹嘉)
yujiaqin16 <at> gmail.com

I am a Ph.D. student at Tsinghua, advised by Prof. Zhiyuan Liu . I have broad interests in natural language processing and machine learning, with a focus on pre-trained language models and their applications in information extraction and question answering .

Google Scholar  /  Twitter

Education

B.E. Electronic Information Science and Technology, Tsinghua University, 2016-2020

Ph.D. Computer Science, Tsinghua University, 2020-2025 (expected)

Selected Publication
Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning
Yujia Qin*, Xiaozhi Wang*, Yusheng Su, Yankai Lin, Ning Ding, Zhiyuan Liu, Juanzi Li, Lei Hou, Peng Li, Maosong Sun, Jie Zhou
preprint
(*indicates equal contribution)
paper
Knowledge Inheritance for Pre-trained Language Models
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
preprint
paper  /  code
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou
ACL-IJCNLP 2021 (oral)
paper  /  code
Learning from Explanations with Neural Execution Tree
Ziqi Wang*, Yujia Qin*, Wenxuan Zhou, Jun Yan, Qinyuan Ye, Leonardo Neves, Zhiyuan Liu, Xiang Ren
ICLR 2020
(*indicates equal contribution)
paper  /  code  /  Project NExT
Improving Sequence Modeling Ability of Recurrent Neural Networks via Sememes
Yujia Qin*, Fanchao Qi*, Sicong Ouyang, Zhiyuan Liu, Cheng Yang, Yasheng Wang, Qun Liu, Maosong Sun
TASLP 2020
(*indicates equal contribution)
paper  /  code
Internship

Beijing Academy of Artificial Intelligence (BAAI), Beijing, Research Intern, 2020.12 - Present

Pattern recognition group, @Tencent.Wechat, Beijing, Summer Research Intern hosted by Dr. Peng Li and Dr. Yankai Lin, 2020.5 - 2020.9

Laboratory of Multimedia and Information Processing, Tsinghua University (Thesis), Research Intern advised by Prof. Ji Wu, 2019.9 - 2020.6

Intelligence and Knowledge Discovery Research Lab, USC, Research Intern hosted by Prof. Xiang Ren , 2019.6 - 2019.9

Laboratory of Natural Language Processing, Tsinghua University, advised by Prof. Zhiyuan Liu , 2018.5 - 2019.6

Pacific Century CyberWorks, Hong Kong, Summer 2018

Reviewer

NLPCC 2019, COLING 2020, IEEE TASLP, EMNLP 2021, ARR (assistant)


The design of this website is borrowed from Jon Barron, last updated: 2021.11