publications

Please check out my Google Scholar for more complete and up-to-date publication list.

2021

  1. Focal Transformer
    Focal self-attention for local-global interactions in vision transformers
    Yang, Jianwei, Li, Chunyuan, Zhang, Pengchuan, Dai, Xiyang, Xiao, Bin, Yuan, Lu, and Gao, Jianfeng
    NeurIPS 2021
  2. EsViT
    Efficient Self-supervised Vision Transformers for Representation Learning
    Li, Chunyuan, Yang, Jianwei, Zhang, Pengchuan, Gao, Mei, Xiao, Bin, Dai, Xiyang, Yuan, Lu, and Gao, Jianfeng
    arXiv preprint arXiv:2106.09785 2021
  3. Soloist
    Soloist: Building Task Bots at Scale with Transfer Learning and Machine Teaching
    Peng, Baolin, Li, Chunyuan, Li, Jinchao, Shayandeh, Shahin, Liden, Lars, and Gao, Jianfeng
    Transactions of the Association for Computational Linguistics 2021

2020

  1. Oscar
    Oscar: Object-semantics aligned pre-training for vision-language tasks
    Li, Xiujun, Yin, Xi, Li, Chunyuan, Zhang, Pengchuan, Hu, Xiaowei, Zhang, Lei, Wang, Lijuan, Hu, Houdong, Dong, Li, Wei, Furu, and others,
    In ECCV 2020
  2. Optimus
    Optimus: Organizing sentences via pre-trained modeling of a latent space
    Li, Chunyuan, Gao, Xiang, Li, Yuan, Peng, Baolin, Li, Xiujun, Zhang, Yizhe, and Gao, Jianfeng
    EMNLP 2020
  3. cSG-MCMC
    Cyclical stochastic gradient MCMC for Bayesian deep learning
    Zhang, Ruqi, Li, Chunyuan, Zhang, Jianyi, Chen, Changyou, and Wilson, Andrew Gordon
    ICLR (Oral Presentation) 2020

2019

  1. TAC-GAN
    Twin auxiliary classifiers gan
    Gong, Mingming, Xu, Yanwu, Li, Chunyuan, Zhang, Kun, and Batmanghelich, Kayhan
    NeurIPS (Spotlight Presentation) 2019
  2. Cyclical annealing
    Cyclical annealing schedule: A simple approach to mitigating KL vanishing
    Fu, Hao*, Li, Chunyuan*, Liu, Xiaodong, Gao, Jianfeng, Celikyilmaz, Asli, and Carin, Lawrence
    NAACL 2019

2018

  1. Intrinsic Dim
    Measuring the intrinsic dimension of objective landscapes
    Li, Chunyuan, Farkhoor, Heerad, Liu, Rosanne, and Yosinski, Jason
    ICLR 2018
  2. LEAM
    Joint embedding of words and labels for text classification
    Wang, Guoyin, Li, Chunyuan, Wang, Wenlin, Zhang, Yizhe, Shen, Dinghan, Zhang, Xinyuan, Henao, Ricardo, and Carin, Lawrence
    ACL 2018