publications

Please check out my Google Scholar for more complete and up-to-date publication list.

2022

  1. K-LITE
    K-LITE: Learning Transferable Visual Models with External Knowledge
    Shen, Sheng*, Li, Chunyuan*, Hu, Xiaowei*, Xie, Yujia, Yang, Jianwei, Zhang, Pengchuan, Rohrbach, Anna, Gan, Zhe, Wang, Lijuan, Yuan, Lu, Liu, Ce, Keutzer, Kurt, Darrell, Trevor, and Gao, Jianfeng
    arXiv preprint 2022
  2. ELEVATER
    ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
    Li, Chunyuan*, Liu, Haotian*, Li, Liunian Harold, Zhang, Pengchuan, Aneja, Jyoti, Yang, Jianwei, Jin, Ping, Lee, Yong Jae, Hu, Houdong, Liu, Zicheng, and Gao, Jianfeng
    arXiv preprint 2022
  3. FocalNet
    Focal Modulation Networks
    Yang, Jianwei, Li, Chunyuan, and Gao, Jianfeng
    arXiv preprint 2022
  4. EsViT
    Efficient Self-supervised Vision Transformers for Representation Learning
    Li, Chunyuan, Yang, Jianwei, Zhang, Pengchuan, Gao, Mei, Xiao, Bin, Dai, Xiyang, Yuan, Lu, and Gao, Jianfeng
    ICLR 2022
  5. UniCL
    Unified Contrastive Learning in Image-Text-Label Space
    Yang, Jianwei*, Li, Chunyuan*, Zhang, Pengchuan*, Xiao, Bin*, Liu, Ce, Yuan, Lu, and Gao, Jianfeng
    CVPR 2022
  6. GLIP
    Grounded Language-Image Pre-training
    Li, Liunian Harold, Zhang, Pengchuan, Zhang, Haotian, Yang, Jianwei, Li, Chunyuan, Zhong, Yiwu, Wang, Lijuan, Yuan, Lu, Zhang, Lei, Hwang, Jenq-Neng, and others,
    CVPR 2022
  7. LAFITE
    Lafite: Towards Language-Free Training for Text-to-Image Generation
    Zhou, Yufan, Zhang, Ruiyi, Chen, Changyou, Li, Chunyuan, Tensmeyer, Chris, Yu, Tong, Gu, Jiuxiang, Xu, Jinhui, and Sun, Tong
    CVPR 2022
  8. RegionCLIP
    RegionCLIP: Region-based Language-Image Pre-training
    Zhong, Yiwu, Yang, Jianwei, Zhang, Pengchuan, Li, Chunyuan, Codella, Noel, Li, Liunian Harold, Zhou, Luowei, Dai, Xiyang, Yuan, Lu, Li, Yin, and others,
    CPVR 2022

2021

  1. Florence
    Florence: A New Foundation Model for Computer Vision
    Yuan, Lu, Chen, Dongdong, Chen, Yi-Ling, Codella, Noel, Dai, Xiyang, Gao, Jianfeng, Hu, Houdong, Huang, Xuedong, Li, Boxin, Li, Chunyuan, and others,
    arXiv 2021
  2. Focal Transformer
    Focal self-attention for local-global interactions in vision transformers
    Yang, Jianwei, Li, Chunyuan, Zhang, Pengchuan, Dai, Xiyang, Xiao, Bin, Yuan, Lu, and Gao, Jianfeng
    NeurIPS (Spotlight Presentation) 2021
  3. Soloist
    Soloist: Building Task Bots at Scale with Transfer Learning and Machine Teaching
    Peng, Baolin, Li, Chunyuan, Li, Jinchao, Shayandeh, Shahin, Liden, Lars, and Gao, Jianfeng
    Transactions of the Association for Computational Linguistics 2021
  4. Few-shot NER
    Few-Shot Named Entity Recognition: An Empirical Baseline Study
    Huang, Jiaxin, Li, Chunyuan, Subudhi, Krishan, Jose, Damien, Balakrishnan, Shobana, Chen, Weizhu, Peng, Baolin, Gao, Jianfeng, and Han, Jiawei
    In EMNLP 2021

2020

  1. Oscar
    Oscar: Object-semantics aligned pre-training for vision-language tasks
    Li, Xiujun, Yin, Xi, Li, Chunyuan, Zhang, Pengchuan, Hu, Xiaowei, Zhang, Lei, Wang, Lijuan, Hu, Houdong, Dong, Li, Wei, Furu, and others,
    In ECCV 2020
  2. Optimus
    Optimus: Organizing sentences via pre-trained modeling of a latent space
    Li, Chunyuan, Gao, Xiang, Li, Yuan, Peng, Baolin, Li, Xiujun, Zhang, Yizhe, and Gao, Jianfeng
    EMNLP 2020
  3. cSG-MCMC
    Cyclical stochastic gradient MCMC for Bayesian deep learning
    Zhang, Ruqi, Li, Chunyuan, Zhang, Jianyi, Chen, Changyou, and Wilson, Andrew Gordon
    ICLR (Oral Presentation) 2020
  4. Prevalent
    Towards learning a generic agent for vision-and-language navigation via pre-training
    Hao, Weituo, Li, Chunyuan, Li, Xiujun, Carin, Lawrence, and Gao, Jianfeng
    In CVPR 2020

2019

  1. TAC-GAN
    Twin auxiliary classifiers GAN
    Gong, Mingming, Xu, Yanwu, Li, Chunyuan, Zhang, Kun, and Batmanghelich, Kayhan
    NeurIPS (Spotlight Presentation) 2019
  2. Cyclical annealing
    Cyclical annealing schedule: A simple approach to mitigating KL vanishing
    Fu, Hao*, Li, Chunyuan*, Liu, Xiaodong, Gao, Jianfeng, Celikyilmaz, Asli, and Carin, Lawrence
    NAACL 2019

2018

  1. Intrinsic Dim
    Measuring the intrinsic dimension of objective landscapes
    Li, Chunyuan, Farkhoor, Heerad, Liu, Rosanne, and Yosinski, Jason
    ICLR 2018
  2. LEAM
    Joint embedding of words and labels for text classification
    Wang, Guoyin, Li, Chunyuan, Wang, Wenlin, Zhang, Yizhe, Shen, Dinghan, Zhang, Xinyuan, Henao, Ricardo, and Carin, Lawrence
    ACL 2018

2017

  1. ALICE
    Alice: Towards understanding adversarial learning for joint distribution matching
    Li, Chunyuan, Liu, Hao, Chen, Changyou, Pu, Yuchen, Chen, Liqun, Henao, Ricardo, and Carin, Lawrence
    NIPS 2017

2016

  1. Multimodal VAEs
    Variational autoencoder for deep learning of images, labels and captions
    Pu, Yunchen, Gan, Zhe, Henao, Ricardo, Yuan, Xin, Li, Chunyuan, Stevens, Andrew, and Carin, Lawrence
    NIPS 2016
  2. pSGLD
    Preconditioned stochastic gradient Langevin dynamics for deep neural networks
    Li, Chunyuan, Chen, Changyou, Carlson, David, and Carin, Lawrence
    In AAAI (Oral Presentation) 2016
  3. Dropout = SGLD
    Learning weight uncertainty with stochastic gradient mcmc for shape classification
    Li, Chunyuan, Stevens, Andrew, Chen, Changyou, Pu, Yunchen, Gan, Zhe, and Carin, Lawrence
    In CVPR (Spotlight Presentation) 2016

2015

  1. Sequential SBN
    Deep temporal sigmoid belief networks for sequence modeling
    Gan, Zhe, Li, Chunyuan, Henao, Ricardo, Carlson, David, and Carin, Lawrence
    NIPS 2015

2014

  1. TDA for Vision
    Persistence-based structural recognition
    Li, Chunyuan, Ovsjanikov, Maks, and Chazal, Frederic
    In CVPR 2014