publications

Please check out my Google Scholar for more complete and up-to-date publication list.

2022

  1. K-LITE
    K-LITE: Learning Transferable Visual Models with External Knowledge
    Shen, Sheng*, Li, Chunyuan*, Hu, Xiaowei*, Xie, Yujia, Yang, Jianwei, Zhang, Pengchuan, Rohrbach, Anna, Gan, Zhe, Wang, Lijuan, Yuan, Lu, Liu, Ce, Keutzer, Kurt, Darrell, Trevor, and Gao, Jianfeng
    NeurIPS 2022
    PDF
  2. ELEVATER
    ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
    Li, Chunyuan*, Liu, Haotian*, Li, Liunian Harold, Zhang, Pengchuan, Aneja, Jyoti, Yang, Jianwei, Jin, Ping, Lee, Yong Jae, Hu, Houdong, Liu, Zicheng, and Gao, Jianfeng
    NeurIPS (Datasets and Benchmarks Track) 2022
    PDF
  3. FocalNet
    Focal Modulation Networks
    Yang, Jianwei, Li, Chunyuan, and Gao, Jianfeng
    NeurIPS 2022
    PDF Code
  4. EsViT
    Efficient Self-supervised Vision Transformers for Representation Learning
    Li, Chunyuan, Yang, Jianwei, Zhang, Pengchuan, Gao, Mei, Xiao, Bin, Dai, Xiyang, Yuan, Lu, and Gao, Jianfeng
    ICLR 2022
    PDF Code
  5. UniCL
    Unified Contrastive Learning in Image-Text-Label Space
    Yang, Jianwei*, Li, Chunyuan*, Zhang, Pengchuan*, Xiao, Bin*, Liu, Ce, Yuan, Lu, and Gao, Jianfeng
    CVPR 2022
    PDF Code
  6. GLIP
    Grounded Language-Image Pre-training
    Li, Liunian Harold, Zhang, Pengchuan, Zhang, Haotian, Yang, Jianwei, Li, Chunyuan, Zhong, Yiwu, Wang, Lijuan, Yuan, Lu, Zhang, Lei, Hwang, Jenq-Neng, and others,
    CVPR 2022
    PDF Code
  7. LAFITE
    Lafite: Towards Language-Free Training for Text-to-Image Generation
    Zhou, Yufan, Zhang, Ruiyi, Chen, Changyou, Li, Chunyuan, Tensmeyer, Chris, Yu, Tong, Gu, Jiuxiang, Xu, Jinhui, and Sun, Tong
    CVPR 2022
    PDF Code
  8. RegionCLIP
    RegionCLIP: Region-based Language-Image Pre-training
    Zhong, Yiwu, Yang, Jianwei, Zhang, Pengchuan, Li, Chunyuan, Codella, Noel, Li, Liunian Harold, Zhou, Luowei, Dai, Xiyang, Yuan, Lu, Li, Yin, and others,
    CPVR 2022
    PDF Code

2021

  1. Florence
    Florence: A New Foundation Model for Computer Vision
    Yuan, Lu, Chen, Dongdong, Chen, Yi-Ling, Codella, Noel, Dai, Xiyang, Gao, Jianfeng, Hu, Houdong, Huang, Xuedong, Li, Boxin, Li, Chunyuan, and others,
    arXiv 2021
    PDF
  2. Focal Transformer
    Focal self-attention for local-global interactions in vision transformers
    Yang, Jianwei, Li, Chunyuan, Zhang, Pengchuan, Dai, Xiyang, Xiao, Bin, Yuan, Lu, and Gao, Jianfeng
    NeurIPS (Spotlight Presentation) 2021
    PDF Code
  3. Soloist
    Soloist: Building Task Bots at Scale with Transfer Learning and Machine Teaching
    Peng, Baolin, Li, Chunyuan, Li, Jinchao, Shayandeh, Shahin, Liden, Lars, and Gao, Jianfeng
    Transactions of the Association for Computational Linguistics 2021
    PDF Code
  4. Few-shot NER
    Few-Shot Named Entity Recognition: An Empirical Baseline Study
    Huang, Jiaxin, Li, Chunyuan, Subudhi, Krishan, Jose, Damien, Balakrishnan, Shobana, Chen, Weizhu, Peng, Baolin, Gao, Jianfeng, and Han, Jiawei
    In EMNLP 2021
    PDF Code

2020

  1. Oscar
    Oscar: Object-semantics aligned pre-training for vision-language tasks
    Li, Xiujun, Yin, Xi, Li, Chunyuan, Zhang, Pengchuan, Hu, Xiaowei, Zhang, Lei, Wang, Lijuan, Hu, Houdong, Dong, Li, Wei, Furu, and others,
    In ECCV 2020
    PDF Code
  2. Optimus
    Optimus: Organizing sentences via pre-trained modeling of a latent space
    Li, Chunyuan, Gao, Xiang, Li, Yuan, Peng, Baolin, Li, Xiujun, Zhang, Yizhe, and Gao, Jianfeng
    EMNLP 2020
    PDF Code
  3. cSG-MCMC
    Cyclical stochastic gradient MCMC for Bayesian deep learning
    Zhang, Ruqi, Li, Chunyuan, Zhang, Jianyi, Chen, Changyou, and Wilson, Andrew Gordon
    ICLR (Oral Presentation) 2020
    PDF Code
  4. Prevalent
    Towards learning a generic agent for vision-and-language navigation via pre-training
    Hao, Weituo, Li, Chunyuan, Li, Xiujun, Carin, Lawrence, and Gao, Jianfeng
    In CVPR 2020
    PDF Code

2019

  1. TAC-GAN
    Twin auxiliary classifiers GAN
    Gong, Mingming, Xu, Yanwu, Li, Chunyuan, Zhang, Kun, and Batmanghelich, Kayhan
    NeurIPS (Spotlight Presentation) 2019
    PDF Code
  2. Cyclical annealing
    Cyclical annealing schedule: A simple approach to mitigating KL vanishing
    Fu, Hao*, Li, Chunyuan*, Liu, Xiaodong, Gao, Jianfeng, Celikyilmaz, Asli, and Carin, Lawrence
    NAACL 2019
    PDF Code

2018

  1. Intrinsic Dim
    Measuring the intrinsic dimension of objective landscapes
    Li, Chunyuan, Farkhoor, Heerad, Liu, Rosanne, and Yosinski, Jason
    ICLR 2018
    PDF Blog Code
  2. LEAM
    Joint embedding of words and labels for text classification
    Wang, Guoyin, Li, Chunyuan, Wang, Wenlin, Zhang, Yizhe, Shen, Dinghan, Zhang, Xinyuan, Henao, Ricardo, and Carin, Lawrence
    ACL 2018
    PDF Code

2017

  1. ALICE
    Alice: Towards understanding adversarial learning for joint distribution matching
    Li, Chunyuan, Liu, Hao, Chen, Changyou, Pu, Yuchen, Chen, Liqun, Henao, Ricardo, and Carin, Lawrence
    NIPS 2017
    PDF Code

2016

  1. Multimodal VAEs
    Variational autoencoder for deep learning of images, labels and captions
    Pu, Yunchen, Gan, Zhe, Henao, Ricardo, Yuan, Xin, Li, Chunyuan, Stevens, Andrew, and Carin, Lawrence
    NIPS 2016
    PDF
  2. pSGLD
    Preconditioned stochastic gradient Langevin dynamics for deep neural networks
    Li, Chunyuan, Chen, Changyou, Carlson, David, and Carin, Lawrence
    In AAAI (Oral Presentation) 2016
    PDF Code
  3. Dropout = SGLD
    Learning weight uncertainty with stochastic gradient mcmc for shape classification
    Li, Chunyuan, Stevens, Andrew, Chen, Changyou, Pu, Yunchen, Gan, Zhe, and Carin, Lawrence
    In CVPR (Spotlight Presentation) 2016
    PDF Code

2015

  1. Sequential SBN
    Deep temporal sigmoid belief networks for sequence modeling
    Gan, Zhe, Li, Chunyuan, Henao, Ricardo, Carlson, David, and Carin, Lawrence
    NIPS 2015
    PDF

2014

  1. TDA for Vision
    Persistence-based structural recognition
    Li, Chunyuan, Ovsjanikov, Maks, and Chazal, Frederic
    In CVPR 2014
    PDF