THE RESEARCH ATLAS

Learning Transferable Visual Models From Natural Language Supervision

Contrastive training aligns images with natural-language descriptions, enabling transfer to new visual categories.

Alec Radford et al.
2021-02 · OpenAI · Research paper
Source checked: 2026-10-24Credited institutions · OpenAI 🇺🇸 United States
Institution and location sources

Location refers to credited institutions or the listed organization, not author citizenship or an exhaustive collaboration list.

arxiv.org ↗

Why read this

An essential bridge between vision, language and open-vocabulary perception.

Read original source ↗Original PDF ↗

Citation

@misc{radford2021learning,
  title = {Learning Transferable Visual Models From Natural Language Supervision},
  author = {Alec Radford and Jong Wook Kim and Chris Hallacy and Aditya Ramesh and Gabriel Goh and Sandhini Agarwal and Girish Sastry and Amanda Askell and Pamela Mishkin and Jack Clark and Gretchen Krueger and Ilya Sutskever},
  year = {2021},
  eprint = {2103.00020},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2103.00020}
}

Rights remain with the original authors. Refer to the original source for citations and licensing.

Related research

2012 · Academic · Research paperCredited institutions · University of Toronto 🇨🇦 Canada

ImageNet Classification with Deep Convolutional Neural Networks

A deep convolutional network demonstrated how data, GPU computation and learned representations could transform visual recognition.

2020-06 · Academic · Research paperCredited institutions · UC Berkeley 🇺🇸 United States

Denoising Diffusion Probabilistic Models

A generative model learns to reverse a gradual noise process, establishing an influential approach to image synthesis.

2023-03 · OpenAI · Technical reportInstitution base · OpenAI 🇺🇸 United States

GPT-4 Technical Report

The report describes GPT-4’s capabilities, evaluation results and limitations while leaving important training details undisclosed.