Learning Transferable Visual Models From Natural Language Supervision
Radford, Kim, Hallacy, et al.
2021 ICML 2021
TL;DR
Train an image encoder and a text encoder to embed matching (image, caption) pairs nearby in a shared space. Gives zero-shot image classification across thousands of categories.