ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
Khattab, Zaharia
2020 SIGIR 2020
TL;DR
Keep per-token embeddings for both query and document and score via a sum of max-similarities. Much more expressive than a single-vector dual encoder while still fast enough to index.