ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
Paper
•
2602.16609
•
Published
•
5
ColBERT-Zero 🐶
First large-scale fully pre-trained ColBERT model using only public data, outperforming GTE-ModernColBERT and GTE-ModernBERT
-
-
lightonai/ColBERT-Zero
Sentence Similarity • 0.1B • Updated • 55 • 15 -
lightonai/ColBERT-Zero-supervised
Sentence Similarity • 0.1B • Updated • 15 • 2 -
lightonai/ColBERT-Zero-unsupervised
Sentence Similarity • 0.1B • Updated • 16 • 1 -
lightonai/ModernColBERT-embed-base
Sentence Similarity • 0.1B • Updated • 13 -
lightonai/ModernColBERT-embed-base-supervised
Sentence Similarity • 0.1B • Updated • 17 -
lightonai/ModernColBERT-embed-base-kd-only
Sentence Similarity • 0.1B • Updated • 16 • 1 -
lightonai/ColBERT-Zero-noprompts
Sentence Similarity • 0.1B • Updated • 18 • 2 -
lightonai/ColBERT-Zero-supervised-noprompts
Sentence Similarity • 0.1B • Updated • 10 -
lightonai/ColBERT-Zero-unsupervised-noprompts
Sentence Similarity • 0.1B • Updated • 18