Appearance
nomic-ai/Nomic Embed Text v1.5 137M
- License: Apache-2.0
- Release date: Not explicitly documented in the original model card.
- Modalities: Input: text; Output: embeddings
- Original model: nomic-ai/nomic-embed-text-v1.5
Description
Nomic Embed Text v1.5 converts English text into vectors for retrieval, clustering, and classification. Its Matryoshka training allows smaller representations to trade some accuracy for reduced storage. The upstream model supports sequences up to 8192 tokens and full 768-dimensional vectors.
Run
bash
self serve nomic-embed-text-v1.5:137mHere is a link to the API docs: Embeddings API.
Example Request
With the server running, open another terminal and send a request:
bash
curl http://localhost:8080/v1/embeddings \
-H 'Content-Type: application/json' \
-d '{"input":"search_query: What is semantic search?"}'The server returns a JSON response containing the embedding vector.
Engine Parameters
Served by the upstream llama-server through the embedding adapter. These are startup settings, not per-request API fields. Settings not specified in the registry are left to the bundled engine's defaults.
| Parameter | Default | What it controls |
|---|---|---|
context_size | 8192 | Engine context size in tokens; accepts integers from 512 to 1048576. The adapter range is not a guarantee of model support. |
pooling | mean | Embedding pooling; accepts none, mean, cls, last, or rank. Keep mean for this model's sentence embeddings. |
threads | Engine default (not set in registry) | Number of CPU workers; accepts integers from 1 to 1024. |
gpu_layers | Engine default (not set in registry) | Layers offloaded to GPU; accepts integers from -1 to 10000, with -1 meaning all layers. |
flash_attn | Engine default (not set in registry) | Flash Attention mode: auto, on, or off; availability depends on the backend and model. |
parallel | Engine default (not set in registry) | Number of parallel engine slots; accepts integers from 1 to 256. |
Override startup settings with --set <parameter>=<value>.
Quantizations and Files
Default variant: q4. Sizes and SHA-256 hashes are pinned in the model registry.
q4 (default)
| File | Role | Size | SHA-256 | Origin |
|---|---|---|---|---|
nomic-embed-text-v1.5.Q4_K_M.gguf | model | 80.2 MiB (84106624 bytes) | d4e388894e09cf3816e8b0896d81d265b55e7a9fff9ab03fe8bf4ef5e11295ac | nomic-ai/nomic-embed-text-v1.5-GGUF |
Total download: 80.2 MiB (84106624 bytes).
Notes
- Task prefixes are required: use
search_query:for retrieval queries andsearch_document:for indexed documents. For other tasks, useclustering:orclassification:as documented upstream. Include the prefix in every input string; the adapter does not add it. - The API returns full vectors and does not support the
dimensionsrequest field. For downstream Matryoshka reduction, follow the upstream procedure: layer-normalize the full vector, truncate to the desired dimension, then L2-normalize. Process queries and documents consistently. - Download size is not the total runtime memory requirement.
- The origin link uses
mainbecause the registry pins the file hash, not a repository revision.
Quality benchmarks
MTEB: Listed; rank not imported
nomic-ai/nomic-embed-text-v1.5
Registered in MTEB; no suite-specific rank imported
Checked 2026-10-13
Hugging Face model-card evaluations: Publisher-reported
nomic-ai/nomic-embed-text-v1.5
Publisher-reported upstream checkpoint; not an independent rank or local quantization
Checked 2026-10-13
| Dataset | Metric | Score |
|---|---|---|
| MTEB AmazonCounterfactualClassification (en) (test) | accuracy | 75.21 |
| MTEB AmazonCounterfactualClassification (en) (test) | ap | 38.58 |
| MTEB AmazonCounterfactualClassification (en) (test) | f1 | 69.36 |
| MTEB AmazonPolarityClassification (test) | accuracy | 91.81 |
| MTEB AmazonPolarityClassification (test) | ap | 88.65 |
| MTEB AmazonPolarityClassification (test) | f1 | 91.80 |
| MTEB AmazonReviewsClassification (en) (test) | accuracy | 47.16 |
| MTEB AmazonReviewsClassification (en) (test) | f1 | 46.59 |
| MTEB ArguAna (test) | map_at_1 | 24.25 |
| MTEB ArguAna (test) | map_at_10 | 38.96 |
| MTEB ArguAna (test) | map_at_100 | 40.08 |
| MTEB ArguAna (test) | map_at_1000 | 40.09 |
| MTEB ArguAna (test) | map_at_3 | 33.50 |
| MTEB ArguAna (test) | map_at_5 | 36.35 |
| MTEB ArguAna (test) | mrr_at_1 | 24.61 |
| MTEB ArguAna (test) | mrr_at_10 | 39.10 |
| MTEB ArguAna (test) | mrr_at_100 | 40.21 |
| MTEB ArguAna (test) | mrr_at_1000 | 40.22 |
| MTEB ArguAna (test) | mrr_at_3 | 33.68 |
| MTEB ArguAna (test) | mrr_at_5 | 36.47 |
| MTEB ArguAna (test) | ndcg_at_1 | 24.25 |
| MTEB ArguAna (test) | ndcg_at_10 | 48.01 |
| MTEB ArguAna (test) | ndcg_at_100 | 52.76 |
| MTEB ArguAna (test) | ndcg_at_1000 | 52.96 |
| MTEB ArguAna (test) | ndcg_at_3 | 36.56 |
| MTEB ArguAna (test) | ndcg_at_5 | 41.71 |
| MTEB ArguAna (test) | precision_at_1 | 24.25 |
| MTEB ArguAna (test) | precision_at_10 | 7.74 |
| MTEB ArguAna (test) | precision_at_100 | 0.98 |
| MTEB ArguAna (test) | precision_at_1000 | 0.10 |
| MTEB ArguAna (test) | precision_at_3 | 15.15 |
| MTEB ArguAna (test) | precision_at_5 | 11.59 |
| MTEB ArguAna (test) | recall_at_1 | 24.25 |
| MTEB ArguAna (test) | recall_at_10 | 77.38 |
| MTEB ArguAna (test) | recall_at_100 | 98.01 |
| MTEB ArguAna (test) | recall_at_1000 | 99.64 |
| MTEB ArguAna (test) | recall_at_3 | 45.45 |
| MTEB ArguAna (test) | recall_at_5 | 57.97 |
| MTEB ArxivClusteringP2P (test) | v_measure | 45.69 |
| MTEB ArxivClusteringS2S (test) | v_measure | 36.35 |
| MTEB AskUbuntuDupQuestions (test) | map | 61.71 |
| MTEB AskUbuntuDupQuestions (test) | mrr | 76.06 |
| MTEB BIOSSES (test) | cos_sim_pearson | 86.74 |
| MTEB BIOSSES (test) | cos_sim_spearman | 84.25 |
| MTEB BIOSSES (test) | euclidean_pearson | 85.85 |
| MTEB BIOSSES (test) | euclidean_spearman | 84.25 |
| MTEB BIOSSES (test) | manhattan_pearson | 86.27 |
| MTEB BIOSSES (test) | manhattan_spearman | 84.56 |
| MTEB Banking77Classification (test) | accuracy | 84.25 |
| MTEB Banking77Classification (test) | f1 | 84.18 |
| MTEB BiorxivClusteringP2P (test) | v_measure | 38.77 |
| MTEB BiorxivClusteringS2S (test) | v_measure | 32.94 |
| MTEB CQADupstackAndroidRetrieval (test) | map_at_1 | 32.16 |
| MTEB CQADupstackAndroidRetrieval (test) | map_at_10 | 42.64 |
| MTEB CQADupstackAndroidRetrieval (test) | map_at_100 | 43.95 |
| MTEB CQADupstackAndroidRetrieval (test) | map_at_1000 | 44.07 |
| MTEB CQADupstackAndroidRetrieval (test) | map_at_3 | 39.59 |
| MTEB CQADupstackAndroidRetrieval (test) | map_at_5 | 41.20 |
| MTEB CQADupstackAndroidRetrieval (test) | mrr_at_1 | 39.63 |
| MTEB CQADupstackAndroidRetrieval (test) | mrr_at_10 | 48.63 |
| MTEB CQADupstackAndroidRetrieval (test) | mrr_at_100 | 49.37 |
| MTEB CQADupstackAndroidRetrieval (test) | mrr_at_1000 | 49.41 |
| MTEB CQADupstackAndroidRetrieval (test) | mrr_at_3 | 46.40 |
| MTEB CQADupstackAndroidRetrieval (test) | mrr_at_5 | 47.68 |
| MTEB CQADupstackAndroidRetrieval (test) | ndcg_at_1 | 39.63 |
| MTEB CQADupstackAndroidRetrieval (test) | ndcg_at_10 | 48.56 |
| MTEB CQADupstackAndroidRetrieval (test) | ndcg_at_100 | 53.51 |
| MTEB CQADupstackAndroidRetrieval (test) | ndcg_at_1000 | 55.64 |
| MTEB CQADupstackAndroidRetrieval (test) | ndcg_at_3 | 44.47 |
| MTEB CQADupstackAndroidRetrieval (test) | ndcg_at_5 | 46.14 |
| MTEB CQADupstackAndroidRetrieval (test) | precision_at_1 | 39.63 |
| MTEB CQADupstackAndroidRetrieval (test) | precision_at_10 | 8.86 |
| MTEB CQADupstackAndroidRetrieval (test) | precision_at_100 | 1.43 |
| MTEB CQADupstackAndroidRetrieval (test) | precision_at_1000 | 0.19 |
| MTEB CQADupstackAndroidRetrieval (test) | precision_at_3 | 21.27 |
| MTEB CQADupstackAndroidRetrieval (test) | precision_at_5 | 14.65 |
| MTEB CQADupstackAndroidRetrieval (test) | recall_at_1 | 32.16 |
| MTEB CQADupstackAndroidRetrieval (test) | recall_at_10 | 59.61 |
| MTEB CQADupstackAndroidRetrieval (test) | recall_at_100 | 80.52 |
| MTEB CQADupstackAndroidRetrieval (test) | recall_at_1000 | 94.25 |
| MTEB CQADupstackAndroidRetrieval (test) | recall_at_3 | 46.52 |
| MTEB CQADupstackAndroidRetrieval (test) | recall_at_5 | 52.08 |
| MTEB CQADupstackEnglishRetrieval (test) | map_at_1 | 31.53 |
| MTEB CQADupstackEnglishRetrieval (test) | map_at_10 | 41.58 |
| MTEB CQADupstackEnglishRetrieval (test) | map_at_100 | 42.82 |
| MTEB CQADupstackEnglishRetrieval (test) | map_at_1000 | 42.94 |
| MTEB CQADupstackEnglishRetrieval (test) | map_at_3 | 38.61 |
| MTEB CQADupstackEnglishRetrieval (test) | map_at_5 | 40.35 |
| MTEB CQADupstackEnglishRetrieval (test) | mrr_at_1 | 39.49 |
| MTEB CQADupstackEnglishRetrieval (test) | mrr_at_10 | 47.83 |
| MTEB CQADupstackEnglishRetrieval (test) | mrr_at_100 | 48.51 |
| MTEB CQADupstackEnglishRetrieval (test) | mrr_at_1000 | 48.55 |
| MTEB CQADupstackEnglishRetrieval (test) | mrr_at_3 | 45.75 |
| MTEB CQADupstackEnglishRetrieval (test) | mrr_at_5 | 46.99 |
| MTEB CQADupstackEnglishRetrieval (test) | ndcg_at_1 | 39.49 |
| MTEB CQADupstackEnglishRetrieval (test) | ndcg_at_10 | 47.27 |
| MTEB CQADupstackEnglishRetrieval (test) | ndcg_at_100 | 51.56 |
| MTEB CQADupstackEnglishRetrieval (test) | ndcg_at_1000 | 53.53 |
| MTEB CQADupstackEnglishRetrieval (test) | ndcg_at_3 | 43.30 |
| MTEB CQADupstackEnglishRetrieval (test) | ndcg_at_5 | 45.24 |
| MTEB CQADupstackEnglishRetrieval (test) | precision_at_1 | 39.49 |
| MTEB CQADupstackEnglishRetrieval (test) | precision_at_10 | 8.93 |
| MTEB CQADupstackEnglishRetrieval (test) | precision_at_100 | 1.42 |
| MTEB CQADupstackEnglishRetrieval (test) | precision_at_1000 | 0.19 |
| MTEB CQADupstackEnglishRetrieval (test) | precision_at_3 | 20.89 |
| MTEB CQADupstackEnglishRetrieval (test) | precision_at_5 | 14.87 |
| MTEB CQADupstackEnglishRetrieval (test) | recall_at_1 | 31.53 |
| MTEB CQADupstackEnglishRetrieval (test) | recall_at_10 | 56.76 |
| MTEB CQADupstackEnglishRetrieval (test) | recall_at_100 | 75.03 |
| MTEB CQADupstackEnglishRetrieval (test) | recall_at_1000 | 87.49 |
| MTEB CQADupstackEnglishRetrieval (test) | recall_at_3 | 44.79 |
| MTEB CQADupstackEnglishRetrieval (test) | recall_at_5 | 50.25 |
| MTEB CQADupstackGamingRetrieval (test) | map_at_1 | 40.99 |
| MTEB CQADupstackGamingRetrieval (test) | map_at_10 | 52.83 |
| MTEB CQADupstackGamingRetrieval (test) | map_at_100 | 53.75 |
| MTEB CQADupstackGamingRetrieval (test) | map_at_1000 | 53.81 |
| MTEB CQADupstackGamingRetrieval (test) | map_at_3 | 49.84 |
| MTEB CQADupstackGamingRetrieval (test) | map_at_5 | 51.47 |
| MTEB CQADupstackGamingRetrieval (test) | mrr_at_1 | 46.83 |
| MTEB CQADupstackGamingRetrieval (test) | mrr_at_10 | 56.39 |
| MTEB CQADupstackGamingRetrieval (test) | mrr_at_100 | 57.00 |
| MTEB CQADupstackGamingRetrieval (test) | mrr_at_1000 | 57.03 |
| MTEB CQADupstackGamingRetrieval (test) | mrr_at_3 | 54.18 |
| MTEB CQADupstackGamingRetrieval (test) | mrr_at_5 | 55.49 |
| MTEB CQADupstackGamingRetrieval (test) | ndcg_at_1 | 46.83 |
| MTEB CQADupstackGamingRetrieval (test) | ndcg_at_10 | 58.37 |
| MTEB CQADupstackGamingRetrieval (test) | ndcg_at_100 | 62.07 |
| MTEB CQADupstackGamingRetrieval (test) | ndcg_at_1000 | 63.29 |
| MTEB CQADupstackGamingRetrieval (test) | ndcg_at_3 | 53.40 |
| MTEB CQADupstackGamingRetrieval (test) | ndcg_at_5 | 55.77 |
| MTEB CQADupstackGamingRetrieval (test) | precision_at_1 | 46.83 |
| MTEB CQADupstackGamingRetrieval (test) | precision_at_10 | 9.19 |
| MTEB CQADupstackGamingRetrieval (test) | precision_at_100 | 1.19 |
| MTEB CQADupstackGamingRetrieval (test) | precision_at_1000 | 0.13 |
| MTEB CQADupstackGamingRetrieval (test) | precision_at_3 | 23.45 |
| MTEB CQADupstackGamingRetrieval (test) | precision_at_5 | 15.86 |
| MTEB CQADupstackGamingRetrieval (test) | recall_at_1 | 40.99 |
| MTEB CQADupstackGamingRetrieval (test) | recall_at_10 | 71.15 |
| MTEB CQADupstackGamingRetrieval (test) | recall_at_100 | 87.03 |
| MTEB CQADupstackGamingRetrieval (test) | recall_at_1000 | 95.63 |
| MTEB CQADupstackGamingRetrieval (test) | recall_at_3 | 58.03 |
| MTEB CQADupstackGamingRetrieval (test) | recall_at_5 | 63.82 |
| MTEB CQADupstackGisRetrieval (test) | map_at_1 | 24.59 |
| MTEB CQADupstackGisRetrieval (test) | map_at_10 | 33.11 |
| MTEB CQADupstackGisRetrieval (test) | map_at_100 | 34.04 |
| MTEB CQADupstackGisRetrieval (test) | map_at_1000 | 34.12 |
| MTEB CQADupstackGisRetrieval (test) | map_at_3 | 30.45 |
| MTEB CQADupstackGisRetrieval (test) | map_at_5 | 31.81 |
| MTEB CQADupstackGisRetrieval (test) | mrr_at_1 | 26.55 |
| MTEB CQADupstackGisRetrieval (test) | mrr_at_10 | 35.15 |
| MTEB CQADupstackGisRetrieval (test) | mrr_at_100 | 35.93 |
| MTEB CQADupstackGisRetrieval (test) | mrr_at_1000 | 35.99 |
| MTEB CQADupstackGisRetrieval (test) | mrr_at_3 | 32.60 |
| MTEB CQADupstackGisRetrieval (test) | mrr_at_5 | 33.89 |
| MTEB CQADupstackGisRetrieval (test) | ndcg_at_1 | 26.55 |
| MTEB CQADupstackGisRetrieval (test) | ndcg_at_10 | 38.13 |
| MTEB CQADupstackGisRetrieval (test) | ndcg_at_100 | 42.78 |
| MTEB CQADupstackGisRetrieval (test) | ndcg_at_1000 | 44.92 |
| MTEB CQADupstackGisRetrieval (test) | ndcg_at_3 | 32.83 |
| MTEB CQADupstackGisRetrieval (test) | ndcg_at_5 | 35.17 |
| MTEB CQADupstackGisRetrieval (test) | precision_at_1 | 26.55 |
| MTEB CQADupstackGisRetrieval (test) | precision_at_10 | 5.92 |
| MTEB CQADupstackGisRetrieval (test) | precision_at_100 | 0.87 |
| MTEB CQADupstackGisRetrieval (test) | precision_at_1000 | 0.11 |
| MTEB CQADupstackGisRetrieval (test) | precision_at_3 | 13.86 |
| MTEB CQADupstackGisRetrieval (test) | precision_at_5 | 9.61 |
| MTEB CQADupstackGisRetrieval (test) | recall_at_1 | 24.59 |
| MTEB CQADupstackGisRetrieval (test) | recall_at_10 | 51.69 |
| MTEB CQADupstackGisRetrieval (test) | recall_at_100 | 73.43 |
| MTEB CQADupstackGisRetrieval (test) | recall_at_1000 | 89.55 |
| MTEB CQADupstackGisRetrieval (test) | recall_at_3 | 37.34 |
| MTEB CQADupstackGisRetrieval (test) | recall_at_5 | 43.05 |
| MTEB CQADupstackMathematicaRetrieval (test) | map_at_1 | 16.71 |
| MTEB CQADupstackMathematicaRetrieval (test) | map_at_10 | 24.25 |
| MTEB CQADupstackMathematicaRetrieval (test) | map_at_100 | 25.33 |
| MTEB CQADupstackMathematicaRetrieval (test) | map_at_1000 | 25.45 |
| MTEB CQADupstackMathematicaRetrieval (test) | map_at_3 | 21.91 |
| MTEB CQADupstackMathematicaRetrieval (test) | map_at_5 | 23.26 |
| MTEB CQADupstackMathematicaRetrieval (test) | mrr_at_1 | 20.27 |
| MTEB CQADupstackMathematicaRetrieval (test) | mrr_at_10 | 28.55 |
| MTEB CQADupstackMathematicaRetrieval (test) | mrr_at_100 | 29.42 |
| MTEB CQADupstackMathematicaRetrieval (test) | mrr_at_1000 | 29.50 |
| MTEB CQADupstackMathematicaRetrieval (test) | mrr_at_3 | 26.14 |
| MTEB CQADupstackMathematicaRetrieval (test) | mrr_at_5 | 27.50 |
| MTEB CQADupstackMathematicaRetrieval (test) | ndcg_at_1 | 20.27 |
| MTEB CQADupstackMathematicaRetrieval (test) | ndcg_at_10 | 29.09 |
| MTEB CQADupstackMathematicaRetrieval (test) | ndcg_at_100 | 34.29 |
| MTEB CQADupstackMathematicaRetrieval (test) | ndcg_at_1000 | 37.27 |
| MTEB CQADupstackMathematicaRetrieval (test) | ndcg_at_3 | 24.71 |
| MTEB CQADupstackMathematicaRetrieval (test) | ndcg_at_5 | 26.81 |
| MTEB CQADupstackMathematicaRetrieval (test) | precision_at_1 | 20.27 |
| MTEB CQADupstackMathematicaRetrieval (test) | precision_at_10 | 5.36 |
| MTEB CQADupstackMathematicaRetrieval (test) | precision_at_100 | 0.92 |
| MTEB CQADupstackMathematicaRetrieval (test) | precision_at_1000 | 0.13 |
| MTEB CQADupstackMathematicaRetrieval (test) | precision_at_3 | 11.73 |
| MTEB CQADupstackMathematicaRetrieval (test) | precision_at_5 | 8.56 |
| MTEB CQADupstackMathematicaRetrieval (test) | recall_at_1 | 16.71 |
| MTEB CQADupstackMathematicaRetrieval (test) | recall_at_10 | 39.59 |
| MTEB CQADupstackMathematicaRetrieval (test) | recall_at_100 | 62.34 |
| MTEB CQADupstackMathematicaRetrieval (test) | recall_at_1000 | 83.45 |
| MTEB CQADupstackMathematicaRetrieval (test) | recall_at_3 | 27.84 |
| MTEB CQADupstackMathematicaRetrieval (test) | recall_at_5 | 32.95 |
| MTEB CQADupstackPhysicsRetrieval (test) | map_at_1 | 28.79 |
| MTEB CQADupstackPhysicsRetrieval (test) | map_at_10 | 38.58 |
| MTEB CQADupstackPhysicsRetrieval (test) | map_at_100 | 39.88 |
| MTEB CQADupstackPhysicsRetrieval (test) | map_at_1000 | 39.99 |
| MTEB CQADupstackPhysicsRetrieval (test) | map_at_3 | 35.85 |
| MTEB CQADupstackPhysicsRetrieval (test) | map_at_5 | 37.29 |
| MTEB CQADupstackPhysicsRetrieval (test) | mrr_at_1 | 34.46 |
| MTEB CQADupstackPhysicsRetrieval (test) | mrr_at_10 | 43.91 |
| MTEB CQADupstackPhysicsRetrieval (test) | mrr_at_100 | 44.74 |
| MTEB CQADupstackPhysicsRetrieval (test) | mrr_at_1000 | 44.79 |
| MTEB CQADupstackPhysicsRetrieval (test) | mrr_at_3 | 41.66 |
| MTEB CQADupstackPhysicsRetrieval (test) | mrr_at_5 | 43.01 |
| MTEB CQADupstackPhysicsRetrieval (test) | ndcg_at_1 | 34.46 |
| MTEB CQADupstackPhysicsRetrieval (test) | ndcg_at_10 | 44.27 |
| MTEB CQADupstackPhysicsRetrieval (test) | ndcg_at_100 | 49.64 |
| MTEB CQADupstackPhysicsRetrieval (test) | ndcg_at_1000 | 51.64 |
| MTEB CQADupstackPhysicsRetrieval (test) | ndcg_at_3 | 39.87 |
| MTEB CQADupstackPhysicsRetrieval (test) | ndcg_at_5 | 41.89 |
| MTEB CQADupstackPhysicsRetrieval (test) | precision_at_1 | 34.46 |
| MTEB CQADupstackPhysicsRetrieval (test) | precision_at_10 | 7.84 |
| MTEB CQADupstackPhysicsRetrieval (test) | precision_at_100 | 1.24 |
| MTEB CQADupstackPhysicsRetrieval (test) | precision_at_1000 | 0.16 |
| MTEB CQADupstackPhysicsRetrieval (test) | precision_at_3 | 18.83 |
| MTEB CQADupstackPhysicsRetrieval (test) | precision_at_5 | 13.15 |
| MTEB CQADupstackPhysicsRetrieval (test) | recall_at_1 | 28.79 |
| MTEB CQADupstackPhysicsRetrieval (test) | recall_at_10 | 55.68 |
| MTEB CQADupstackPhysicsRetrieval (test) | recall_at_100 | 77.99 |
| MTEB CQADupstackPhysicsRetrieval (test) | recall_at_1000 | 91.18 |
| MTEB CQADupstackPhysicsRetrieval (test) | recall_at_3 | 43.29 |
| MTEB CQADupstackPhysicsRetrieval (test) | recall_at_5 | 48.62 |
| MTEB CQADupstackProgrammersRetrieval (test) | map_at_1 | 25.91 |
| MTEB CQADupstackProgrammersRetrieval (test) | map_at_10 | 35.52 |
| MTEB CQADupstackProgrammersRetrieval (test) | map_at_100 | 36.81 |
| MTEB CQADupstackProgrammersRetrieval (test) | map_at_1000 | 36.91 |
| MTEB CQADupstackProgrammersRetrieval (test) | map_at_3 | 32.75 |
| MTEB CQADupstackProgrammersRetrieval (test) | map_at_5 | 34.23 |
| MTEB CQADupstackProgrammersRetrieval (test) | mrr_at_1 | 31.62 |
| MTEB CQADupstackProgrammersRetrieval (test) | mrr_at_10 | 40.69 |
| MTEB CQADupstackProgrammersRetrieval (test) | mrr_at_100 | 41.58 |
| MTEB CQADupstackProgrammersRetrieval (test) | mrr_at_1000 | 41.64 |
| MTEB CQADupstackProgrammersRetrieval (test) | mrr_at_3 | 38.53 |
| MTEB CQADupstackProgrammersRetrieval (test) | mrr_at_5 | 39.61 |
| MTEB CQADupstackProgrammersRetrieval (test) | ndcg_at_1 | 31.62 |
| MTEB CQADupstackProgrammersRetrieval (test) | ndcg_at_10 | 41.00 |
| MTEB CQADupstackProgrammersRetrieval (test) | ndcg_at_100 | 46.62 |
| MTEB CQADupstackProgrammersRetrieval (test) | ndcg_at_1000 | 48.82 |
| MTEB CQADupstackProgrammersRetrieval (test) | ndcg_at_3 | 36.54 |
| MTEB CQADupstackProgrammersRetrieval (test) | ndcg_at_5 | 38.37 |
| MTEB CQADupstackProgrammersRetrieval (test) | precision_at_1 | 31.62 |
| MTEB CQADupstackProgrammersRetrieval (test) | precision_at_10 | 7.40 |
| MTEB CQADupstackProgrammersRetrieval (test) | precision_at_100 | 1.19 |
| MTEB CQADupstackProgrammersRetrieval (test) | precision_at_1000 | 0.15 |
| MTEB CQADupstackProgrammersRetrieval (test) | precision_at_3 | 17.39 |
| MTEB CQADupstackProgrammersRetrieval (test) | precision_at_5 | 12.10 |
| MTEB CQADupstackProgrammersRetrieval (test) | recall_at_1 | 25.91 |
| MTEB CQADupstackProgrammersRetrieval (test) | recall_at_10 | 52.12 |
| MTEB CQADupstackProgrammersRetrieval (test) | recall_at_100 | 76.24 |
| MTEB CQADupstackProgrammersRetrieval (test) | recall_at_1000 | 91.22 |
| MTEB CQADupstackProgrammersRetrieval (test) | recall_at_3 | 39.42 |
| MTEB CQADupstackProgrammersRetrieval (test) | recall_at_5 | 44.44 |
| MTEB CQADupstackRetrieval (test) | map_at_1 | 25.73 |
| MTEB CQADupstackRetrieval (test) | map_at_10 | 34.52 |
| MTEB CQADupstackRetrieval (test) | map_at_100 | 35.67 |
| MTEB CQADupstackRetrieval (test) | map_at_1000 | 35.79 |
| MTEB CQADupstackRetrieval (test) | map_at_3 | 31.95 |
| MTEB CQADupstackRetrieval (test) | map_at_5 | 33.33 |
| MTEB CQADupstackRetrieval (test) | mrr_at_1 | 30.30 |
| MTEB CQADupstackRetrieval (test) | mrr_at_10 | 38.63 |
| MTEB CQADupstackRetrieval (test) | mrr_at_100 | 39.46 |
| MTEB CQADupstackRetrieval (test) | mrr_at_1000 | 39.52 |
| MTEB CQADupstackRetrieval (test) | mrr_at_3 | 36.41 |
| MTEB CQADupstackRetrieval (test) | mrr_at_5 | 37.64 |
| MTEB CQADupstackRetrieval (test) | ndcg_at_1 | 30.30 |
| MTEB CQADupstackRetrieval (test) | ndcg_at_10 | 39.61 |
| MTEB CQADupstackRetrieval (test) | ndcg_at_100 | 44.61 |
| MTEB CQADupstackRetrieval (test) | ndcg_at_1000 | 46.92 |
| MTEB CQADupstackRetrieval (test) | ndcg_at_3 | 35.27 |
| MTEB CQADupstackRetrieval (test) | ndcg_at_5 | 37.22 |
| MTEB CQADupstackRetrieval (test) | precision_at_1 | 30.30 |
| MTEB CQADupstackRetrieval (test) | precision_at_10 | 6.84 |
| MTEB CQADupstackRetrieval (test) | precision_at_100 | 1.10 |
| MTEB CQADupstackRetrieval (test) | precision_at_1000 | 0.15 |
| MTEB CQADupstackRetrieval (test) | precision_at_3 | 16.14 |
| MTEB CQADupstackRetrieval (test) | precision_at_5 | 11.28 |
| MTEB CQADupstackRetrieval (test) | recall_at_1 | 25.73 |
| MTEB CQADupstackRetrieval (test) | recall_at_10 | 50.58 |
| MTEB CQADupstackRetrieval (test) | recall_at_100 | 72.42 |
| MTEB CQADupstackRetrieval (test) | recall_at_1000 | 88.49 |
| MTEB CQADupstackRetrieval (test) | recall_at_3 | 38.41 |
| MTEB CQADupstackRetrieval (test) | recall_at_5 | 43.52 |
| MTEB CQADupstackStatsRetrieval (test) | map_at_1 | 23.95 |
| MTEB CQADupstackStatsRetrieval (test) | map_at_10 | 30.97 |
| MTEB CQADupstackStatsRetrieval (test) | map_at_100 | 31.80 |
| MTEB CQADupstackStatsRetrieval (test) | map_at_1000 | 31.90 |
| MTEB CQADupstackStatsRetrieval (test) | map_at_3 | 28.76 |
| MTEB CQADupstackStatsRetrieval (test) | map_at_5 | 29.94 |
| MTEB CQADupstackStatsRetrieval (test) | mrr_at_1 | 26.53 |
| MTEB CQADupstackStatsRetrieval (test) | mrr_at_10 | 33.55 |
| MTEB CQADupstackStatsRetrieval (test) | mrr_at_100 | 34.30 |
| MTEB CQADupstackStatsRetrieval (test) | mrr_at_1000 | 34.36 |
| MTEB CQADupstackStatsRetrieval (test) | mrr_at_3 | 31.39 |
| MTEB CQADupstackStatsRetrieval (test) | mrr_at_5 | 32.53 |
| MTEB CQADupstackStatsRetrieval (test) | ndcg_at_1 | 26.53 |
| MTEB CQADupstackStatsRetrieval (test) | ndcg_at_10 | 35.11 |
| MTEB CQADupstackStatsRetrieval (test) | ndcg_at_100 | 39.28 |
| MTEB CQADupstackStatsRetrieval (test) | ndcg_at_1000 | 41.72 |
| MTEB CQADupstackStatsRetrieval (test) | ndcg_at_3 | 30.90 |
| MTEB CQADupstackStatsRetrieval (test) | ndcg_at_5 | 32.76 |
| MTEB CQADupstackStatsRetrieval (test) | precision_at_1 | 26.53 |
| MTEB CQADupstackStatsRetrieval (test) | precision_at_10 | 5.45 |
| MTEB CQADupstackStatsRetrieval (test) | precision_at_100 | 0.82 |
| MTEB CQADupstackStatsRetrieval (test) | precision_at_1000 | 0.11 |
| MTEB CQADupstackStatsRetrieval (test) | precision_at_3 | 12.99 |
| MTEB CQADupstackStatsRetrieval (test) | precision_at_5 | 9.05 |
| MTEB CQADupstackStatsRetrieval (test) | recall_at_1 | 23.95 |
| MTEB CQADupstackStatsRetrieval (test) | recall_at_10 | 45.24 |
| MTEB CQADupstackStatsRetrieval (test) | recall_at_100 | 64.12 |
| MTEB CQADupstackStatsRetrieval (test) | recall_at_1000 | 82.29 |
| MTEB CQADupstackStatsRetrieval (test) | recall_at_3 | 33.81 |
| MTEB CQADupstackStatsRetrieval (test) | recall_at_5 | 38.28 |
| MTEB CQADupstackTexRetrieval (test) | map_at_1 | 16.83 |
| MTEB CQADupstackTexRetrieval (test) | map_at_10 | 23.68 |
| MTEB CQADupstackTexRetrieval (test) | map_at_100 | 24.68 |
| MTEB CQADupstackTexRetrieval (test) | map_at_1000 | 24.81 |
| MTEB CQADupstackTexRetrieval (test) | map_at_3 | 21.55 |
| MTEB CQADupstackTexRetrieval (test) | map_at_5 | 22.77 |
| MTEB CQADupstackTexRetrieval (test) | mrr_at_1 | 20.10 |
| MTEB CQADupstackTexRetrieval (test) | mrr_at_10 | 27.23 |
| MTEB CQADupstackTexRetrieval (test) | mrr_at_100 | 28.08 |
| MTEB CQADupstackTexRetrieval (test) | mrr_at_1000 | 28.17 |
| MTEB CQADupstackTexRetrieval (test) | mrr_at_3 | 25.21 |
| MTEB CQADupstackTexRetrieval (test) | mrr_at_5 | 26.32 |
| MTEB CQADupstackTexRetrieval (test) | ndcg_at_1 | 20.10 |
| MTEB CQADupstackTexRetrieval (test) | ndcg_at_10 | 27.99 |
| MTEB CQADupstackTexRetrieval (test) | ndcg_at_100 | 32.85 |
| MTEB CQADupstackTexRetrieval (test) | ndcg_at_1000 | 35.90 |
| MTEB CQADupstackTexRetrieval (test) | ndcg_at_3 | 24.12 |
| MTEB CQADupstackTexRetrieval (test) | ndcg_at_5 | 25.96 |
| MTEB CQADupstackTexRetrieval (test) | precision_at_1 | 20.10 |
| MTEB CQADupstackTexRetrieval (test) | precision_at_10 | 5.00 |
| MTEB CQADupstackTexRetrieval (test) | precision_at_100 | 0.88 |
| MTEB CQADupstackTexRetrieval (test) | precision_at_1000 | 0.13 |
| MTEB CQADupstackTexRetrieval (test) | precision_at_3 | 11.21 |
| MTEB CQADupstackTexRetrieval (test) | precision_at_5 | 8.08 |
| MTEB CQADupstackTexRetrieval (test) | recall_at_1 | 16.83 |
| MTEB CQADupstackTexRetrieval (test) | recall_at_10 | 37.41 |
| MTEB CQADupstackTexRetrieval (test) | recall_at_100 | 59.10 |
| MTEB CQADupstackTexRetrieval (test) | recall_at_1000 | 81.02 |
| MTEB CQADupstackTexRetrieval (test) | recall_at_3 | 26.74 |
| MTEB CQADupstackTexRetrieval (test) | recall_at_5 | 31.52 |
| MTEB CQADupstackUnixRetrieval (test) | map_at_1 | 24.14 |
| MTEB CQADupstackUnixRetrieval (test) | map_at_10 | 32.28 |
| MTEB CQADupstackUnixRetrieval (test) | map_at_100 | 33.42 |
| MTEB CQADupstackUnixRetrieval (test) | map_at_1000 | 33.53 |
| MTEB CQADupstackUnixRetrieval (test) | map_at_3 | 29.85 |
| MTEB CQADupstackUnixRetrieval (test) | map_at_5 | 31.10 |
| MTEB CQADupstackUnixRetrieval (test) | mrr_at_1 | 28.45 |
| MTEB CQADupstackUnixRetrieval (test) | mrr_at_10 | 36.21 |
| MTEB CQADupstackUnixRetrieval (test) | mrr_at_100 | 37.13 |
| MTEB CQADupstackUnixRetrieval (test) | mrr_at_1000 | 37.20 |
| MTEB CQADupstackUnixRetrieval (test) | mrr_at_3 | 34.00 |
| MTEB CQADupstackUnixRetrieval (test) | mrr_at_5 | 35.19 |
| MTEB CQADupstackUnixRetrieval (test) | ndcg_at_1 | 28.45 |
| MTEB CQADupstackUnixRetrieval (test) | ndcg_at_10 | 37.17 |
| MTEB CQADupstackUnixRetrieval (test) | ndcg_at_100 | 42.45 |
| MTEB CQADupstackUnixRetrieval (test) | ndcg_at_1000 | 44.98 |
| MTEB CQADupstackUnixRetrieval (test) | ndcg_at_3 | 32.80 |
| MTEB CQADupstackUnixRetrieval (test) | ndcg_at_5 | 34.63 |
| MTEB CQADupstackUnixRetrieval (test) | precision_at_1 | 28.45 |
| MTEB CQADupstackUnixRetrieval (test) | precision_at_10 | 6.24 |
| MTEB CQADupstackUnixRetrieval (test) | precision_at_100 | 1.00 |
| MTEB CQADupstackUnixRetrieval (test) | precision_at_1000 | 0.13 |
| MTEB CQADupstackUnixRetrieval (test) | precision_at_3 | 14.80 |
| MTEB CQADupstackUnixRetrieval (test) | precision_at_5 | 10.28 |
| MTEB CQADupstackUnixRetrieval (test) | recall_at_1 | 24.14 |
| MTEB CQADupstackUnixRetrieval (test) | recall_at_10 | 48.11 |
| MTEB CQADupstackUnixRetrieval (test) | recall_at_100 | 71.25 |
| MTEB CQADupstackUnixRetrieval (test) | recall_at_1000 | 88.99 |
| MTEB CQADupstackUnixRetrieval (test) | recall_at_3 | 36.12 |
| MTEB CQADupstackUnixRetrieval (test) | recall_at_5 | 40.85 |
| MTEB CQADupstackWebmastersRetrieval (test) | map_at_1 | 23.24 |
| MTEB CQADupstackWebmastersRetrieval (test) | map_at_10 | 31.23 |
| MTEB CQADupstackWebmastersRetrieval (test) | map_at_100 | 33.01 |
| MTEB CQADupstackWebmastersRetrieval (test) | map_at_1000 | 33.22 |
| MTEB CQADupstackWebmastersRetrieval (test) | map_at_3 | 28.92 |
| MTEB CQADupstackWebmastersRetrieval (test) | map_at_5 | 30.02 |
| MTEB CQADupstackWebmastersRetrieval (test) | mrr_at_1 | 27.67 |
| MTEB CQADupstackWebmastersRetrieval (test) | mrr_at_10 | 35.52 |
| MTEB CQADupstackWebmastersRetrieval (test) | mrr_at_100 | 36.70 |
| MTEB CQADupstackWebmastersRetrieval (test) | mrr_at_1000 | 36.76 |
| MTEB CQADupstackWebmastersRetrieval (test) | mrr_at_3 | 33.37 |
| MTEB CQADupstackWebmastersRetrieval (test) | mrr_at_5 | 34.55 |
| MTEB CQADupstackWebmastersRetrieval (test) | ndcg_at_1 | 27.67 |
| MTEB CQADupstackWebmastersRetrieval (test) | ndcg_at_10 | 36.38 |
| MTEB CQADupstackWebmastersRetrieval (test) | ndcg_at_100 | 43.06 |
| MTEB CQADupstackWebmastersRetrieval (test) | ndcg_at_1000 | 45.66 |
| MTEB CQADupstackWebmastersRetrieval (test) | ndcg_at_3 | 32.50 |
| MTEB CQADupstackWebmastersRetrieval (test) | ndcg_at_5 | 34.11 |
| MTEB CQADupstackWebmastersRetrieval (test) | precision_at_1 | 27.67 |
| MTEB CQADupstackWebmastersRetrieval (test) | precision_at_10 | 6.80 |
| MTEB CQADupstackWebmastersRetrieval (test) | precision_at_100 | 1.49 |
| MTEB CQADupstackWebmastersRetrieval (test) | precision_at_1000 | 0.23 |
| MTEB CQADupstackWebmastersRetrieval (test) | precision_at_3 | 15.15 |
| MTEB CQADupstackWebmastersRetrieval (test) | precision_at_5 | 10.79 |
| MTEB CQADupstackWebmastersRetrieval (test) | recall_at_1 | 23.24 |
| MTEB CQADupstackWebmastersRetrieval (test) | recall_at_10 | 45.98 |
| MTEB CQADupstackWebmastersRetrieval (test) | recall_at_100 | 74.82 |
| MTEB CQADupstackWebmastersRetrieval (test) | recall_at_1000 | 91.08 |
| MTEB CQADupstackWebmastersRetrieval (test) | recall_at_3 | 34.92 |
| MTEB CQADupstackWebmastersRetrieval (test) | recall_at_5 | 39.13 |
| MTEB CQADupstackWordpressRetrieval (test) | map_at_1 | 19.95 |
| MTEB CQADupstackWordpressRetrieval (test) | map_at_10 | 27.52 |
| MTEB CQADupstackWordpressRetrieval (test) | map_at_100 | 28.59 |
| MTEB CQADupstackWordpressRetrieval (test) | map_at_1000 | 28.68 |
| MTEB CQADupstackWordpressRetrieval (test) | map_at_3 | 25.35 |
| MTEB CQADupstackWordpressRetrieval (test) | map_at_5 | 26.55 |
| MTEB CQADupstackWordpressRetrieval (test) | mrr_at_1 | 22.00 |
| MTEB CQADupstackWordpressRetrieval (test) | mrr_at_10 | 29.84 |
| MTEB CQADupstackWordpressRetrieval (test) | mrr_at_100 | 30.78 |
| MTEB CQADupstackWordpressRetrieval (test) | mrr_at_1000 | 30.84 |
| MTEB CQADupstackWordpressRetrieval (test) | mrr_at_3 | 27.73 |
| MTEB CQADupstackWordpressRetrieval (test) | mrr_at_5 | 28.88 |
| MTEB CQADupstackWordpressRetrieval (test) | ndcg_at_1 | 22.00 |
| MTEB CQADupstackWordpressRetrieval (test) | ndcg_at_10 | 32.03 |
| MTEB CQADupstackWordpressRetrieval (test) | ndcg_at_100 | 37.19 |
| MTEB CQADupstackWordpressRetrieval (test) | ndcg_at_1000 | 39.65 |
| MTEB CQADupstackWordpressRetrieval (test) | ndcg_at_3 | 27.75 |
| MTEB CQADupstackWordpressRetrieval (test) | ndcg_at_5 | 29.81 |
| MTEB CQADupstackWordpressRetrieval (test) | precision_at_1 | 22.00 |
| MTEB CQADupstackWordpressRetrieval (test) | precision_at_10 | 5.07 |
| MTEB CQADupstackWordpressRetrieval (test) | precision_at_100 | 0.82 |
| MTEB CQADupstackWordpressRetrieval (test) | precision_at_1000 | 0.11 |
| MTEB CQADupstackWordpressRetrieval (test) | precision_at_3 | 12.08 |
| MTEB CQADupstackWordpressRetrieval (test) | precision_at_5 | 8.39 |
| MTEB CQADupstackWordpressRetrieval (test) | recall_at_1 | 19.95 |
| MTEB CQADupstackWordpressRetrieval (test) | recall_at_10 | 43.62 |
| MTEB CQADupstackWordpressRetrieval (test) | recall_at_100 | 67.19 |
| MTEB CQADupstackWordpressRetrieval (test) | recall_at_1000 | 85.70 |
| MTEB CQADupstackWordpressRetrieval (test) | recall_at_3 | 32.15 |
| MTEB CQADupstackWordpressRetrieval (test) | recall_at_5 | 37.21 |
| MTEB ClimateFEVER (test) | map_at_1 | 18.28 |
| MTEB ClimateFEVER (test) | map_at_10 | 31.05 |
| MTEB ClimateFEVER (test) | map_at_100 | 33.13 |
| MTEB ClimateFEVER (test) | map_at_1000 | 33.31 |
| MTEB ClimateFEVER (test) | map_at_3 | 26.21 |
| MTEB ClimateFEVER (test) | map_at_5 | 28.86 |
| MTEB ClimateFEVER (test) | mrr_at_1 | 42.67 |
| MTEB ClimateFEVER (test) | mrr_at_10 | 54.56 |
| MTEB ClimateFEVER (test) | mrr_at_100 | 55.14 |
| MTEB ClimateFEVER (test) | mrr_at_1000 | 55.17 |
| MTEB ClimateFEVER (test) | mrr_at_3 | 51.49 |
| MTEB ClimateFEVER (test) | mrr_at_5 | 53.44 |
| MTEB ClimateFEVER (test) | ndcg_at_1 | 42.67 |
| MTEB ClimateFEVER (test) | ndcg_at_10 | 41.28 |
| MTEB ClimateFEVER (test) | ndcg_at_100 | 48.38 |
| MTEB ClimateFEVER (test) | ndcg_at_1000 | 51.32 |
| MTEB ClimateFEVER (test) | ndcg_at_3 | 35.07 |
| MTEB ClimateFEVER (test) | ndcg_at_5 | 37.24 |
| MTEB ClimateFEVER (test) | precision_at_1 | 42.67 |
| MTEB ClimateFEVER (test) | precision_at_10 | 12.64 |
| MTEB ClimateFEVER (test) | precision_at_100 | 2.04 |
| MTEB ClimateFEVER (test) | precision_at_1000 | 0.26 |
| MTEB ClimateFEVER (test) | precision_at_3 | 26.08 |
| MTEB ClimateFEVER (test) | precision_at_5 | 19.80 |
| MTEB ClimateFEVER (test) | recall_at_1 | 18.28 |
| MTEB ClimateFEVER (test) | recall_at_10 | 46.95 |
| MTEB ClimateFEVER (test) | recall_at_100 | 70.97 |
| MTEB ClimateFEVER (test) | recall_at_1000 | 87.11 |
| MTEB ClimateFEVER (test) | recall_at_3 | 31.15 |
| MTEB ClimateFEVER (test) | recall_at_5 | 38.10 |
| MTEB DBPedia (test) | map_at_1 | 8.57 |
| MTEB DBPedia (test) | map_at_10 | 19.75 |
| MTEB DBPedia (test) | map_at_100 | 28.21 |
| MTEB DBPedia (test) | map_at_1000 | 29.83 |
| MTEB DBPedia (test) | map_at_3 | 14.11 |
| MTEB DBPedia (test) | map_at_5 | 16.45 |
| MTEB DBPedia (test) | mrr_at_1 | 71.00 |
| MTEB DBPedia (test) | mrr_at_10 | 77.69 |
| MTEB DBPedia (test) | mrr_at_100 | 78.00 |
| MTEB DBPedia (test) | mrr_at_1000 | 78.00 |
| MTEB DBPedia (test) | mrr_at_3 | 76.29 |
| MTEB DBPedia (test) | mrr_at_5 | 77.03 |
| MTEB DBPedia (test) | ndcg_at_1 | 59.13 |
| MTEB DBPedia (test) | ndcg_at_10 | 43.90 |
| MTEB DBPedia (test) | ndcg_at_100 | 47.86 |
| MTEB DBPedia (test) | ndcg_at_1000 | 54.85 |
| MTEB DBPedia (test) | ndcg_at_3 | 49.80 |
| MTEB DBPedia (test) | ndcg_at_5 | 46.32 |
| MTEB DBPedia (test) | precision_at_1 | 71.00 |
| MTEB DBPedia (test) | precision_at_10 | 34.40 |
| MTEB DBPedia (test) | precision_at_100 | 11.06 |
| MTEB DBPedia (test) | precision_at_1000 | 1.99 |
| MTEB DBPedia (test) | precision_at_3 | 52.33 |
| MTEB DBPedia (test) | precision_at_5 | 43.70 |
| MTEB DBPedia (test) | recall_at_1 | 8.57 |
| MTEB DBPedia (test) | recall_at_10 | 25.61 |
| MTEB DBPedia (test) | recall_at_100 | 53.39 |
| MTEB DBPedia (test) | recall_at_1000 | 75.46 |
| MTEB DBPedia (test) | recall_at_3 | 15.43 |
| MTEB DBPedia (test) | recall_at_5 | 19.36 |
| MTEB EmotionClassification (test) | accuracy | 47.99 |
| MTEB EmotionClassification (test) | f1 | 42.78 |
| MTEB FEVER (test) | map_at_1 | 74.13 |
| MTEB FEVER (test) | map_at_10 | 82.83 |
| MTEB FEVER (test) | map_at_100 | 83.10 |
| MTEB FEVER (test) | map_at_1000 | 83.11 |
| MTEB FEVER (test) | map_at_3 | 81.75 |
| MTEB FEVER (test) | map_at_5 | 82.45 |
| MTEB FEVER (test) | mrr_at_1 | 79.55 |
| MTEB FEVER (test) | mrr_at_10 | 86.65 |
| MTEB FEVER (test) | mrr_at_100 | 86.77 |
| MTEB FEVER (test) | mrr_at_1000 | 86.78 |
| MTEB FEVER (test) | mrr_at_3 | 85.98 |
| MTEB FEVER (test) | mrr_at_5 | 86.46 |
| MTEB FEVER (test) | ndcg_at_1 | 79.55 |
| MTEB FEVER (test) | ndcg_at_10 | 86.34 |
| MTEB FEVER (test) | ndcg_at_100 | 87.32 |
| MTEB FEVER (test) | ndcg_at_1000 | 87.58 |
| MTEB FEVER (test) | ndcg_at_3 | 84.72 |
| MTEB FEVER (test) | ndcg_at_5 | 85.68 |
| MTEB FEVER (test) | precision_at_1 | 79.55 |
| MTEB FEVER (test) | precision_at_10 | 10.40 |
| MTEB FEVER (test) | precision_at_100 | 1.11 |
| MTEB FEVER (test) | precision_at_1000 | 0.11 |
| MTEB FEVER (test) | precision_at_3 | 32.41 |
| MTEB FEVER (test) | precision_at_5 | 20.14 |
| MTEB FEVER (test) | recall_at_1 | 74.13 |
| MTEB FEVER (test) | recall_at_10 | 93.22 |
| MTEB FEVER (test) | recall_at_100 | 97.08 |
| MTEB FEVER (test) | recall_at_1000 | 98.73 |
| MTEB FEVER (test) | recall_at_3 | 88.79 |
| MTEB FEVER (test) | recall_at_5 | 91.26 |
| MTEB FiQA2018 (test) | map_at_1 | 18.30 |
| MTEB FiQA2018 (test) | map_at_10 | 29.90 |
| MTEB FiQA2018 (test) | map_at_100 | 31.53 |
| MTEB FiQA2018 (test) | map_at_1000 | 31.71 |
| MTEB FiQA2018 (test) | map_at_3 | 25.74 |
| MTEB FiQA2018 (test) | map_at_5 | 28.23 |
| MTEB FiQA2018 (test) | mrr_at_1 | 36.73 |
| MTEB FiQA2018 (test) | mrr_at_10 | 45.40 |
| MTEB FiQA2018 (test) | mrr_at_100 | 46.27 |
| MTEB FiQA2018 (test) | mrr_at_1000 | 46.31 |
| MTEB FiQA2018 (test) | mrr_at_3 | 42.98 |
| MTEB FiQA2018 (test) | mrr_at_5 | 44.29 |
| MTEB FiQA2018 (test) | ndcg_at_1 | 36.73 |
| MTEB FiQA2018 (test) | ndcg_at_10 | 37.46 |
| MTEB FiQA2018 (test) | ndcg_at_100 | 43.83 |
| MTEB FiQA2018 (test) | ndcg_at_1000 | 47.00 |
| MTEB FiQA2018 (test) | ndcg_at_3 | 33.69 |
| MTEB FiQA2018 (test) | ndcg_at_5 | 35.09 |
| MTEB FiQA2018 (test) | precision_at_1 | 36.73 |
| MTEB FiQA2018 (test) | precision_at_10 | 10.39 |
| MTEB FiQA2018 (test) | precision_at_100 | 1.70 |
| MTEB FiQA2018 (test) | precision_at_1000 | 0.23 |
| MTEB FiQA2018 (test) | precision_at_3 | 22.48 |
| MTEB FiQA2018 (test) | precision_at_5 | 16.61 |
| MTEB FiQA2018 (test) | recall_at_1 | 18.30 |
| MTEB FiQA2018 (test) | recall_at_10 | 44.37 |
| MTEB FiQA2018 (test) | recall_at_100 | 68.10 |
| MTEB FiQA2018 (test) | recall_at_1000 | 87.22 |
| MTEB FiQA2018 (test) | recall_at_3 | 30.22 |
| MTEB FiQA2018 (test) | recall_at_5 | 36.86 |
| MTEB HotpotQA (test) | map_at_1 | 39.57 |
| MTEB HotpotQA (test) | map_at_10 | 65.06 |
| MTEB HotpotQA (test) | map_at_100 | 65.90 |
| MTEB HotpotQA (test) | map_at_1000 | 65.95 |
| MTEB HotpotQA (test) | map_at_3 | 61.83 |
| MTEB HotpotQA (test) | map_at_5 | 63.85 |
| MTEB HotpotQA (test) | mrr_at_1 | 79.14 |
| MTEB HotpotQA (test) | mrr_at_10 | 84.58 |
| MTEB HotpotQA (test) | mrr_at_100 | 84.77 |
| MTEB HotpotQA (test) | mrr_at_1000 | 84.77 |
| MTEB HotpotQA (test) | mrr_at_3 | 83.68 |
| MTEB HotpotQA (test) | mrr_at_5 | 84.22 |
| MTEB HotpotQA (test) | ndcg_at_1 | 79.14 |
| MTEB HotpotQA (test) | ndcg_at_10 | 72.62 |
| MTEB HotpotQA (test) | ndcg_at_100 | 75.54 |
| MTEB HotpotQA (test) | ndcg_at_1000 | 76.61 |
| MTEB HotpotQA (test) | ndcg_at_3 | 68.06 |
| MTEB HotpotQA (test) | ndcg_at_5 | 70.58 |
| MTEB HotpotQA (test) | precision_at_1 | 79.14 |
| MTEB HotpotQA (test) | precision_at_10 | 15.21 |
| MTEB HotpotQA (test) | precision_at_100 | 1.75 |
| MTEB HotpotQA (test) | precision_at_1000 | 0.19 |
| MTEB HotpotQA (test) | precision_at_3 | 44.01 |
| MTEB HotpotQA (test) | precision_at_5 | 28.39 |
| MTEB HotpotQA (test) | recall_at_1 | 39.57 |
| MTEB HotpotQA (test) | recall_at_10 | 76.08 |
| MTEB HotpotQA (test) | recall_at_100 | 87.48 |
| MTEB HotpotQA (test) | recall_at_1000 | 94.56 |
| MTEB HotpotQA (test) | recall_at_3 | 66.02 |
| MTEB HotpotQA (test) | recall_at_5 | 70.97 |
| MTEB ImdbClassification (test) | accuracy | 85.31 |
| MTEB ImdbClassification (test) | ap | 80.36 |
| MTEB ImdbClassification (test) | f1 | 85.27 |
| MTEB MSMARCO (dev) | map_at_1 | 23.36 |
| MTEB MSMARCO (dev) | map_at_10 | 35.71 |
| MTEB MSMARCO (dev) | map_at_100 | 36.88 |
| MTEB MSMARCO (dev) | map_at_1000 | 36.92 |
| MTEB MSMARCO (dev) | map_at_3 | 32.03 |
| MTEB MSMARCO (dev) | map_at_5 | 34.16 |
| MTEB MSMARCO (dev) | mrr_at_1 | 24.04 |
| MTEB MSMARCO (dev) | mrr_at_10 | 36.34 |
| MTEB MSMARCO (dev) | mrr_at_100 | 37.44 |
| MTEB MSMARCO (dev) | mrr_at_1000 | 37.48 |
| MTEB MSMARCO (dev) | mrr_at_3 | 32.71 |
| MTEB MSMARCO (dev) | mrr_at_5 | 34.82 |
| MTEB MSMARCO (dev) | ndcg_at_1 | 24.03 |
| MTEB MSMARCO (dev) | ndcg_at_10 | 42.53 |
| MTEB MSMARCO (dev) | ndcg_at_100 | 48.08 |
| MTEB MSMARCO (dev) | ndcg_at_1000 | 49.21 |
| MTEB MSMARCO (dev) | ndcg_at_3 | 35.04 |
| MTEB MSMARCO (dev) | ndcg_at_5 | 38.83 |
| MTEB MSMARCO (dev) | precision_at_1 | 24.03 |
| MTEB MSMARCO (dev) | precision_at_10 | 6.62 |
| MTEB MSMARCO (dev) | precision_at_100 | 0.94 |
| MTEB MSMARCO (dev) | precision_at_1000 | 0.10 |
| MTEB MSMARCO (dev) | precision_at_3 | 14.91 |
| MTEB MSMARCO (dev) | precision_at_5 | 10.87 |
| MTEB MSMARCO (dev) | recall_at_1 | 23.36 |
| MTEB MSMARCO (dev) | recall_at_10 | 63.43 |
| MTEB MSMARCO (dev) | recall_at_100 | 88.96 |
| MTEB MSMARCO (dev) | recall_at_1000 | 97.64 |
| MTEB MSMARCO (dev) | recall_at_3 | 43.09 |
| MTEB MSMARCO (dev) | recall_at_5 | 52.18 |
| MTEB MTOPDomainClassification (en) (test) | accuracy | 93.01 |
| MTEB MTOPDomainClassification (en) (test) | f1 | 92.78 |
| MTEB MTOPIntentClassification (en) (test) | accuracy | 75.03 |
| MTEB MTOPIntentClassification (en) (test) | f1 | 58.46 |
| MTEB MassiveIntentClassification (en) (test) | accuracy | 73.46 |
| MTEB MassiveIntentClassification (en) (test) | f1 | 71.42 |
| MTEB MassiveScenarioClassification (en) (test) | accuracy | 77.08 |
| MTEB MassiveScenarioClassification (en) (test) | f1 | 77.23 |
| MTEB MedrxivClusteringP2P (test) | v_measure | 34.53 |
| MTEB MedrxivClusteringS2S (test) | v_measure | 30.94 |
| MTEB MindSmallReranking (test) | map | 30.31 |
| MTEB MindSmallReranking (test) | mrr | 31.29 |
| MTEB NFCorpus (test) | map_at_1 | 5.46 |
| MTEB NFCorpus (test) | map_at_10 | 13.03 |
| MTEB NFCorpus (test) | map_at_100 | 16.06 |
| MTEB NFCorpus (test) | map_at_1000 | 17.49 |
| MTEB NFCorpus (test) | map_at_3 | 9.55 |
| MTEB NFCorpus (test) | map_at_5 | 11.20 |
| MTEB NFCorpus (test) | mrr_at_1 | 43.65 |
| MTEB NFCorpus (test) | mrr_at_10 | 53.27 |
| MTEB NFCorpus (test) | mrr_at_100 | 53.72 |
| MTEB NFCorpus (test) | mrr_at_1000 | 53.76 |
| MTEB NFCorpus (test) | mrr_at_3 | 50.93 |
| MTEB NFCorpus (test) | mrr_at_5 | 52.46 |
| MTEB NFCorpus (test) | ndcg_at_1 | 42.26 |
| MTEB NFCorpus (test) | ndcg_at_10 | 34.67 |
| MTEB NFCorpus (test) | ndcg_at_100 | 30.76 |
| MTEB NFCorpus (test) | ndcg_at_1000 | 39.73 |
| MTEB NFCorpus (test) | ndcg_at_3 | 40.35 |
| MTEB NFCorpus (test) | ndcg_at_5 | 37.91 |
| MTEB NFCorpus (test) | precision_at_1 | 43.65 |
| MTEB NFCorpus (test) | precision_at_10 | 25.79 |
| MTEB NFCorpus (test) | precision_at_100 | 7.75 |
| MTEB NFCorpus (test) | precision_at_1000 | 2.07 |
| MTEB NFCorpus (test) | precision_at_3 | 38.60 |
| MTEB NFCorpus (test) | precision_at_5 | 33.25 |
| MTEB NFCorpus (test) | recall_at_1 | 5.46 |
| MTEB NFCorpus (test) | recall_at_10 | 17.15 |
| MTEB NFCorpus (test) | recall_at_100 | 29.77 |
| MTEB NFCorpus (test) | recall_at_1000 | 62.24 |
| MTEB NFCorpus (test) | recall_at_3 | 10.58 |
| MTEB NFCorpus (test) | recall_at_5 | 13.31 |
| MTEB NQ (test) | map_at_1 | 37.01 |
| MTEB NQ (test) | map_at_10 | 52.47 |
| MTEB NQ (test) | map_at_100 | 53.34 |
| MTEB NQ (test) | map_at_1000 | 53.37 |
| MTEB NQ (test) | map_at_3 | 48.41 |
| MTEB NQ (test) | map_at_5 | 50.88 |
| MTEB NQ (test) | mrr_at_1 | 41.54 |
| MTEB NQ (test) | mrr_at_10 | 54.97 |
| MTEB NQ (test) | mrr_at_100 | 55.61 |
| MTEB NQ (test) | mrr_at_1000 | 55.63 |
| MTEB NQ (test) | mrr_at_3 | 51.82 |
| MTEB NQ (test) | mrr_at_5 | 53.76 |
| MTEB NQ (test) | ndcg_at_1 | 41.54 |
| MTEB NQ (test) | ndcg_at_10 | 59.72 |
| MTEB NQ (test) | ndcg_at_100 | 63.39 |
| MTEB NQ (test) | ndcg_at_1000 | 63.88 |
| MTEB NQ (test) | ndcg_at_3 | 52.33 |
| MTEB NQ (test) | ndcg_at_5 | 56.33 |
| MTEB NQ (test) | precision_at_1 | 41.54 |
| MTEB NQ (test) | precision_at_10 | 9.45 |
| MTEB NQ (test) | precision_at_100 | 1.15 |
| MTEB NQ (test) | precision_at_1000 | 0.12 |
| MTEB NQ (test) | precision_at_3 | 23.26 |
| MTEB NQ (test) | precision_at_5 | 16.31 |
| MTEB NQ (test) | recall_at_1 | 37.01 |
| MTEB NQ (test) | recall_at_10 | 79.14 |
| MTEB NQ (test) | recall_at_100 | 94.99 |
| MTEB NQ (test) | recall_at_1000 | 98.61 |
| MTEB NQ (test) | recall_at_3 | 60.28 |
| MTEB NQ (test) | recall_at_5 | 69.41 |
| MTEB QuoraRetrieval (test) | map_at_1 | 70.40 |
| MTEB QuoraRetrieval (test) | map_at_10 | 84.18 |
| MTEB QuoraRetrieval (test) | map_at_100 | 84.80 |
| MTEB QuoraRetrieval (test) | map_at_1000 | 84.81 |
| MTEB QuoraRetrieval (test) | map_at_3 | 81.21 |
| MTEB QuoraRetrieval (test) | map_at_5 | 83.08 |
| MTEB QuoraRetrieval (test) | mrr_at_1 | 81.02 |
| MTEB QuoraRetrieval (test) | mrr_at_10 | 87.26 |
| MTEB QuoraRetrieval (test) | mrr_at_100 | 87.36 |
| MTEB QuoraRetrieval (test) | mrr_at_1000 | 87.36 |
| MTEB QuoraRetrieval (test) | mrr_at_3 | 86.23 |
| MTEB QuoraRetrieval (test) | mrr_at_5 | 86.94 |
| MTEB QuoraRetrieval (test) | ndcg_at_1 | 81.01 |
| MTEB QuoraRetrieval (test) | ndcg_at_10 | 88.00 |
| MTEB QuoraRetrieval (test) | ndcg_at_100 | 89.22 |
| MTEB QuoraRetrieval (test) | ndcg_at_1000 | 89.33 |
| MTEB QuoraRetrieval (test) | ndcg_at_3 | 85.05 |
| MTEB QuoraRetrieval (test) | ndcg_at_5 | 86.70 |
| MTEB QuoraRetrieval (test) | precision_at_1 | 81.01 |
| MTEB QuoraRetrieval (test) | precision_at_10 | 13.34 |
| MTEB QuoraRetrieval (test) | precision_at_100 | 1.52 |
| MTEB QuoraRetrieval (test) | precision_at_1000 | 0.16 |
| MTEB QuoraRetrieval (test) | precision_at_3 | 37.14 |
| MTEB QuoraRetrieval (test) | precision_at_5 | 24.44 |
| MTEB QuoraRetrieval (test) | recall_at_1 | 70.40 |
| MTEB QuoraRetrieval (test) | recall_at_10 | 95.21 |
| MTEB QuoraRetrieval (test) | recall_at_100 | 99.44 |
| MTEB QuoraRetrieval (test) | recall_at_1000 | 99.93 |
| MTEB QuoraRetrieval (test) | recall_at_3 | 86.76 |
| MTEB QuoraRetrieval (test) | recall_at_5 | 91.44 |
| MTEB RedditClustering (test) | v_measure | 56.52 |
| MTEB RedditClusteringP2P (test) | v_measure | 61.05 |
| MTEB SCIDOCS (test) | map_at_1 | 4.58 |
| MTEB SCIDOCS (test) | map_at_10 | 11.04 |
| MTEB SCIDOCS (test) | map_at_100 | 12.88 |
| MTEB SCIDOCS (test) | map_at_1000 | 13.15 |
| MTEB SCIDOCS (test) | map_at_3 | 8.13 |
| MTEB SCIDOCS (test) | map_at_5 | 9.56 |
| MTEB SCIDOCS (test) | mrr_at_1 | 22.60 |
| MTEB SCIDOCS (test) | mrr_at_10 | 32.68 |
| MTEB SCIDOCS (test) | mrr_at_100 | 33.79 |
| MTEB SCIDOCS (test) | mrr_at_1000 | 33.85 |
| MTEB SCIDOCS (test) | mrr_at_3 | 29.70 |
| MTEB SCIDOCS (test) | mrr_at_5 | 31.48 |
| MTEB SCIDOCS (test) | ndcg_at_1 | 22.60 |
| MTEB SCIDOCS (test) | ndcg_at_10 | 18.62 |
| MTEB SCIDOCS (test) | ndcg_at_100 | 25.88 |
| MTEB SCIDOCS (test) | ndcg_at_1000 | 30.94 |
| MTEB SCIDOCS (test) | ndcg_at_3 | 18.14 |
| MTEB SCIDOCS (test) | ndcg_at_5 | 15.63 |
| MTEB SCIDOCS (test) | precision_at_1 | 22.60 |
| MTEB SCIDOCS (test) | precision_at_10 | 9.48 |
| MTEB SCIDOCS (test) | precision_at_100 | 1.99 |
| MTEB SCIDOCS (test) | precision_at_1000 | 0.32 |
| MTEB SCIDOCS (test) | precision_at_3 | 16.80 |
| MTEB SCIDOCS (test) | precision_at_5 | 13.54 |
| MTEB SCIDOCS (test) | recall_at_1 | 4.58 |
| MTEB SCIDOCS (test) | recall_at_10 | 19.21 |
| MTEB SCIDOCS (test) | recall_at_100 | 40.40 |
| MTEB SCIDOCS (test) | recall_at_1000 | 65.20 |
| MTEB SCIDOCS (test) | recall_at_3 | 10.21 |
| MTEB SCIDOCS (test) | recall_at_5 | 13.72 |
| MTEB SICK-R (test) | cos_sim_pearson | 83.44 |
| MTEB SICK-R (test) | cos_sim_spearman | 79.38 |
| MTEB SICK-R (test) | euclidean_pearson | 81.11 |
| MTEB SICK-R (test) | euclidean_spearman | 79.38 |
| MTEB SICK-R (test) | manhattan_pearson | 81.04 |
| MTEB SICK-R (test) | manhattan_spearman | 79.33 |
| MTEB STS12 (test) | cos_sim_pearson | 84.96 |
| MTEB STS12 (test) | cos_sim_spearman | 78.52 |
| MTEB STS12 (test) | euclidean_pearson | 81.58 |
| MTEB STS12 (test) | euclidean_spearman | 78.52 |
| MTEB STS12 (test) | manhattan_pearson | 81.53 |
| MTEB STS12 (test) | manhattan_spearman | 78.50 |
| MTEB STS13 (test) | cos_sim_pearson | 84.79 |
| MTEB STS13 (test) | cos_sim_spearman | 86.05 |
| MTEB STS13 (test) | euclidean_pearson | 85.46 |
| MTEB STS13 (test) | euclidean_spearman | 86.05 |
| MTEB STS13 (test) | manhattan_pearson | 85.46 |
| MTEB STS13 (test) | manhattan_spearman | 86.08 |
| MTEB STS14 (test) | cos_sim_pearson | 83.21 |
| MTEB STS14 (test) | cos_sim_spearman | 81.54 |
| MTEB STS14 (test) | euclidean_pearson | 82.82 |
| MTEB STS14 (test) | euclidean_spearman | 81.54 |
| MTEB STS14 (test) | manhattan_pearson | 82.79 |
| MTEB STS14 (test) | manhattan_spearman | 81.51 |
| MTEB STS15 (test) | cos_sim_pearson | 85.46 |
| MTEB STS15 (test) | cos_sim_spearman | 86.97 |
| MTEB STS15 (test) | euclidean_pearson | 86.63 |
| MTEB STS15 (test) | euclidean_spearman | 86.97 |
| MTEB STS15 (test) | manhattan_pearson | 86.59 |
| MTEB STS15 (test) | manhattan_spearman | 86.93 |
| MTEB STS16 (test) | cos_sim_pearson | 82.52 |
| MTEB STS16 (test) | cos_sim_spearman | 84.77 |
| MTEB STS16 (test) | euclidean_pearson | 84.24 |
| MTEB STS16 (test) | euclidean_spearman | 84.77 |
| MTEB STS16 (test) | manhattan_pearson | 84.23 |
| MTEB STS16 (test) | manhattan_spearman | 84.75 |
| MTEB STS17 (en-en) (test) | cos_sim_pearson | 87.28 |
| MTEB STS17 (en-en) (test) | cos_sim_spearman | 87.47 |
| MTEB STS17 (en-en) (test) | euclidean_pearson | 88.31 |
| MTEB STS17 (en-en) (test) | euclidean_spearman | 87.47 |
| MTEB STS17 (en-en) (test) | manhattan_pearson | 88.11 |
| MTEB STS17 (en-en) (test) | manhattan_spearman | 87.21 |
| MTEB STS22 (en) (test) | cos_sim_pearson | 62.38 |
| MTEB STS22 (en) (test) | cos_sim_spearman | 65.02 |
| MTEB STS22 (en) (test) | euclidean_pearson | 65.65 |
| MTEB STS22 (en) (test) | euclidean_spearman | 65.02 |
| MTEB STS22 (en) (test) | manhattan_pearson | 65.88 |
| MTEB STS22 (en) (test) | manhattan_spearman | 65.18 |
| MTEB STSBenchmark (test) | cos_sim_pearson | 84.23 |
| MTEB STSBenchmark (test) | cos_sim_spearman | 85.47 |
| MTEB STSBenchmark (test) | euclidean_pearson | 85.33 |
| MTEB STSBenchmark (test) | euclidean_spearman | 85.47 |
| MTEB STSBenchmark (test) | manhattan_pearson | 85.30 |
| MTEB STSBenchmark (test) | manhattan_spearman | 85.43 |
| MTEB SciDocsRR (test) | map | 80.61 |
| MTEB SciDocsRR (test) | mrr | 94.29 |
| MTEB SciFact (test) | map_at_1 | 54.53 |
| MTEB SciFact (test) | map_at_10 | 65.19 |
| MTEB SciFact (test) | map_at_100 | 65.63 |
| MTEB SciFact (test) | map_at_1000 | 65.66 |
| MTEB SciFact (test) | map_at_3 | 62.35 |
| MTEB SciFact (test) | map_at_5 | 64.03 |
| MTEB SciFact (test) | mrr_at_1 | 57.33 |
| MTEB SciFact (test) | mrr_at_10 | 66.58 |
| MTEB SciFact (test) | mrr_at_100 | 66.88 |
| MTEB SciFact (test) | mrr_at_1000 | 66.91 |
| MTEB SciFact (test) | mrr_at_3 | 64.56 |
| MTEB SciFact (test) | mrr_at_5 | 65.74 |
| MTEB SciFact (test) | ndcg_at_1 | 57.33 |
| MTEB SciFact (test) | ndcg_at_10 | 70.28 |
| MTEB SciFact (test) | ndcg_at_100 | 72.14 |
| MTEB SciFact (test) | ndcg_at_1000 | 72.96 |
| MTEB SciFact (test) | ndcg_at_3 | 65.41 |
| MTEB SciFact (test) | ndcg_at_5 | 67.83 |
| MTEB SciFact (test) | precision_at_1 | 57.33 |
| MTEB SciFact (test) | precision_at_10 | 9.50 |
| MTEB SciFact (test) | precision_at_100 | 1.06 |
| MTEB SciFact (test) | precision_at_1000 | 0.11 |
| MTEB SciFact (test) | precision_at_3 | 25.78 |
| MTEB SciFact (test) | precision_at_5 | 17.20 |
| MTEB SciFact (test) | recall_at_1 | 54.53 |
| MTEB SciFact (test) | recall_at_10 | 84.36 |
| MTEB SciFact (test) | recall_at_100 | 92.83 |
| MTEB SciFact (test) | recall_at_1000 | 99.33 |
| MTEB SciFact (test) | recall_at_3 | 71.28 |
| MTEB SciFact (test) | recall_at_5 | 77.15 |
| MTEB SprintDuplicateQuestions (test) | cos_sim_accuracy | 99.74 |
| MTEB SprintDuplicateQuestions (test) | cos_sim_ap | 92.90 |
| MTEB SprintDuplicateQuestions (test) | cos_sim_f1 | 86.36 |
| MTEB SprintDuplicateQuestions (test) | cos_sim_precision | 90.47 |
| MTEB SprintDuplicateQuestions (test) | cos_sim_recall | 82.60 |
| MTEB SprintDuplicateQuestions (test) | dot_accuracy | 99.74 |
| MTEB SprintDuplicateQuestions (test) | dot_ap | 92.90 |
| MTEB SprintDuplicateQuestions (test) | dot_f1 | 86.36 |
| MTEB SprintDuplicateQuestions (test) | dot_precision | 90.47 |
| MTEB SprintDuplicateQuestions (test) | dot_recall | 82.60 |
| MTEB SprintDuplicateQuestions (test) | euclidean_accuracy | 99.74 |
| MTEB SprintDuplicateQuestions (test) | euclidean_ap | 92.90 |
| MTEB SprintDuplicateQuestions (test) | euclidean_f1 | 86.36 |
| MTEB SprintDuplicateQuestions (test) | euclidean_precision | 90.47 |
| MTEB SprintDuplicateQuestions (test) | euclidean_recall | 82.60 |
| MTEB SprintDuplicateQuestions (test) | manhattan_accuracy | 99.74 |
| MTEB SprintDuplicateQuestions (test) | manhattan_ap | 92.87 |
| MTEB SprintDuplicateQuestions (test) | manhattan_f1 | 86.38 |
| MTEB SprintDuplicateQuestions (test) | manhattan_precision | 90.29 |
| MTEB SprintDuplicateQuestions (test) | manhattan_recall | 82.80 |
| MTEB SprintDuplicateQuestions (test) | max_accuracy | 99.74 |
| MTEB SprintDuplicateQuestions (test) | max_ap | 92.90 |
| MTEB SprintDuplicateQuestions (test) | max_f1 | 86.38 |
| MTEB StackExchangeClustering (test) | v_measure | 63.19 |
| MTEB StackExchangeClusteringP2P (test) | v_measure | 34.03 |
| MTEB StackOverflowDupQuestions (test) | map | 50.47 |
| MTEB StackOverflowDupQuestions (test) | mrr | 51.19 |
| MTEB SummEval (test) | cos_sim_pearson | 30.20 |
| MTEB SummEval (test) | cos_sim_spearman | 30.40 |
| MTEB SummEval (test) | dot_pearson | 30.20 |
| MTEB SummEval (test) | dot_spearman | 30.40 |
| MTEB TRECCOVID (test) | map_at_1 | 0.24 |
| MTEB TRECCOVID (test) | map_at_10 | 2.17 |
| MTEB TRECCOVID (test) | map_at_100 | 12.22 |
| MTEB TRECCOVID (test) | map_at_1000 | 28.63 |
| MTEB TRECCOVID (test) | map_at_3 | 0.73 |
| MTEB TRECCOVID (test) | map_at_5 | 1.19 |
| MTEB TRECCOVID (test) | mrr_at_1 | 94.00 |
| MTEB TRECCOVID (test) | mrr_at_10 | 97.00 |
| MTEB TRECCOVID (test) | mrr_at_100 | 97.00 |
| MTEB TRECCOVID (test) | mrr_at_1000 | 97.00 |
| MTEB TRECCOVID (test) | mrr_at_3 | 97.00 |
| MTEB TRECCOVID (test) | mrr_at_5 | 97.00 |
| MTEB TRECCOVID (test) | ndcg_at_1 | 89.00 |
| MTEB TRECCOVID (test) | ndcg_at_10 | 82.30 |
| MTEB TRECCOVID (test) | ndcg_at_100 | 61.84 |
| MTEB TRECCOVID (test) | ndcg_at_1000 | 53.38 |
| MTEB TRECCOVID (test) | ndcg_at_3 | 88.88 |
| MTEB TRECCOVID (test) | ndcg_at_5 | 86.05 |
| MTEB TRECCOVID (test) | precision_at_1 | 94.00 |
| MTEB TRECCOVID (test) | precision_at_10 | 87.00 |
| MTEB TRECCOVID (test) | precision_at_100 | 63.38 |
| MTEB TRECCOVID (test) | precision_at_1000 | 23.50 |
| MTEB TRECCOVID (test) | precision_at_3 | 94.00 |
| MTEB TRECCOVID (test) | precision_at_5 | 92.00 |
| MTEB TRECCOVID (test) | recall_at_1 | 0.24 |
| MTEB TRECCOVID (test) | recall_at_10 | 2.30 |
| MTEB TRECCOVID (test) | recall_at_100 | 14.98 |
| MTEB TRECCOVID (test) | recall_at_1000 | 49.64 |
| MTEB TRECCOVID (test) | recall_at_3 | 0.75 |
| MTEB TRECCOVID (test) | recall_at_5 | 1.23 |
| MTEB Touche2020 (test) | map_at_1 | 3.01 |
| MTEB Touche2020 (test) | map_at_10 | 11.80 |
| MTEB Touche2020 (test) | map_at_100 | 18.15 |
| MTEB Touche2020 (test) | map_at_1000 | 19.79 |
| MTEB Touche2020 (test) | map_at_3 | 5.91 |
| MTEB Touche2020 (test) | map_at_5 | 8.80 |
| MTEB Touche2020 (test) | mrr_at_1 | 40.82 |
| MTEB Touche2020 (test) | mrr_at_10 | 56.37 |
| MTEB Touche2020 (test) | mrr_at_100 | 56.72 |
| MTEB Touche2020 (test) | mrr_at_1000 | 56.72 |
| MTEB Touche2020 (test) | mrr_at_3 | 52.04 |
| MTEB Touche2020 (test) | mrr_at_5 | 54.80 |
| MTEB Touche2020 (test) | ndcg_at_1 | 37.76 |
| MTEB Touche2020 (test) | ndcg_at_10 | 29.86 |
| MTEB Touche2020 (test) | ndcg_at_100 | 39.57 |
| MTEB Touche2020 (test) | ndcg_at_1000 | 51.39 |
| MTEB Touche2020 (test) | ndcg_at_3 | 32.58 |
| MTEB Touche2020 (test) | ndcg_at_5 | 32.35 |
| MTEB Touche2020 (test) | precision_at_1 | 40.82 |
| MTEB Touche2020 (test) | precision_at_10 | 26.53 |
| MTEB Touche2020 (test) | precision_at_100 | 7.80 |
| MTEB Touche2020 (test) | precision_at_1000 | 1.55 |
| MTEB Touche2020 (test) | precision_at_3 | 32.65 |
| MTEB Touche2020 (test) | precision_at_5 | 33.06 |
| MTEB Touche2020 (test) | recall_at_1 | 3.01 |
| MTEB Touche2020 (test) | recall_at_10 | 18.74 |
| MTEB Touche2020 (test) | recall_at_100 | 48.06 |
| MTEB Touche2020 (test) | recall_at_1000 | 83.41 |
| MTEB Touche2020 (test) | recall_at_3 | 7.17 |
| MTEB Touche2020 (test) | recall_at_5 | 12.10 |
| MTEB ToxicConversationsClassification (test) | accuracy | 71.42 |
| MTEB ToxicConversationsClassification (test) | ap | 14.65 |
| MTEB ToxicConversationsClassification (test) | f1 | 55.07 |
| MTEB TweetSentimentExtractionClassification (test) | accuracy | 60.92 |
| MTEB TweetSentimentExtractionClassification (test) | f1 | 61.24 |
| MTEB TwentyNewsgroupsClustering (test) | v_measure | 49.21 |
| MTEB TwitterSemEval2015 (test) | cos_sim_accuracy | 86.23 |
| MTEB TwitterSemEval2015 (test) | cos_sim_ap | 74.27 |
| MTEB TwitterSemEval2015 (test) | cos_sim_f1 | 68.72 |
| MTEB TwitterSemEval2015 (test) | cos_sim_precision | 64.56 |
| MTEB TwitterSemEval2015 (test) | cos_sim_recall | 73.46 |
| MTEB TwitterSemEval2015 (test) | dot_accuracy | 86.23 |
| MTEB TwitterSemEval2015 (test) | dot_ap | 74.27 |
| MTEB TwitterSemEval2015 (test) | dot_f1 | 68.72 |
| MTEB TwitterSemEval2015 (test) | dot_precision | 64.56 |
| MTEB TwitterSemEval2015 (test) | dot_recall | 73.46 |
| MTEB TwitterSemEval2015 (test) | euclidean_accuracy | 86.23 |
| MTEB TwitterSemEval2015 (test) | euclidean_ap | 74.27 |
| MTEB TwitterSemEval2015 (test) | euclidean_f1 | 68.72 |
| MTEB TwitterSemEval2015 (test) | euclidean_precision | 64.56 |
| MTEB TwitterSemEval2015 (test) | euclidean_recall | 73.46 |
| MTEB TwitterSemEval2015 (test) | manhattan_accuracy | 86.17 |
| MTEB TwitterSemEval2015 (test) | manhattan_ap | 74.21 |
| MTEB TwitterSemEval2015 (test) | manhattan_f1 | 68.64 |
| MTEB TwitterSemEval2015 (test) | manhattan_precision | 63.59 |
| MTEB TwitterSemEval2015 (test) | manhattan_recall | 74.56 |
| MTEB TwitterSemEval2015 (test) | max_accuracy | 86.23 |
| MTEB TwitterSemEval2015 (test) | max_ap | 74.27 |
| MTEB TwitterSemEval2015 (test) | max_f1 | 68.72 |
| MTEB TwitterURLCorpus (test) | cos_sim_accuracy | 89.37 |
| MTEB TwitterURLCorpus (test) | cos_sim_ap | 86.65 |
| MTEB TwitterURLCorpus (test) | cos_sim_f1 | 79.03 |
| MTEB TwitterURLCorpus (test) | cos_sim_precision | 75.36 |
| MTEB TwitterURLCorpus (test) | cos_sim_recall | 83.07 |
| MTEB TwitterURLCorpus (test) | dot_accuracy | 89.37 |
| MTEB TwitterURLCorpus (test) | dot_ap | 86.65 |
| MTEB TwitterURLCorpus (test) | dot_f1 | 79.03 |
| MTEB TwitterURLCorpus (test) | dot_precision | 75.36 |
| MTEB TwitterURLCorpus (test) | dot_recall | 83.07 |
| MTEB TwitterURLCorpus (test) | euclidean_accuracy | 89.37 |
| MTEB TwitterURLCorpus (test) | euclidean_ap | 86.65 |
| MTEB TwitterURLCorpus (test) | euclidean_f1 | 79.03 |
| MTEB TwitterURLCorpus (test) | euclidean_precision | 75.36 |
| MTEB TwitterURLCorpus (test) | euclidean_recall | 83.07 |
| MTEB TwitterURLCorpus (test) | manhattan_accuracy | 89.37 |
| MTEB TwitterURLCorpus (test) | manhattan_ap | 86.65 |
| MTEB TwitterURLCorpus (test) | manhattan_f1 | 79.07 |
| MTEB TwitterURLCorpus (test) | manhattan_precision | 76.41 |
| MTEB TwitterURLCorpus (test) | manhattan_recall | 81.93 |
| MTEB TwitterURLCorpus (test) | max_accuracy | 89.37 |
| MTEB TwitterURLCorpus (test) | max_ap | 86.65 |
| MTEB TwitterURLCorpus (test) | max_f1 | 79.07 |
Benchmarks
No submitted benchmark reports yet.