Code

BREAKING: v2.0.0#1433

Code

Draft

KennethEnevoldsen wants to merge 22 commits intomainembeddings-benchmark/mteb:mainfrom v2.0.0embeddings-benchmark/mteb:v2.0.0Copy head branch name to clipboard

+721,585-9,856

Commits

Commits on Nov 11, 2024

• fix: Ensure seed is based on RNG State (#1193)

  KennethEnevoldsen

  authored
  e2520df

Commits on Nov 13, 2024

• Consolidate Retrieval/Reranking/Instruction Variants (#1359)

  Show description for 9c58518
  

  orionw

  and

  Samoed

  authored
  9c58518

Commits on Nov 14, 2024

• fix: Unsure TaskResults can handle runtime and version being unspecified

  KennethEnevoldsen

  committed
  2a8a370

• Merge branch 'v2.0.0' of https://github.com/embeddings-benchmark/mteb into v2.0.0

  KennethEnevoldsen

  committed
  dea2b77

• fix: remove NaN handling for retrieval

  KennethEnevoldsen

  committed
  23d6cb2

• Merge branch 'main' into v2.0.0

  KennethEnevoldsen

  committed
  8868cd4

• fix: Merge main into v2 (#1454)

  Show description for 5470c88
  

  4 peopleauthored
  5470c88

Commits on Nov 15, 2024

• feat: enable codecarbon by default (#1428)

  Show description for 70a3ff2
  

  Samoed

  and

  isaac-chung

  authored
  70a3ff2

Commits on Nov 18, 2024

• Add decriptive stat almost to all datasets (#1466)

  Show description for 0e9b6fd
  Samoed

  authored
  0e9b6fd

Commits on Nov 19, 2024

• fix: Fix test for empty descriptive tasks (#1413)

  Show description for 0a5bedb
  Samoed

  authored
  0a5bedb

• fix: pin datasets version <3.0.0 (#1471)

  Napuh

  authored
  6da2a1a

• feat: Multilingual retrieval loader (#1473)

  Show description for a27de33
  Samoed

  authored
  a27de33

Commits on Nov 21, 2024

• fix: add citations to ModelMeta (#1477)

  Show description for 0df0210
  Samoed

  authored
  0df0210

• Add descriptive stats to mising tasks and add number of qrels (#1476)

  Show description for 0abe1a0
  

  imenelydiaker

  and

  Samoed

  authored
  0abe1a0

Commits on Nov 23, 2024

• 1475 add descriptive stats to all tasks v2 (#1482)

  Show description for a7a5214
  

  3 peopleauthored
  a7a5214

• fix: Fix BrightRetrieval calculate stats (#1484)

  Show description for 99247b2
  Samoed

  authored
  99247b2

Commits on Nov 27, 2024

• Merge main v2 (#1504)

  Show description for 022d355
  

  10 peopleauthored
  022d355

• Fix: retrieval stats (#1496)

  Show description for 6383950
  Samoed

  authored
  6383950

Commits on Nov 28, 2024

• fix: hatespeech filipino (#1522)

  Show description for d54fb75
  Samoed

  authored
  d54fb75

Commits on Dec 4, 2024

• feat: Forbid task metadata and add upload functions (#1362)

  Show description for dec5d6a
  

  Samoed

  and

  KennethEnevoldsen

  authored
  dec5d6a

Commits on Dec 9, 2024

• fix: remove * imports (#1569)

  Show description for d0aa3a7
  Samoed

  authored
  d0aa3a7

Commits on Dec 10, 2024

• Merge branch 'refs/heads/main' into v2.0.0

  Show description for f16deb6
  Samoed

  committed
  f16deb6