Code

Merge main v2 #1504

Code

Merged

KennethEnevoldsen merged 25 commits intov2.0.0embeddings-benchmark/mteb:v2.0.0from merge_main_v2_embeddings-benchmark/mteb:merge_main_v2_Copy head branch name to clipboardNov 27, 2024

+1,485-28

Commits

Commits on Nov 14, 2024

• fix: Count unique texts, data leaks in calculate metrics (#1438)

  Show description for dd5d226
  Samoed

  authored
  dd5d226

  Copy full SHA for dd5d226

• fix: update task metadata to allow for null (#1448)

  KennethEnevoldsen

  authored
  04ac3f2

  Copy full SHA for 04ac3f2

• Update tasks table

  github-actions[bot]

  committed
  f6a49fe

  Copy full SHA for f6a49fe

• 1.19.5

  Show description for 78c0e4e
  

  github-actions

  committed
  78c0e4e

  Copy full SHA for 78c0e4e

• Fix: Made data parsing in the leaderboard figure more robust (#1450)

  Show description for 4e86cea
  x-tabdeveloping

  authored
  4e86cea

  Copy full SHA for 4e86cea

• Fixed task loading (#1451)

  Show description for 039d010
  x-tabdeveloping

  authored
  039d010

  Copy full SHA for 039d010

• fix: publish (#1452)

  x-tabdeveloping

  authored
  feb1ab7

  Copy full SHA for feb1ab7

• 1.19.6

  Show description for 3397633
  

  github-actions

  committed
  3397633

  Copy full SHA for 3397633

• fix: Fix load external results with None mteb_version (#1453)

  Show description for 14d7523
  Samoed

  authored
  14d7523

  Copy full SHA for 14d7523

• 1.19.7

  Show description for 68eb498
  

  github-actions

  committed
  68eb498

  Copy full SHA for 68eb498

Commits on Nov 15, 2024

• WIP: Polishing up leaderboard UI (#1461)

  Show description for 58c459b
  x-tabdeveloping

  authored
  58c459b

  Copy full SHA for 58c459b

• fix: loading pre 1.11.0 (#1460)

  Show description for 1b920ac
  Samoed

  authored
  1b920ac

  Copy full SHA for 1b920ac

• 1.19.8

  Show description for a988fef
  

  github-actions

  committed
  a988fef

  Copy full SHA for a988fef

Commits on Nov 17, 2024

• fix: swap touche2020 to maintain compatibility (#1469)

  Show description for 9b2aece
  isaac-chung

  authored
  9b2aece

  Copy full SHA for 9b2aece

• 1.19.9

  Show description for 8bb4a29
  

  github-actions

  committed
  8bb4a29

  Copy full SHA for 8bb4a29

Commits on Nov 18, 2024

• docs: Add sum per language for task counts (#1468)

  Show description for 2fb6fe7
  isaac-chung

  authored
  2fb6fe7

  Copy full SHA for 2fb6fe7

Commits on Nov 19, 2024

• fix: pinned datasets to <3.0.0 (#1470)

  Napuh

  authored
  fde124a

  Copy full SHA for fde124a

• 1.19.10

  Show description for 7186e04
  

  github-actions

  committed
  7186e04

  Copy full SHA for 7186e04

Commits on Nov 21, 2024

• feat: add CUREv1 retrieval dataset (#1459)

  Show description for 1cc6c9e
  

  3 peopleauthored
  1cc6c9e

  Copy full SHA for 1cc6c9e

• Update tasks table

  github-actions[bot]

  committed
  4408717

  Copy full SHA for 4408717

• 1.20.0

  Show description for 3ff38ec
  

  github-actions

  committed
  3ff38ec

  Copy full SHA for 3ff38ec

Commits on Nov 26, 2024

• fix: check if model attr of model exists (#1499)

  Show description for 917ad7f
  Samoed

  authored
  917ad7f

  Copy full SHA for 917ad7f

• 1.20.1

  Show description for cde720e
  

  github-actions

  committed
  cde720e

  Copy full SHA for cde720e

• Merge branch 'refs/heads/main' into merge_main_v2_

  Show description for 2f500e1
  Samoed

  committed
  2f500e1

  Copy full SHA for 2f500e1

• add cure statistics

  Samoed

  committed
  e48e75c

  Copy full SHA for e48e75c