Code

feat: add server dataset hub import#5591

Code

Merged

jfcalvo merged 21 commits intofeat/argilla-direct-feature-branchargilla-io/argilla:feat/argilla-direct-feature-branchfrom feat/add-hub-dataset-importargilla-io/argilla:feat/add-hub-dataset-importCopy head branch name to clipboardOct 18, 2024

+1,066-266

Commits

Commits on Oct 10, 2024

• feat: first iteration of background job to import datasets from hub

  jfcalvo

  committed
  b2594b9

  Copy full SHA for b2594b9

Commits on Oct 11, 2024

• feat: improve import_dataset_from_hub_job to get dataset before instantiate HubDataset class

  jfcalvo

  committed
  6108ffe

  Copy full SHA for 6108ffe

• feat: improve HubDataset batch processing

  jfcalvo

  committed
  3a875ee

  Copy full SHA for 3a875ee

• feat: use UpsertRecordsBulk of CreateRecordsBulk for importing datasets from hub

  jfcalvo

  committed
  b10a92e

  Copy full SHA for b10a92e

• feat: transform dataset importing value columns with PIL images to data URLs

  jfcalvo

  committed
  2b47522

  Copy full SHA for 2b47522

Commits on Oct 14, 2024

• feat: add support to map suggestions importing datasets from hub

  jfcalvo

  committed
  7f93e0b

  Copy full SHA for 7f93e0b

• Merge branch 'feat/argilla-direct-feature-branch' into feat/add-hub-dataset-import

  frascuchon

  authored
  07aeec6

  Copy full SHA for 07aeec6

• Merge branch 'feat/argilla-direct-feature-branch' into feat/add-hub-dataset-import

  frascuchon

  authored
  83237a7

  Copy full SHA for 83237a7

• feat: add support for hub dataset mapping

  jfcalvo

  committed
  a38fdda

  Copy full SHA for a38fdda

• feat: set metadata and suggestions as optional for HubDatasetMapping

  jfcalvo

  committed
  15d694f

  Copy full SHA for 15d694f

• feat: when no external_id is mapped row_idx is used

  jfcalvo

  committed
  c3752e8

  Copy full SHA for c3752e8

Commits on Oct 15, 2024

• feat: use streaming when loading the dataset

  jfcalvo

  committed
  469ebc4

  Copy full SHA for 469ebc4

• feat: refactor UpsertRecordsBulk to validate records individually

  jfcalvo

  committed
  b665019

  Copy full SHA for b665019

• feat: ignore invalid records when importing datasets from hub

  jfcalvo

  committed
  a2fbc10

  Copy full SHA for a2fbc10

• Merge branch 'feat/argilla-direct-feature-branch' into feat/add-hub-dataset-import

  jfcalvo

  authored
  f3e33bd

  Copy full SHA for f3e33bd

Commits on Oct 16, 2024

• Merge branch 'feat/argilla-direct-feature-branch' into feat/add-hub-dataset-import

  frascuchon

  authored
  fde2603

  Copy full SHA for fde2603

Commits on Oct 17, 2024

• feat: add a fixed number of rows to take importing dataset from Hub (#5597)

  Show description for 3d1f04f
  

  jfcalvo

  and

  frascuchon

  authored
  3d1f04f

  Copy full SHA for 3d1f04f

• Merge branch 'feat/argilla-direct-feature-branch' into feat/add-hub-dataset-import

  jfcalvo

  committed
  e84fb45

  Copy full SHA for e84fb45

Commits on Oct 18, 2024

• feat: add support for class labels and casting rows (#5601)

  Show description for 08ebe28
  jfcalvo

  authored
  08ebe28

  Copy full SHA for 08ebe28

• feat: improve HubDataset image processing support (#5606)

  Show description for 312551a
  jfcalvo

  authored
  312551a

  Copy full SHA for 312551a

• feat: add support to -1 no label values for ClassLabel dataset features (#5607)

  Show description for f064267
  

  jfcalvo

  and

  pre-commit-ci[bot]

  authored
  f064267

  Copy full SHA for f064267