Code

expand fsspec downstream connectors#1777

Code

Merged

rbiseck3 merged 38 commits intomainUnstructured-IO/unstructured:mainfrom roman/expand-fsspec-downstream-connectors-2Unstructured-IO/unstructured:roman/expand-fsspec-downstream-connectors-2Copy head branch name to clipboardOct 30, 2023

+760-129

Commits

Commits on Oct 30, 2023

• refactor writers into their own directory

  rbiseck3

  committed
  c48a670

  Copy full SHA for c48a670

• Add all other fsspec writers

  rbiseck3

  committed
  054081c

  Copy full SHA for 054081c

• Finish azure dest with e2e test

  rbiseck3

  committed
  eb199bd

  Copy full SHA for eb199bd

• Add s3 e2e test

  rbiseck3

  committed
  9b89d10

  Copy full SHA for 9b89d10

• Add box dest connector

  rbiseck3

  committed
  8d21ab3

  Copy full SHA for 8d21ab3

• Add dropbox dest connector

  rbiseck3

  committed
  8d0ec9e

  Copy full SHA for 8d0ec9e

• WIP: adding gcs dest connector

  rbiseck3

  committed
  a01edf8

  Copy full SHA for a01edf8

• finish setting up e2e test for gcs

  rbiseck3

  committed
  bbbe539

  Copy full SHA for bbbe539

• update changelog

  rbiseck3

  committed
  85c5cb8

  Copy full SHA for 85c5cb8

• Add cloud login for az and gcloud in CI

  rbiseck3

  committed
  50bc263

  Copy full SHA for 50bc263

• Add dest tests to ingest script

  rbiseck3

  committed
  20a207c

  Copy full SHA for 20a207c

• Add permissions to CI

  rbiseck3

  committed
  88a6d38

  Copy full SHA for 88a6d38

• Debugging CI

  rbiseck3

  committed
  a1e743a

  Copy full SHA for a1e743a

• Add generic kwargs input for all writers

  rbiseck3

  committed
  e17cc43

  Copy full SHA for e17cc43

• debugging CI

  rbiseck3

  committed
  c36a734

  Copy full SHA for c36a734

• debugging CI

  rbiseck3

  committed
  84dfbdb

  Copy full SHA for 84dfbdb

• debugging CI

  rbiseck3

  committed
  279c4bd

  Copy full SHA for 279c4bd

• Add cloud auth to upgest ingest job

  rbiseck3

  committed
  00d4aa4

  Copy full SHA for 00d4aa4

• Add permissions to upgest ingest job

  rbiseck3

  committed
  a0e4c8c

  Copy full SHA for a0e4c8c

• debugging CI

  rbiseck3

  committed
  275062f

  Copy full SHA for 275062f

• debugging CI

  rbiseck3

  committed
  0cf5fb2

  Copy full SHA for 0cf5fb2

• debugging CI

  rbiseck3

  committed
  e54c1b9

  Copy full SHA for e54c1b9

• debugging CI

  rbiseck3

  committed
  ef659fd

  Copy full SHA for ef659fd

• move permissions to top level

  

  tabossert

  authored and

  rbiseck3

  committed
  e5bf533

  Copy full SHA for e5bf533

• move permissions to top level

  

  tabossert

  authored and

  rbiseck3

  committed
  de47529

  Copy full SHA for de47529

• bump version

  

  tabossert

  authored and

  rbiseck3

  committed
  718b789

  Copy full SHA for 718b789

• activate gcp credentials

  

  tabossert

  authored and

  rbiseck3

  committed
  d4742e6

  Copy full SHA for d4742e6

• test logins

  

  tabossert

  authored and

  rbiseck3

  committed
  80aae66

  Copy full SHA for 80aae66

• add login command

  

  tabossert

  authored and

  rbiseck3

  committed
  71ccbc1

  Copy full SHA for 71ccbc1

• update path to credentials file

  

  tabossert

  authored and

  rbiseck3

  committed
  8c366a1

  Copy full SHA for 8c366a1

• add test commnds

  

  tabossert

  authored and

  rbiseck3

  committed
  d17a588

  Copy full SHA for d17a588

• remove extra steps for gcloud

  

  tabossert

  authored and

  rbiseck3

  committed
  e3c2df7

  Copy full SHA for e3c2df7

• add back setup cloud sdk

  

  tabossert

  authored and

  rbiseck3

  committed
  f773223

  Copy full SHA for f773223

• debugging CI

  rbiseck3

  committed
  37edcd3

  Copy full SHA for 37edcd3

• set environment for azure federated login

  

  tabossert

  authored and

  rbiseck3

  committed
  9deb94a

  Copy full SHA for 9deb94a

• Fix s3 dest test

  rbiseck3

  committed
  482ccc0

  Copy full SHA for 482ccc0

• fix shellcheck

  rbiseck3

  committed
  3a350c8

  Copy full SHA for 3a350c8

• expand fsspec downstream connectors <- Ingest test fixtures update (#1938)

  Show description for 463f4c3
  

  ryannikolaidis

  and

  rbiseck3

  committed
  463f4c3

  Copy full SHA for 463f4c3