Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

conduit 0.11.0 #180389

Merged
merged 2 commits into from
Aug 8, 2024
Merged

conduit 0.11.0 #180389

merged 2 commits into from
Aug 8, 2024

Conversation

BrewTestBot
Copy link
Member

Created by brew bump


Created with brew bump-formula-pr.

release notes
**Schema Support:**
- Introduced comprehensive schema support, allowing schemas to be attached to records.
- Integrated a built-in schema registry, with the option to use an external schema registry.
- Enhanced standalone connectors to retain type information.

Connector Improvements:

  • Introduced middleware for automatic schema handling in built-in connectors and processors.
  • Postgres Connector:
    • Added support for incremental snapshots in logical replication mode.
    • Improved management of logical replication slots.

Processor Improvements:

  • error
    • Introduced an error processor to send records to DLQ or fail the pipeline based on conditions.
  • webhook.http
    • Added the ability to specify headers in the webhook.http processor.
  • field.convert
    • Extended to support conversion to Go time.Time objects, handling unix nano timestamps and RFC3339 formatted dates.
  • avro.encode and avro.decode
    • Updated to use Conduit’s built-in schema registry.

Internal Improvements:

  • Fixed bug causing a panic when trying to run a partial pipeline.

Changelog

  • ab0ecac44926ce880d4587f00afb380cf9346042: Mention storage options in README (#1730) (@hariso)
  • 428e6513cb564787213c01b88485b45fec4d7865: Database implementation for SQLite3 (#1682) (@lyuboxa)
  • bf9b0c71cbe3daddfc1a8e189d3a5ce133241be1: Include conduit-schema-registry in release instructions (#1713) (@hariso)
  • 840a6503ff5f6843108a966372571731a82040fb: More info about Postgres connection string (#1726) (@hariso)
  • 733924125894f07429f05e1b13b150b2e2fd6d34: Replace panic with error message when not declaring a source node in .yml config (#1695) (@AdamHaffar)
  • 1397d5d09d1339fde34ac53aa72aaffbe01c8743: Replace pkg/foundation/database with commons, use schema registry with DB (#1720) (@hariso)
  • 930afaea992c285f707b519f54f1d424e4b4236e: Schema support (#1702) (@lovromazgon)
  • 3a9d2449c517996b1e0d5a02bc68f2a28fb3aefb: Tests and examples for converting time using field.convert (#1745) (@lovromazgon)
  • 5c956e105bf88710d02c7214654a584c495c2b52: Update SDK, protocol, Kafka connector (#1731) (@hariso)
  • 7601e0691d48567da75a83df42356d6d783c464d: Update dependencies for v0.11.0 (#1756) (@lovromazgon)
  • f53d710ce2ff86b57cbd79e2534529aa24032b0f: Update linter config (#1675) (@hariso)
  • d6e83ced30593dec6c18ec300a4d974aa3332f7c: Update processor SDK, add middleware (#1742) (@lovromazgon)
  • 06bd6e58cb1ff17841319897109dfade369a5ddd: Use connector protocol v2 (#1622) (@lovromazgon)
  • 0d5929dab3956a709c2a2aa150324c805ce75318: Use gofumpt (#1741) (@hariso)
  • d370cd5dd3a7aef86d60a0defa2778b3f1323af2: Use interpreter runtime in wasm tests (#1746) (@lovromazgon)
  • 306defe702c8ea4659fd3c56b3ef469169ed27b2: Wrap builtin processors in middleware in examples (#1748) (@lovromazgon)
  • 76c25f1d1c140e65164e5ec5147a0fbe5d7e2830: [Schemas] Handle name conflicts (#1718) (@hariso)
  • 203aeb78ca58a0267924a59026b8dceecf39f94c: [Schemas] Limit schema service usage to connectors (#1701) (@hariso)
  • 817d52c3184f33e7b4b542afc8b794196a68c420: [Schemas] Use configured schema service in Avro processors (#1743) (@hariso)
  • a9812b7cd2df1d4870632bb748e4677a74e31e53: add getSchema and createSchema for wasm processors (#1683) (@maha-hajja)
  • 76151f42bcb43e42d7f3814531e75a5abfb099ba: change keep-n-most-recent to cut-off (required parameter) (#1689) (@lovromazgon)
  • 6b9dfa2cbc17f812974797a62693f7831d81d8ef: doc: update releases template (#1749) (@raulb)
  • fd9f261f5bf3aedf4aa02f896dcb6cfbd55f1a1f: don't release win/i386 (#1703) (@lovromazgon)
  • 7bb8cd8d6643c65a2d2551ba3f0c7d3f01fa3148: enable container-retention-policy action (#1693) (@lovromazgon)
  • a8d76dcc0dae2347d3e41fce16868e0c7d7537b2: feat: sets environment variable based on log level (#1740) (@raulb)
  • 2da3a0b378d0e7b188984d2d6f8d2e02b3614ba1: refactor: architecture documentation (#1732) (@raulb)
  • b6fa5becefc67aa38bfdfb88f341a9924959a69a: support empty .payload.After / .payload.Before in avro.decode (#1678) (@samirketema)
  • fab3ab90480abd01abaa13664638b18e74de5292: update swagger ui (#1711) (@lovromazgon)

Release Artifacts

OSX Darwin

Linux

Windows

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.11.0

@github-actions github-actions bot added go Go use is a significant feature of the PR or issue nodejs Node or npm use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Aug 7, 2024
conduit: update test

Signed-off-by: Rui Chen <[email protected]>
Copy link
Contributor

github-actions bot commented Aug 8, 2024

@github-actions github-actions bot added the CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. label Aug 8, 2024
@BrewTestBot BrewTestBot added this pull request to the merge queue Aug 8, 2024
Merged via the queue into master with commit 37eae9b Aug 8, 2024
15 checks passed
@BrewTestBot BrewTestBot deleted the bump-conduit-0.11.0 branch August 8, 2024 13:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bump-formula-pr PR was created using `brew bump-formula-pr` CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. go Go use is a significant feature of the PR or issue nodejs Node or npm use is a significant feature of the PR or issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants