-
Notifications
You must be signed in to change notification settings - Fork 39
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* Automated commit: Create changelog files * Improved changelog * Improved changelog * Improved changelog * Improved changelog * Fixed typo --------- Co-authored-by: Lucie Milan <[email protected]> Co-authored-by: Anaëlle <[email protected]>
- Loading branch information
1 parent
87e95dd
commit e06fb0a
Showing
3 changed files
with
60 additions
and
0 deletions.
There are no files selected for viewing
24 changes: 24 additions & 0 deletions
24
_changelog-files/2024/2024-05-13-mambu-v4-fix-date-windowing-pagination-use.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
--- | ||
title: "Mambu (v4) bug fix: Date windowing pagination use" | ||
content-type: "changelog-entry" | ||
date: 2024-05-13 | ||
entry-type: bug-fix | ||
entry-category: integration | ||
connection-id: mambu | ||
connection-version: 4 | ||
pull-request: "https://github.com/singer-io/tap-mambu/pull/113" | ||
--- | ||
{{ site.data.changelog.metadata.single-integration | flatify }} | ||
|
||
We've updated our {{ this-connection.display_name }} (v{{ this-connection.this-version }}) integration to fix issues during the integration execution: | ||
|
||
- Out-Of-Memory Issue: | ||
Initially, all records from the start date to the current date were pulled, and the integration allowed generator buffers to grow without limit, surpassing the default extraction memory limits rapidly. | ||
To address this, we implemented date windowing (default size = 1 day) and pagination for multi-threaded streams, a limited generator buffer growth to finite boundaries and we eliminated performance metrics to reduce performance overheads. | ||
- Execution Time: | ||
Previously, to address performance concerns, a single-threaded implementation was adopted, resulting in slow extraction speeds. | ||
Multi-threaded execution has been reintroduced to expedite historical sync execution with a maximum thread count equal to 20. | ||
- Data Discrepancy: | ||
Data discrepancies were reported in certain streams after the extraction gets interrupted due to extraction timeout and memory issue. | ||
The bookmark strategy has been revised for multi-threaded generators to address data discrepancies. | ||
We segregated the `LoanAccounts` sub-stream bookmarking to rectify data inconsistencies. |
17 changes: 17 additions & 0 deletions
17
_changelog-files/2024/2024-05-14-ga4-v1-new-field-exclusions.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
--- | ||
title: "Google Analytics 4 (v1) update: New field exclusions" | ||
content-type: "changelog-entry" | ||
date: 2024-05-14 | ||
entry-type: updated-feature | ||
entry-category: integration | ||
connection-id: google-analytics-4 | ||
connection-version: 1 | ||
pull-request: "https://github.com/singer-io/tap-ga4/pull/104" | ||
--- | ||
{{ site.data.changelog.metadata.single-integration | flatify }} | ||
|
||
We've updated our {{ this-connection.display_name }} (v{{ this-connection.this-version }}) integration to add new field exclusions to avoid the following error: | ||
|
||
``` | ||
Error: 400 Cannot have filter_partition dimension without specifying filter-partitions in the request. | ||
``` |
19 changes: 19 additions & 0 deletions
19
_changelog-files/2024/2024-05-14-mongodb-v3-string-projection.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,19 @@ | ||
--- | ||
title: "MongoDB (v3) update: String projection" | ||
content-type: "changelog-entry" | ||
date: 2024-05-14 | ||
entry-type: improvement | ||
entry-category: integration | ||
connection-id: mongodb | ||
connection-version: 3 | ||
pull-request: "https://github.com/singer-io/tap-mongodb/pull/94" | ||
--- | ||
{{ site.data.changelog.metadata.single-integration | flatify }} | ||
|
||
We've improved our {{ this-connection.display_name }} (v{{ this-connection.this-version }}) integration to allow the specification of a string projection, instead of using only integer values. | ||
|
||
For example, the following sample projection now works: | ||
|
||
``` | ||
{"name": "$personName"} | ||
``` |