Skip to content

Commit

Permalink
Changelog 2024-05-20 (#1031)
Browse files Browse the repository at this point in the history
* Automated commit: Create changelog files

* Improved changelog

* Improved changelog

* Improved changelog

* Improved changelog

* Fixed typo

---------

Co-authored-by: Lucie Milan <[email protected]>
Co-authored-by: Anaëlle <[email protected]>
  • Loading branch information
3 people authored May 22, 2024
1 parent 87e95dd commit e06fb0a
Show file tree
Hide file tree
Showing 3 changed files with 60 additions and 0 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
---
title: "Mambu (v4) bug fix: Date windowing pagination use"
content-type: "changelog-entry"
date: 2024-05-13
entry-type: bug-fix
entry-category: integration
connection-id: mambu
connection-version: 4
pull-request: "https://github.com/singer-io/tap-mambu/pull/113"
---
{{ site.data.changelog.metadata.single-integration | flatify }}

We've updated our {{ this-connection.display_name }} (v{{ this-connection.this-version }}) integration to fix issues during the integration execution:

- Out-Of-Memory Issue:
Initially, all records from the start date to the current date were pulled, and the integration allowed generator buffers to grow without limit, surpassing the default extraction memory limits rapidly.
To address this, we implemented date windowing (default size = 1 day) and pagination for multi-threaded streams, a limited generator buffer growth to finite boundaries and we eliminated performance metrics to reduce performance overheads.
- Execution Time:
Previously, to address performance concerns, a single-threaded implementation was adopted, resulting in slow extraction speeds.
Multi-threaded execution has been reintroduced to expedite historical sync execution with a maximum thread count equal to 20.
- Data Discrepancy:
Data discrepancies were reported in certain streams after the extraction gets interrupted due to extraction timeout and memory issue.
The bookmark strategy has been revised for multi-threaded generators to address data discrepancies.
We segregated the `LoanAccounts` sub-stream bookmarking to rectify data inconsistencies.
17 changes: 17 additions & 0 deletions _changelog-files/2024/2024-05-14-ga4-v1-new-field-exclusions.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: "Google Analytics 4 (v1) update: New field exclusions"
content-type: "changelog-entry"
date: 2024-05-14
entry-type: updated-feature
entry-category: integration
connection-id: google-analytics-4
connection-version: 1
pull-request: "https://github.com/singer-io/tap-ga4/pull/104"
---
{{ site.data.changelog.metadata.single-integration | flatify }}

We've updated our {{ this-connection.display_name }} (v{{ this-connection.this-version }}) integration to add new field exclusions to avoid the following error:

```
Error: 400 Cannot have filter_partition dimension without specifying filter-partitions in the request.
```
19 changes: 19 additions & 0 deletions _changelog-files/2024/2024-05-14-mongodb-v3-string-projection.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
---
title: "MongoDB (v3) update: String projection"
content-type: "changelog-entry"
date: 2024-05-14
entry-type: improvement
entry-category: integration
connection-id: mongodb
connection-version: 3
pull-request: "https://github.com/singer-io/tap-mongodb/pull/94"
---
{{ site.data.changelog.metadata.single-integration | flatify }}

We've improved our {{ this-connection.display_name }} (v{{ this-connection.this-version }}) integration to allow the specification of a string projection, instead of using only integer values.

For example, the following sample projection now works:

```
{"name": "$personName"}
```

0 comments on commit e06fb0a

Please sign in to comment.