Sourced from meltano's releases.
v3.6.0 (2024-12-09)
Highlights
- The default value of
elt.buffer_size
was bumped from 10 MiB to 100 MiB. This should reduce the number of broken pipelines you may encounter when taps emit hefty records.- Logs emitted with the
meltano.core.logging.json_log_formatter
now include anexceptions
key containing a structured array of exception objects to aid in log parsing and debugging.- Mappings are now correctly auto-installed.
- Python 3.8 (EOL 2024/10) is no longer supported.
- Python 3.13 is now supported.
✨ New
- #8944 Suggest verifying stream selection after
meltano config ... test
fails- #8917 Bumped the default
elt.buffer_size
to 100 MiB- #8913 Include the Python version and machine type in system debug log message
- #8894 Fields marked as
unsupported
in the catalog are now marked as such in the output ofmeltano select --list --all
- #8889 The
args
attribute of plugin commands is now optional- #8786 Added an
--all
flag tomeltano state clear
to delete all state IDs -- Thanks@fauzxan
!- #8735 Add Content-Type to S3 state file uploads
- #8844 Support an environment variable for the
--full-refresh
flag -- Thanks@MutuT2
!- #8618 Python 3.13 is now supported
- #8737 Added
exceptions
to the log message when using the JSON formatter- #8626 Added a
--run-id
option tomeltano el[t]
- #8494 Added a
callsite_parameters
argument to the builtin log formatters, which adds source path, line number and function name fields to the emitted log🐛 Fixes
- #8949 Add newline at the end of plugin lock files
- #8914 Ask for confirmation in
meltano config ... reset
- #8869 Adding User friendly loader error when the loader is missing from the Meltano run. -- Thanks
@NishitSingh2023
!- #8852 Using the
--force
flag ofmeltano install
no longer causes plugin installation to crash when using theuv
venv backend- #8828 Show the correct value in the "Current value is still" warning for
meltano config set
-- Thanks@ReubenFrankel
!- #8815 A mapper is now auto-installed when one of its mappings is used in a command -- Thanks
@ReubenFrankel
!⚙️ Under the Hood
- #8851 Decoupled the
JobState
ORM model of the system db from state store implementations- #8898 Use
importlib.resources
to read package files and useimportlib.metadata
to detect "editable" installations (via PEP 610)- #8830 Dropped support for EOL Python 3.8
📚 Documentation Improvements
- #8950 Document Git requirement and add
uv
section- #8937 Use tabs for code blocks with OS-specific instructions in Getting Started guide
- #8934 Document a logging example to log at DEBUG level but excluding extractor/loader stdout
- #8909 Update part1.mdx
- #8829 Update Azure state backend connection documentation for DefaultAzureCredential -- Thanks
@acarter24
!
... (truncated)
Sourced from meltano's changelog.
v3.6.0 (2024-12-09)
✨ New
- #8944 Suggest verifying stream selection after
meltano config ... test
fails- #8917 Bumped the default
elt.buffer_size
to 100 MiB- #8913 Include the Python version and machine type in system debug log message
- #8894 Fields marked as
unsupported
in the catalog are now marked as such in the output ofmeltano select --list --all
- #8889 The
args
attribute of plugin commands is now optional- #8786 Added an
--all
flag tomeltano state clear
to delete all state IDs -- Thanks@fauzxan
!- #8735 Add Content-Type to S3 state file uploads
- #8844 Support an environment variable for the
--full-refresh
flag -- Thanks@MutuT2
!- #8618 Python 3.13 is now supported
- #8737 Added
exceptions
to the log message when using the JSON formatter- #8626 Added a
--run-id
option tomeltano el[t]
- #8494 Added a
callsite_parameters
argument to the builtin log formatters, which adds source path, line number and function name fields to the emitted log🐛 Fixes
- #8949 Add newline at the end of plugin lock files
- #8914 Ask for confirmation in
meltano config ... reset
- #8869 Adding User friendly loader error when the loader is missing from the Meltano run. -- Thanks
@NishitSingh2023
!- #8852 Using the
--force
flag ofmeltano install
no longer causes plugin installation to crash when using theuv
venv backend- #8828 Show the correct value in the "Current value is still" warning for
meltano config set
-- Thanks@ReubenFrankel
!- #8815 A mapper is now auto-installed when one of its mappings is used in a command -- Thanks
@ReubenFrankel
!⚙️ Under the Hood
- #8851 Decoupled the
JobState
ORM model of the system db from state store implementations- #8898 Use
importlib.resources
to read package files and useimportlib.metadata
to detect "editable" installations (via PEP 610)- #8830 Dropped support for EOL Python 3.8
📚 Documentation Improvements
- #8950 Document Git requirement and add
uv
section- #8937 Use tabs for code blocks with OS-specific instructions in Getting Started guide
- #8934 Document a logging example to log at DEBUG level but excluding extractor/loader stdout
- #8909 Update part1.mdx
- #8829 Update Azure state backend connection documentation for DefaultAzureCredential -- Thanks
@acarter24
!- #8809 Bumped Docusaurus to 3.1, fixed broken links and started printing warnings on broken anchors
- #8752 Added 2024-Q3 changelog
- #8808 Fixed broken anchor links in settings page
📦 Packaging changes
... (truncated)
1d0c978
chore: Release v3.6.0 (#8952)2376655
docs: Document Git requirement and add uv
section (#8950)635adf5
chore(deps-dev): Bump the development-dependencies group with 4 updates
(#8954)e877854
packaging(deps): Bump the runtime-dependencies group with 3 updates (#8956)a9c672a
chore(deps): Bump path-to-regexp and express in /docs (#8959)d4a8a5c
chore(deps-dev): Bump the development-dependencies group in /docs with 4
upda...7179c96
ci: Bump the actions group with 2 updates (#8955)4d43848
ci: Bump poetry from 1.8.4 to 1.8.5 in /.github/workflows in the default
grou...8d4ca34
fix: Add newline at the end of plugin lock files (#8949)6befccc
chore: pre-commit autoupdate (#8948)