Topics
Release Date: 2024-06-17
- ansible-test - Update
pypi-test-container
to version 3.1.0.
- Fix rapid memory usage growth when notifying handlers using the
listen
keyword (#83392) - Fix the task attribute
resolved_action
to show the FQCN instead ofNone
whenaction
orlocal_action
is used in the playbook. - Fix using
module_defaults
withlocal_action
/action
(#81905). - fixed unit test test_borken_cowsay to address mock not been properly applied when existing unix system already have cowsay installed.
- powershell - Implement more robust deletion mechanism for C# code compilation temporary files. This should avoid scenarios where the underlying temporary directory may be temporarily locked by antivirus tools or other IO problems. A failure to delete one of these temporary directories will result in a warning rather than an outright failure.
- shell plugin - properly quote all needed components of shell commands (#82535)
Release Date: 2024-05-20
- urls.py - Removed support for Python 2
- Add
dump
andpassno
mount information to facts component (#80478) - Added MIRACLE LINUX 9.2 in RedHat OS Family.
- Interpreter Discovery - Remove hardcoded references to specific python interpreters to use for certain distro versions, and modify logic for python3 to become the default.
- Use Python's built-in
functools.update_wrapper
instead an inline copy from Python 3.7. - User can now set ansible.log to record higher verbosity than what is specified for display via new configuration item LOG_VERBOSITY.
DEFAULT_PRIVATE_ROLE_VARS
is now overridden by explicit setting ofpublic
forinclude_roles
andimport_roles
.ansible-galaxy role|collection init
- accept--extra-vars
to supplement/override the variablesansible-galaxy
injects for templating.j2
files in the skeleton.import_role
action now also gets apublic
option that controls variable exports, default depending onDEFAULT_PRIVATE_ROLE_VARS
(if using defaults equates topublic=True
).- added configuration item
TARGET_LOG_INFO
that allows the user/author to add an information string to the log output on targets. - ansible-doc - treat double newlines in documentation strings as paragraph breaks. This is useful to create multi-paragraph notes in module/plugin documentation (#82465).
- ansible-doc output has been revamped to make it more visually pleasing when going to a terminal, also more concise, use -v to show extra information.
- ansible-galaxy - Started normalizing build directory with a trailing separator when building collections, internally. (#81619).
- ansible-galaxy dependency resolution messages have changed the unexplained 'virtual' collection for the specific type ('scm', 'dir', etc) that is more user friendly
- ansible-test - Add Alpine 3.19 container.
- ansible-test - Add Alpine 3.19 to remotes.
- ansible-test - Add Fedora 39 container.
- ansible-test - Add Fedora 39 remote.
- ansible-test - Add a work-around for permission denied errors when using
pytest >= 8
on multi-user systems with an installed version ofansible-test
. - ansible-test - Add support for RHEL 9.3 remotes.
- ansible-test - Added a macOS 14.3 remote VM.
- ansible-test - Bump the
nios-test-container
from version 2.0.0 to version 3.0.0. - ansible-test - Containers and remotes managed by ansible-test will have their Python
EXTERNALLY-MANAGED
marker (PEP668) removed. This provides backwards compatibility for existing tests running in newer environments which mark their Python as externally managed. A future version of ansible-test may change this behavior, requiring tests to be adapted to such environments. - ansible-test - Make Python 3.12 the default version used in the
base
anddefault
containers. - ansible-test - Remove Alpine 3(.18) container.
- ansible-test - Remove Alpine 3.18 from remotes.
- ansible-test - Remove Fedora 38 remote support.
- ansible-test - Remove Fedora 38 test container.
- ansible-test - Remove rhel/9.2 test remote
- ansible-test - Remove the FreeBSD 13.2 remote.
- ansible-test - Removed fallback to
virtualenv
when-m venv
is non-functional. - ansible-test - Removed test remotes: macos/13.2
- ansible-test - Removed the
no-basestring
sanity test. The test is no longer necessary now that Python 3 is required. - ansible-test - Removed the
no-dict-iteritems
,no-dict-iterkeys
andno-dict-itervalues
sanity tests. The tests are no longer necessary since Python 3 is required. - ansible-test - Removed the
no-main-display
sanity test. The unwanted pattern is unlikely to occur, since the test has existed since Ansible 2.8. - ansible-test - Removed the
no-unicode-literals
sanity test. The test is unnecessary now that Python 3 is required and theunicode_literals
feature has no effect. - ansible-test - Special handling for installation of
cryptography
has been removed, as it is no longer necessary. - ansible-test - The
shellcheck
sanity test no longer disables theSC2164
check. In most cases, seeing this error means the script is missingset -e
. - ansible-test - The
unidiomatic-typecheck
rule has been enabled in thepylint
sanity test. - ansible-test - The
unidiomatic-typecheck
rule has been removed from thevalidate-modules
sanity test. - ansible-test - Update the base and default containers to use Ubuntu 22.04 for the base image. This also updates PowerShell to version 7.4.0 with .NET 8.0.0 and ShellCheck to version 0.8.0.
- ansible-test - Updated the CloudStack test container to version 1.7.0.
- ansible-test - Updated the distro test containers to version 6.3.0 to include coverage 7.3.2 for Python 3.8+. The alpine3 container is now based on 3.18 instead of 3.17 and includes Python 3.11 instead of Python 3.10.
- ansible-test - Updated the distro test containers to version 7.1.0.
- ansible-test - When ansible-test installs requirements, it now instructs pip to allow installs on externally managed environments as defined by PEP 668. This only occurs in ephemeral environments managed by ansible-test, such as containers, or when the --requirements option is used.
- ansible-test - When invoking
sleep
in containers during container setup, theenv
command is used to avoid invoking the shell builtin, if present. - ansible-test - document block name now included in error message for YAML parsing errors (#82353).
- ansible-test - sanity test allows
EXAMPLES
to be multi-document YAML (#82353). - ansible-test now has FreeBSD 13.3 and 14.0 support
- ansible.builtin.user - Remove user not found warning (#80267)
- apt_repository.py - use api.launchpad.net endpoint instead of launchpad.net/api
- async tasks can now also support check mode at the same time.
- async_status now supports check mode.
- constructed inventory plugin - Adding a note that only group_vars of explicit groups are loaded (#82580).
- csvfile - add a keycol parameter to specify in which column to search.
- dnf - add the
best
option - dnf5 - add the
best
option - filter plugin - Add the count and mandatory_count parameters in the regex_replace filter
- find - add a encoding parameter to specify which encoding of the files to be searched.
- git module - gpg_allowlist name was added in 2.17 and we will eventually deprecate the gpg_whitelist alias.
- import_role - allow subdirectories with
_from
options for parity withinclude_role
(#82584). - module argument spec - Allow module authors to include arbitrary additional context in the argument spec, by making use of a new top level key called
context
. This key should be a dict type. This allows for users to customize what they place in the argument spec, without having to ignore sanity tests that validate the schema. - modules - Add the ability for an action plugin to call
self._execute_module(*, ignore_unknown_opts=True)
to execute a module with options that may not be supported for the version being called. This tells the module basic wrapper to ignore validating the options provided match the arg spec. - package action now has a configuration that overrides the detected package manager, it is still overridden itself by the use option.
- py3compat - Remove
ansible.utils.py3compat
as it is no longer necessary - removed the unused argument
create_new_password
fromCLI.build_vault_ids
(#82066). - urls - Add support for TLS 1.3 post handshake certificate authentication - #81782
- urls - reduce complexity of
Request.open
- user - accept yescrypt hash as user password
- validate-modules tests now correctly handles
choices
in dictionary format.
- assert - Nested templating may result in an inability for the conditional to be evaluated. See the porting guide for more information.
- Old style vars plugins which use the entrypoints get_host_vars or get_group_vars are deprecated. The plugin should be updated to inherit from BaseVarsPlugin and define a get_vars method as the entrypoint.
- The 'required' parameter in 'ansible.module_utils.common.process.get_bin_path' API is deprecated (#82464).
module_utils
- importing the following convenience helpers fromansible.module_utils.basic
has been deprecated:get_exception
,literal_eval
,_literal_eval
,datetime
,signal
,types
,chain
,repeat
,PY2
,PY3
,b
,binary_type
,integer_types
,iteritems
,string_types
,test_type
,map
andshlex_quote
.- ansible-doc - role entrypoint attributes are deprecated and eventually will no longer be shown in ansible-doc from ansible-core 2.20 on (#82639, #82678).
- paramiko connection plugin, configuration items in the global scope are being deprecated and will be removed in favor or the existing same options in the plugin itself. Users should not need to change anything (how to configure them are the same) but plugin authors using the global constants should move to using the plugin's get_option().
- Remove deprecated APIs from ansible-docs (#81716).
- Remove deprecated JINJA2_NATIVE_WARNING environment variable (#81714)
- Remove deprecated
scp_if_ssh
from ssh connection plugin (#81715). - Remove deprecated crypt support from ansible.utils.encrypt (#81717)
- Removed Python 2.7 and Python 3.6 as a supported remote version. Python 3.7+ is now required for target execution.
- With the removal of Python 2 support, the yum module and yum action plugin are removed and redirected to
dnf
.
- ANSIBLE_NO_LOG - Address issue where ANSIBLE_NO_LOG was ignored (CVE-2024-0690)
- ansible-galaxy - Prevent roles from using symlinks to overwrite files outside of the installation directory (CVE-2023-5115)
- templating - Address issues where internal templating can cause unsafe variables to lose their unsafe designation (CVE-2023-5764)
- Add a version ceiling constraint for pypsrp to avoid potential breaking changes in the 1.0.0 release.
- All core lookups now use set_option(s) even when doing their own custom parsing. This ensures that the options are always the proper type.
- Allow for searching handler subdir for included task via include_role (#81722)
- AnsibleModule.atomic_move - fix preserving extended ACLs of the destination when it exists (#72929).
- Cache host_group_vars after instantiating it once and limit the amount of repetitive work it needs to do every time it runs.
- Call PluginLoader.all() once for vars plugins, and load vars plugins that run automatically or are enabled specifically by name subsequently.
- Consolidate systemd detection logic into one place (#80975).
- Consolidated the list of internal static vars, centralized them as constant and completed from some missing entries.
- Do not print undefined error message twice (#78703).
- Enable file cache for vaulted files during vars lookup to fix a strong performance penalty in huge and complex playbboks.
- Fix NEVRA parsing of package names that include digit(s) in them (#76463, #81018)
- Fix
force_handlers
not working withany_errors_fatal
(#36308) - Fix
run_once
being incorrectly interpreted on handlers (#81666) - Fix an issue when setting a plugin name from an unsafe source resulted in
ValueError: unmarshallable object
(#82708) - Fix check for missing _sub_plugin attribute in older connection plugins (#82954)
- Fix condition for unquoting configuration strings from ini files (#82387).
- Fix for when
any_errors_fatal
was ignored if error occurred in a block with always (#31543) - Fix handlers not being executed in lockstep using the linear strategy in some cases (#82307)
- Fix handling missing urls in ansible.module_utils.urls.fetch_file for Python 3.
- Fix issue where an
include_tasks
handler in a role was not able to locate a file intasks/
whentasks_from
was used as a role entry point andmain.yml
was not present (#82241) - Fix issues when tasks withing nested blocks wouldn't run when
force_handlers
is set (#81533) - Fix loading vars_plugins in roles (#82239).
- Fix notifying role handlers by listen keyword topics with the "role_name : " prefix (#82849).
- Fix setting proper locale for git executable when running on non english systems, ensuring git output can always be parsed.
- Fix tasks in always section not being executed for nested blocks with
any_errors_fatal
(#73246) - Fixes permission for cache json file from 600 to 644 (#82683).
- Give the tombstone error for
include
pre-fork like other tombstoned action/module plugins. - Harden python templates for respawn and ansiballz around str literal quoting
- Include the task location when a module or action plugin is deprecated (#82450).
- Interpreter discovery - Add
Amzn
toOS_FAMILY_MAP
for correct family fallback for interpreter discovery (#80882). - Mirror the behavior of dnf on the command line when handling NEVRAs with omitted epoch (#71808)
- Plugin loader does not dedupe nor cache filter/test plugins by file basename, but full path name.
- Properly template tags in parent blocks (#81053)
- Provide additional information about the alternative plugin in the deprecation message (#80561).
- Remove the galaxy_info field
platforms
from the role templates (#82453). - Restoring the ability of filters/tests can have same file base name but different tests/filters defined inside.
- Reword the error message when the module fails to parse parameters in JSON format (#81188).
- Reword warning if the reserved keyword _ansible_ used as a module parameter (#82514).
- Run all handlers with the same
listen
topic, even when notified from another handler (#82363). - Slight optimization to hostvars (instantiate template only once per host, vs per call to var).
- Stopped misleadingly advertising
async
mode support in thereboot
module (#71517). ansible-galaxy role import
- fix using therole_name
in a standalone role'sgalaxy_info
metadata by disabling automatic removal of theansible-role-
prefix. This matches the behavior of the Galaxy UI which also no longer implicitly removes theansible-role-
prefix. Use the--role-name
option or add arole_name
to thegalaxy_info
dictionary in the role'smeta/main.yml
to use an alternate role name.ansible-test sanity --test runtime-metadata
- addaction_plugin
as a valid field for modules in the schema (#82562).ansible.module_utils.service
- ensure binary data transmission indaemonize()
any_errors_fatal
should fail all hosts and rescue all of them when arescue
section is specified (#80981)include_role
- properly executev2_playbook_on_include
andv2_runner_on_failed
callbacks as well as increaseok
andfailed
stats in the play recap, when appropriate (#77336)- allow_duplicates - fix evaluating if the current role allows duplicates instead of using the initial value from the duplicate's cached role.
- ansible-config init will now dedupe ini entries from plugins.
- ansible-config will now properly template defaults before dumping them.
- ansible-doc - fixed "inicates" typo in output
- ansible-doc - format top-level descriptions with multiple paragraphs as multiple paragraphs, instead of concatenating them (#83155).
- ansible-galaxy - Deprecate use of the Galaxy v2 API (#81781)
- ansible-galaxy - Provide a better error message when using a requirements file with an invalid format - #81901
- ansible-galaxy - Resolve issue with the dataclass used for galaxy.yml manifest caused by using future annotations
- ansible-galaxy - ensure path to ansible collection when installing or downloading doesn't have a backslash (#79705).
- ansible-galaxy - started allowing the use of pre-releases for collections that do not have any stable versions published. (#81606)
- ansible-galaxy - started allowing the use of pre-releases for dependencies on any level of the dependency tree that specifically demand exact pre-release versions of collections and not version ranges. (#81606)
- ansible-galaxy error on dependency resolution will not error itself due to 'virtual' collections not having a name/namespace.
- ansible-galaxy info - fix reporting no role found when lookup_role_by_name returns None.
- ansible-galaxy role import - exit with 1 when the import fails (#82175).
- ansible-galaxy role install - fix installing roles from Galaxy that have version
None
(#81832). - ansible-galaxy role install - fix symlinks (#82702, #81965).
- ansible-galaxy role install - normalize tarfile paths and symlinks using
ansible.utils.path.unfrackpath
and consider them valid as long as the realpath is in the tarfile's role directory (#81965). - ansible-inventory - index available_hosts for major performance boost when dumping large inventories
- ansible-pull now will expand relative paths for the
-d|--directory
option is now expanded before use. - ansible-pull will now correctly handle become and connection password file options for ansible-playbook.
- ansible-test - Add a
pylint
plugin to work around a known issue on Python 3.12. - ansible-test - Explicitly supply
ControlPath=none
when setting up port forwarding over SSH to address the scenario where the local ssh configuration usesControlPath
for all hosts, and would prevent ports to be forwarded after the initial connection to the host. - ansible-test - Fix parsing of cgroup entries which contain a
:
in the path (#81977). - ansible-test - Include missing
pylint
requirements for Python 3.10. - ansible-test - Properly detect docker host when using
ssh://
protocol for connecting to the docker daemon. - ansible-test - The
libexpat
package is automatically upgraded during remote bootstrapping to maintain compatibility with newer Python packages. - ansible-test - The
validate-modules
sanity test no longer attempts to process files with unrecognized extensions as Python (resolves #82604). - ansible-test - Update
pylint
to version 3.0.1. - ansible-test ansible-doc sanity test - do not remove underscores from plugin names in collections before calling
ansible-doc
(#82574). - ansible-test validate-modules sanity test - do not treat leading underscores for plugin names in collections as an attempted deprecation (#82575).
- ansible-test — Python 3.8–3.12 will use
coverage
v7.3.2. - ansible.builtin.apt - calling clean = true does not properly clean certain cache files such as /var/cache/apt/pkgcache.bin and /var/cache/apt/pkgcache.bin (#82611)
- ansible.builtin.uri - the module was ignoring the
force
parameter and always requesting a cached copy (via theIf-Modified-Since
header) when downloading to an existing local file. Disable caching whenforce
istrue
, as documented (#82166). - ansible_managed restored it's 'templatability' by ensuring the possible injection routes are cut off earlier in the process.
- apt - honor install_recommends and dpkg_options while installing python3-apt library (#40608).
- apt - install recommended packages when installing package via deb file (#29726).
- apt_repository - do not modify repo files if the file is a symlink (#49809).
- apt_repository - update PPA URL to point to https URL (#82463).
- assemble - fixed missing parameter 'content' in _get_diff_data API (#82359).
- async - Fix bug that stopped running async task in
--check
whencheck_mode: False
was set as a task attribute - #82811 - blockinfile - when
create=true
is used with a filename without path, the module crashed (#81638). - check if there are attributes to set before attempting to set them (#76727)
- copy action now also generates temprary files as hidden ('.' prefixed) to avoid accidental pickup by running services that glob by extension.
- copy action now ensures that tempfiles use the same suffix as destination, to allow for
validate
to work with utilities that check extensions. - deb822_repository - handle idempotency if the order of parameters is changed (#82454).
- debconf - allow user to specify a list for value when vtype is multiselect (#81345).
- delegate_to when set to an empty or undefined variable will now give a proper error.
- distribution.py - Recognize ALP-Dolomite as part of the SUSE OS family in Ansible, fixing its previous misidentification (#82496).
- distro - bump bundled distro version from 1.6.0 to 1.8.0 (#81713).
- dnf - fix an issue when cached RPMs were left in the cache directory even when the keepcache setting was unset (#81954)
- dnf - fix an issue when installing a package by specifying a file it provides could result in installing a different package providing the same file than the package already installed resulting in resolution failure (#82461)
- dnf - properly set gpg check options on enabled repositories according to the
disable_gpg_check
option (#80110) - dnf - properly skip unavailable packages when
skip_broken
is enabled (#80590) - dnf - the
nobest
option only overrides the distribution default when explicitly used, and is used for all supported operations (#82616) - dnf5 - replace removed API calls
- dnf5 - respect
allow_downgrade
when installing packages directly from rpm files - dnf5 - the
nobest
option only overrides the distribution default when used - dwim functions for lookups should be better at detectging role context even in abscense of tasks/main.
- ensure we have logger before we log when we have increased verbosity.
- expect - fix argument spec error using timeout=null (#80982).
- fact gathering on linux now handles thread count by using rounding vs dropping decimals, it should give slightly more accurate numbers.
- facts - add a generic detection for VMware in product name.
- facts - detect VMware ESXi 8.0 virtualization by product name VMware20,1
- fetch - Do not calculate the file size for Windows fetch targets to improve performance.
- fetch - add error message when using
dest
with a trailing slash that becomes a local directory - #82878 - find - do not fail on Permission errors (#82027).
- first_found lookup now always returns a full (absolute) and normalized path
- first_found lookup now always takes into account k=v options
- flush_handlers - properly handle a handler failure in a nested block when
force_handlers
is set (http://github.com/ansible/ansible/issues/81532) - galaxy - skip verification for unwanted Python compiled bytecode files (#81628).
- handle exception raised while validating with elements='int' and value is not within choices (#82776).
- include_tasks - include ansible_loop_var and ansible_index_var in a loop (#82655).
- include_vars - fix calculating
depth
relative to the root and ensure all files are included (#80987). - interpreter_discovery - handle AnsibleError exception raised while interpreter discovery (#78264).
- iptables - add option choices 'src,src' and 'dst,dst' in match_set_flags (#81281).
- iptables - set jump to DSCP when set_dscp_mark or set_dscp_mark_class is set (#77077).
- known_hosts - Fix issue with @cert-authority entries in known_hosts incorrectly being removed.
- module no_log will no longer affect top level booleans, for example
no_log_module_parameter='a'
will no longer hidechanged=False
as a 'no log value' (matches 'a'). - moved assemble, raw, copy, fetch, reboot, script and wait_for_connection to query task instead of play_context ensuring they get the lastest and most correct data.
- reboot action now handles connections with 'timeout' vs only 'connection_timeout' settings.
- role params now have higher precedence than host facts again, matching documentation, this had unintentionally changed in 2.15.
- roles, code cleanup and performance optimization of dependencies, now cached, and
public
setting is now determined once, at role instantiation. - roles, the
static
property is now correctly set, this will fix issues withpublic
andDEFAULT_PRIVATE_ROLE_VARS
controls on exporting vars. - set_option method for plugins to update config now properly passes through type casting and validation.
- ssh - add tests for the SSH connection plugin.
- support url-encoded credentials in URLs like http://x%40:%40@example.com (#82552)
- syslog - Handle ValueError exception raised when sending Null Characters to syslog with Python 3.12.
- systemd_services - update documentation regarding required_one_of and required_by parameters (#82914).
- template - Fix error when templating an unsafe string which corresponds to an invalid type in Python (#82600).
- template action will also inherit the behavior from copy (as it uses it internally).
- templating - ensure syntax errors originating from a template being compiled into Python code object result in a failure (#82606)
- unarchive - add support for 8 character permission strings for zip archives (#81705).
- unarchive - force unarchive if symlink target changes (#30420).
- unarchive modules now uses zipinfo options without relying on implementation defaults, making it more compatible with all OS/distributions.
- unsafe data - Address an incompatibility when iterating or getting a single index from
AnsibleUnsafeBytes
- unsafe data - Address an incompatibility with
AnsibleUnsafeText
andAnsibleUnsafeBytes
when pickling withprotocol=0
- unsafe data - Enable directly using
AnsibleUnsafeText
with Pythonpathlib
(#82414) - uri - update the documentation for follow_redirects.
- uri action plugin now skipped during check mode (not supported) instead of even trying to execute the module, which already skipped, this does not really change the result, but returns much faster.
- vars - handle exception while combining VarsWithSources and dict (#81659).
- wait_for should not handle 'non mmapable files' again.
- winrm - Better handle send input failures when communicating with hosts under load
- winrm - Do not raise another exception during cleanup when a task is timed out - #81095
- winrm - does not hang when attempting to get process output when stdin write failed