How to override hydra config inside the config group?

[namespace-Pt]

Here is my config structure:

- config
  - main
    - default.yaml
- script
  - run.py

In run.py:

@hydra.main(version_base=None, config_path="../config", config_name="main/default")
def main(config: OmegaConf):
    print(config)

if __name__ == "__main__":
    main()

I want to disable the output_subdir and logging of hydra by writing the following in the default.yaml:

defaults:
  - override hydra/hydra_logging: none
  - override hydra/job_logging: none

hydra:
  output_subdir: null
  run:
    dir: .

However the code didn't work:

hydra.errors.ConfigCompositionException: In 'main/_default': Could not override 'main/hydra/hydra_logging'. No match in the defaults list

What's the proper way to do that?

[Jasha10]

Try replacing override hydra/hydra_logging: none with override /hydra/hydra_logging: none, and similarly replace override hydra/job_logging: none with override /hydra/job_logging: none.

The error message indicates that you're trying to override main/hydra/hydra_logging. What you really need to override is hydra/hydra_logging, not main/hydra/hydra_logging. The entries in your defaults list are being interpreted as relative paths (relative to the main config group).

[namespace-Pt]

Replacing override hydra/hydra_logging: none with override /hydra/hydra_logging: none produces the following error:

hydra.errors.ConfigCompositionException: In 'main/_default': Could not override 'hydra/[email protected]_logging'

I also tried the following:

defaults:
  - override /hydra/hydra_logging@_group_: none
  - override /hydra/job_logging@_group_: none

Then the logging is actually disabled.
However, the code to disable output subdir didn't work anyway:

hydra:
  output_subdir: null
  run:
    dir: .

The outputs directory persists.

[Jasha10]

Can you move the file config/main/default.yaml to config/default.yaml? The additional level of nesting is causing problems.

However, the code to disable output subdir didn't work anyway

The issue here is that your composed config looks like this:

$ python script/run.py
{'main': {'hydra': {'output_subdir': None, 'run': {'dir': '.'}}}}
  ^^^^ this extra nesting is causing the problem

The hydra.output_subdir setting you've specified in default.yaml appears nested underneath the main key. For the hydra.output_subdir: null setting to work properly, it needs to be at the top level.

[namespace-Pt]

Okay. Thank you.

[Jasha10]

Now that I think of it, there is another possibility: You can keep the nesting config/main/default.yaml and use an @package directive to make sure that the hydra config is at the top level:

config/main/default.yaml:

# @package _global_
# ^^^ this @package directive solves the nesting problem
defaults:
  - override /hydra/hydra_logging@_group_: none
  - override /hydra/job_logging@_group_: none

hydra:
  output_subdir: null
  run:
    dir: .

[namespace-Pt]

Wonderful. That's what I need. Thank you~