Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance hub - landing bucket policy for AP jobs #4079

Merged
merged 6 commits into from
Nov 20, 2023

Conversation

jemnery
Copy link
Contributor

@jemnery jemnery commented Nov 20, 2023

No description provided.

@jemnery jemnery requested review from a team as code owners November 20, 2023 14:44
@github-actions github-actions bot added the environments-repository Used to exclude PRs from this repo in our Slack PR update label Nov 20, 2023
@jemnery jemnery had a problem deploying to performance-hub-development November 20, 2023 14:45 — with GitHub Actions Failure
Copy link
Contributor

TFSEC Scan Success

Show Output
*****************************

TFSEC will check the following folders:

Checkov Scan Success

Show Output
*****************************

Checkov will check the following folders:

CTFLint Scan Success

Show Output
*****************************

Setting default tflint config...
Running tflint --init...
Installing `terraform` plugin...
Installed `terraform` (source: github.com/terraform-linters/tflint-ruleset-terraform, version: 0.2.1)
tflint will check the following folders:

@jemnery jemnery temporarily deployed to performance-hub-development November 20, 2023 14:51 — with GitHub Actions Inactive
Copy link
Contributor

TFSEC Scan Success

Show Output
*****************************

TFSEC will check the following folders:
terraform/environments/corporate-staff-rostering terraform/environments/nomis terraform/environments/oasys

*****************************

Running TFSEC in terraform/environments/corporate-staff-rostering
Excluding the following checks: AWS095

======================================================
tfsec is joining the Trivy family

tfsec will continue to remain available 
for the time being, although our engineering 
attention will be directed at Trivy going forward.

You can read more here: 
https://github.com/aquasecurity/tfsec/discussions/1994
======================================================
  timings
  ──────────────────────────────────────────
  disk i/o             1.829529ms
  parsing              212.017798ms
  adaptation           115.555µs
  checks               3.140073ms
  total                217.102955ms

  counts
  ──────────────────────────────────────────
  modules downloaded   0
  modules processed    5
  blocks processed     276
  files read           74

  results
  ──────────────────────────────────────────
  passed               1
  ignored              0
  critical             0
  high                 0
  medium               0
  low                  0


No problems detected!

tfsec_exitcode=0

*****************************

Running TFSEC in terraform/environments/nomis
Excluding the following checks: AWS095

======================================================
tfsec is joining the Trivy family

tfsec will continue to remain available 
for the time being, although our engineering 
attention will be directed at Trivy going forward.

You can read more here: 
https://github.com/aquasecurity/tfsec/discussions/1994
======================================================
  timings
  ──────────────────────────────────────────
  disk i/o             1.64276ms
  parsing              220.089693ms
  adaptation           316.901µs
  checks               11.652627ms
  total                233.701981ms

  counts
  ──────────────────────────────────────────
  modules downloaded   0
  modules processed    5
  blocks processed     283
  files read           75

  results
  ──────────────────────────────────────────
  passed               37
  ignored              4
  critical             0
  high                 0
  medium               0
  low                  0


No problems detected!

tfsec_exitcode=0

*****************************

Running TFSEC in terraform/environments/oasys
Excluding the following checks: AWS095

======================================================
tfsec is joining the Trivy family

tfsec will continue to remain available 
for the time being, although our engineering 
attention will be directed at Trivy going forward.

You can read more here: 
https://github.com/aquasecurity/tfsec/discussions/1994
======================================================
  timings
  ──────────────────────────────────────────
  disk i/o             1.443821ms
  parsing              229.758158ms
  adaptation           149.268µs
  checks               3.5198ms
  total                234.871047ms

  counts
  ──────────────────────────────────────────
  modules downloaded   0
  modules processed    5
  blocks processed     268
  files read           70

  results
  ──────────────────────────────────────────
  passed               7
  ignored              0
  critical             0
  high                 0
  medium               0
  low                  0


No problems detected!

tfsec_exitcode=0

Checkov Scan Failed

Show Output
*****************************

Checkov will check the following folders:
terraform/environments/corporate-staff-rostering terraform/environments/nomis terraform/environments/oasys

*****************************

Running Checkov in terraform/environments/corporate-staff-rostering
2023-11-20 14:52:10,633 [MainThread  ] [ERROR]  Exception traceback:
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 788, in _parallel_run
    report = runner.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/sast/runner.py", line 53, in run
    bc_integration.set_s3_client()
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/bridgecrew/platform_integration.py", line 397, in set_s3_client
    raise ValueError("Credentials for client are not set")
ValueError: Credentials for client are not set
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/checkov/main.py", line 523, in run
    self.scan_reports = runner_registry.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 158, in run
    parallel_runner_results = parallel_runner.run_function(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 52, in run_function
    return self._run_function_multiprocess_spawn(func, items, group_size)
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 122, in _run_function_multiprocess_spawn
    return p.starmap(func, items, chunksize=group_size)
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 771, in get
    raise self._value
ValueError: Credentials for client are not set
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 788, in _parallel_run
    report = runner.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/sast/runner.py", line 53, in run
    bc_integration.set_s3_client()
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/bridgecrew/platform_integration.py", line 397, in set_s3_client
    raise ValueError("Credentials for client are not set")
ValueError: Credentials for client are not set
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/checkov", line 9, in <module>
    sys.exit(Checkov().run())
  File "/usr/local/lib/python3.9/dist-packages/checkov/main.py", line 523, in run
    self.scan_reports = runner_registry.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 158, in run
    parallel_runner_results = parallel_runner.run_function(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 52, in run_function
    return self._run_function_multiprocess_spawn(func, items, group_size)
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 122, in _run_function_multiprocess_spawn
    return p.starmap(func, items, chunksize=group_size)
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 771, in get
    raise self._value
ValueError: Credentials for client are not set
checkov_exitcode=1

*****************************

Running Checkov in terraform/environments/nomis
2023-11-20 14:52:18,533 [MainThread  ] [ERROR]  Exception traceback:
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 788, in _parallel_run
    report = runner.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/sast/runner.py", line 53, in run
    bc_integration.set_s3_client()
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/bridgecrew/platform_integration.py", line 397, in set_s3_client
    raise ValueError("Credentials for client are not set")
ValueError: Credentials for client are not set
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/checkov/main.py", line 523, in run
    self.scan_reports = runner_registry.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 158, in run
    parallel_runner_results = parallel_runner.run_function(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 52, in run_function
    return self._run_function_multiprocess_spawn(func, items, group_size)
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 122, in _run_function_multiprocess_spawn
    return p.starmap(func, items, chunksize=group_size)
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 771, in get
    raise self._value
ValueError: Credentials for client are not set
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 788, in _parallel_run
    report = runner.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/sast/runner.py", line 53, in run
    bc_integration.set_s3_client()
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/bridgecrew/platform_integration.py", line 397, in set_s3_client
    raise ValueError("Credentials for client are not set")
ValueError: Credentials for client are not set
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/checkov", line 9, in <module>
    sys.exit(Checkov().run())
  File "/usr/local/lib/python3.9/dist-packages/checkov/main.py", line 523, in run
    self.scan_reports = runner_registry.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 158, in run
    parallel_runner_results = parallel_runner.run_function(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 52, in run_function
    return self._run_function_multiprocess_spawn(func, items, group_size)
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 122, in _run_function_multiprocess_spawn
    return p.starmap(func, items, chunksize=group_size)
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 771, in get
    raise self._value
ValueError: Credentials for client are not set
checkov_exitcode=2

*****************************

Running Checkov in terraform/environments/oasys
2023-11-20 14:52:24,813 [MainThread  ] [ERROR]  Exception traceback:
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 788, in _parallel_run
    report = runner.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/sast/runner.py", line 53, in run
    bc_integration.set_s3_client()
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/bridgecrew/platform_integration.py", line 397, in set_s3_client
    raise ValueError("Credentials for client are not set")
ValueError: Credentials for client are not set
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/checkov/main.py", line 523, in run
    self.scan_reports = runner_registry.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 158, in run
    parallel_runner_results = parallel_runner.run_function(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 52, in run_function
    return self._run_function_multiprocess_spawn(func, items, group_size)
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 122, in _run_function_multiprocess_spawn
    return p.starmap(func, items, chunksize=group_size)
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 771, in get
    raise self._value
ValueError: Credentials for client are not set
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 788, in _parallel_run
    report = runner.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/sast/runner.py", line 53, in run
    bc_integration.set_s3_client()
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/bridgecrew/platform_integration.py", line 397, in set_s3_client
    raise ValueError("Credentials for client are not set")
ValueError: Credentials for client are not set
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/checkov", line 9, in <module>
    sys.exit(Checkov().run())
  File "/usr/local/lib/python3.9/dist-packages/checkov/main.py", line 523, in run
    self.scan_reports = runner_registry.run(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/runners/runner_registry.py", line 158, in run
    parallel_runner_results = parallel_runner.run_function(
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 52, in run_function
    return self._run_function_multiprocess_spawn(func, items, group_size)
  File "/usr/local/lib/python3.9/dist-packages/checkov/common/parallelizer/parallel_runner.py", line 122, in _run_function_multiprocess_spawn
    return p.starmap(func, items, chunksize=group_size)
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/lib/python3.9/multiprocessing/pool.py", line 771, in get
    raise self._value
ValueError: Credentials for client are not set
checkov_exitcode=3

CTFLint Scan Success

Show Output
*****************************

Setting default tflint config...
Running tflint --init...
Installing `terraform` plugin...
Installed `terraform` (source: github.com/terraform-linters/tflint-ruleset-terraform, version: 0.2.1)
tflint will check the following folders:
terraform/environments/corporate-staff-rostering terraform/environments/nomis terraform/environments/oasys

*****************************

Running tflint in terraform/environments/corporate-staff-rostering
Excluding the following checks: terraform_unused_declarations
tflint_exitcode=0

*****************************

Running tflint in terraform/environments/nomis
Excluding the following checks: terraform_unused_declarations
tflint_exitcode=0

*****************************

Running tflint in terraform/environments/oasys
Excluding the following checks: terraform_unused_declarations
tflint_exitcode=0

@jemnery jemnery merged commit ce7e97e into main Nov 20, 2023
13 of 14 checks passed
@jemnery jemnery deleted the performance-hub/land-bucket-policy branch November 20, 2023 14:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
environments-repository Used to exclude PRs from this repo in our Slack PR update
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants