Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V6 #1131

Merged
merged 110 commits into from
Jul 26, 2023
Merged

V6 #1131

merged 110 commits into from
Jul 26, 2023

Commits on Jun 6, 2023

  1. Configuration menu
    Copy the full SHA
    9cc368e View commit details
    Browse the repository at this point in the history
  2. Bump packer to v1.8.6

    triarius committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    0a59a3b View commit details
    Browse the repository at this point in the history
  3. Remove python2 and install aws-cli v2 from repos

    Python2 is long deprecates and is not in the amazon linux 2023 repos
    triarius committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    2a72f01 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    883da24 View commit details
    Browse the repository at this point in the history
  5. Remove docker-compose v1

    triarius committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    6c6bd3e View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    25a9da8 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    23b3db8 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    6ca45e4 View commit details
    Browse the repository at this point in the history
  9. Fewer tabs in bk-install-elastic-stack.sh

    Some tabs have to be kept because <<-HEREDOCs ignore tabs but not
    spaces. Also standardise some spacing.
    triarius committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    4f99405 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    2143bda View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    eca2fe2 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    3c57da5 View commit details
    Browse the repository at this point in the history
  13. Use curl instead of ec2-metadata tool

    The http calls are nicer because we don't have to format the output with `cut`
    triarius committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    9c0d053 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Configuration menu
    Copy the full SHA
    2d32dfc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    734e9ce View commit details
    Browse the repository at this point in the history
  3. Remove ssm plugin

    It's meant to be installed locally, not on EC2 instances
    triarius committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    214f529 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b8a23e1 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e8e41a8 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    6ecfbf0 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    f12eed1 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    406d9ff View commit details
    Browse the repository at this point in the history
  9. Add a comment about userns

    triarius committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    07a7a1b View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    6a7667c View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    198c8bc View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    96510d4 View commit details
    Browse the repository at this point in the history
  13. Escape go templating

    triarius committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    da56b78 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    b4be589 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    2e25e00 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    e1e9479 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    c0b6d97 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    d290926 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    7755a93 View commit details
    Browse the repository at this point in the history
  20. Remove goss timeouts

    Most likely, commands were timing out because we ran some of the tests on `t3.nano`s, which have variable CPU, and the tests exhausted allowed CPU bursts. We conduct more intensive tests now, so we upgraded to `t3.small`. This may mean the longer timeouts are no longer needed.
    triarius committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    974b2b9 View commit details
    Browse the repository at this point in the history
  21. Test multiarch with goss

    triarius committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b4afa48 View commit details
    Browse the repository at this point in the history
  22. Rightsize test instances

    triarius committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    3e4cd66 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    00e7a8b View commit details
    Browse the repository at this point in the history
  24. Change docker info output to show which elements of a list are presen…

    …t instead of "success"
    
    Co-authored-by: paul david <[email protected]>
    triarius and toothbrush authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    9272fb7 View commit details
    Browse the repository at this point in the history
  25. Revert "Revert " Rename the parameter EnableGitMirrorsExperiment to…

    … `BuildkiteAgentEnableGitMirrors`""
    triarius authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    cf65a21 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. Remove Spot Price Parameter

    It has been deprecated. Instead, customers should use `OnDemandPercentage`.
    triarius committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    1e65a5b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e7cb800 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1c6e3c3 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. Publish to both main and master for the time being

    With v6, we will be renaming the default branch to main using the GitHub UI. When this change is made, the next build on the main branch won't push a stack template to the same location. So let's push to both locations for now.
    triarius committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    bd08fa2 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #1125 from buildkite/revert-1124-revert-1123-oss-3…

    …15-git-mirrors-only-works-as-an-experment
    triarius authored Jun 9, 2023
    Configuration menu
    Copy the full SHA
    8d3cb68 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #1128 from buildkite/pdp-1108-rename-securitygroup…

    …id-to-securitygroupids
    triarius authored Jun 9, 2023
    Configuration menu
    Copy the full SHA
    d213736 View commit details
    Browse the repository at this point in the history
  4. Fix goss docker info commands

    They need to have some level of nested templates because otherwise,
    goss will attempt to evaluate the templates that are intended to be
    evaluated by docker.
    
    Also, the elements of `stdout` are regexes, so we
    adapt it to test for each expected element of the list. Goss will report
    which regex did not match the output, so we can use this determine which
    plugin are missing. It won't be able to tell if there are other plugins,
    but that is very much a feature.
    triarius committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    d0bb6f2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    3c7c3a5 View commit details
    Browse the repository at this point in the history
  6. Make capacity-optimized the default spot allocation strategy

    Amazon's recommended strategy is `price-capacity-optimized`: https://docs.aws.amazon.com/autoscaling/ec2/APIReference/API_InstancesDistribution.html but the default strategy for a InstancesDistribution is `lowest-price`.
    In the elastic ci stack v5, we overrode the default and set it to `capacity-optimized`.
    
    However, for a CI system, I think the strategy with the lowest risk of interruption is preferable.
    There are two distinct reasons for this:
    - Interrupting a CI job has a cost in developer time. Usually, developers are
      more expensive than instances.
    - The instances carry state, e.g. the checkout dir and docker caches.
      Loosing this state costs time on subsequent jobs, which means those
      instance could be running for longer, and developers could be waiting
      for longer.
    
    This is clearly a tricky balancing act, so giving users the freedom to
    select a different strategy is also a good idea.
    triarius committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    b4da072 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    83d6a06 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    8ae70cf View commit details
    Browse the repository at this point in the history
  9. Merge pull request #1133 from buildkite/pdp-1116-add-wget-to-elastic-…

    …stack-image-based-on-al2023
    triarius authored Jun 9, 2023
    Configuration menu
    Copy the full SHA
    a26450e View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2023

  1. Configuration menu
    Copy the full SHA
    4003612 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5b54890 View commit details
    Browse the repository at this point in the history
  3. Use unversioned python installs

    Otherwise the symlinks, for example, from python to python3 won't be
    created.
    triarius committed Jun 10, 2023
    Configuration menu
    Copy the full SHA
    7b37cc5 View commit details
    Browse the repository at this point in the history
  4. Replace yum with dnf

    Both of them work for now, and yum is a symlink to dnf. But dnf is now
    the way™️.
    See https://docs.aws.amazon.com/linux/al2023/ug/package-management.html
    triarius committed Jun 10, 2023
    Configuration menu
    Copy the full SHA
    245cfc2 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Configuration menu
    Copy the full SHA
    e3b7e6d View commit details
    Browse the repository at this point in the history
  2. Merge pull request #1135 from buildkite/pdp-1118-guard-against-buildk…

    …ite_agent_enable_git_mirrors-not-being
    triarius authored Jun 12, 2023
    Configuration menu
    Copy the full SHA
    4ab35bb View commit details
    Browse the repository at this point in the history
  3. Merge pull request #1134 from buildkite/pdp-1117-install-some-tools-t…

    …hat-are-not-on-al2023-by-default
    triarius authored Jun 12, 2023
    Configuration menu
    Copy the full SHA
    d479f4f View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Configuration menu
    Copy the full SHA
    1bef48f View commit details
    Browse the repository at this point in the history
  2. Pluralize ManagedPolicyARNs

    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    111219c View commit details
    Browse the repository at this point in the history
  3. Merge pull request #1130 from buildkite/pdp-1107-remove-spot-price-pa…

    …ram-from-elastic-ci-stack
    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    96780f5 View commit details
    Browse the repository at this point in the history
  4. Pluralize IntanceTypes

    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    c76dd43 View commit details
    Browse the repository at this point in the history
  5. Default InstanceName to stack name

    When the InstanceName parameter is the empty string, use the stack name
    instead.
    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    33f33cc View commit details
    Browse the repository at this point in the history
  6. Merge pull request #1129 from buildkite/pdp-1109-publish-to-both-mast…

    …er-and-main-for-the-time-being
    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    a3853f7 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    10d40f0 View commit details
    Browse the repository at this point in the history
  8. Merge pull request #1137 from buildkite/pdp-1132-default-the-instance…

    …-name-to-the-stack-name
    
    Default InstanceName to stack name
    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    2707b17 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    eb72d40 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    50a402b View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    cd07650 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    ccd0973 View commit details
    Browse the repository at this point in the history
  13. Allow the MaxSize to be 0

    This is useful for users that are doing blue-green deployments and want
    the (eg blue) stack to be able to be scaled in to 0 instances while the
    green stack is fully scaled out.
    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    50abd80 View commit details
    Browse the repository at this point in the history
  14. Merge pull request #1139 from buildkite/pdp-1146-pull-docker-images-i…

    …n-packer-instead-of-startup
    triarius committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    d6627ec View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    a24c2c1 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Fix path to cfn-signal in install scripts

    It's in /usr/bin/cfn-signal now, which should be in the $PATH
    triarius committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    35caf88 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #1145 from buildkite/pdp-1226-fix-path-to-cfn-sign…

    …al-in-install-scripts
    triarius authored Jun 27, 2023
    Configuration menu
    Copy the full SHA
    16ef5b4 View commit details
    Browse the repository at this point in the history
  3. Increase cancel grace period to 60s

    It was found on Amazon Linux 2023 that the default 10s grace period was
    insufficient to allow the bootstrap to tear down cleanly when a job is
    cancelled from the Buildkite API.
    triarius committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    d21d893 View commit details
    Browse the repository at this point in the history
  4. Merge pull request #1144 from buildkite/pdp-1225-increase-grace-perio…

    …d-for-cancellation-sigkill
    triarius authored Jun 27, 2023
    Configuration menu
    Copy the full SHA
    469b85e View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    cb47acc View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Merge pull request #1146 from buildkite/pdp-1231-tag-v600-beta

    Update changelog for v6.0.0-beta1
    triarius authored Jun 28, 2023
    Configuration menu
    Copy the full SHA
    ef02a6a View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2023

  1. Configuration menu
    Copy the full SHA
    c952ed8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    33c2106 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    62dbff8 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e0699b8 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. Merge pull request #1148 from buildkite/pdp-1277-append-compatibility…

    …-flag-to-docker-compose-on-elastic-stack
    triarius authored Jul 3, 2023
    Configuration menu
    Copy the full SHA
    435a4c2 View commit details
    Browse the repository at this point in the history
  2. Don't chown /etc/docker to ec2-user:docker

    It's root on most systems. Seems unnecessary to do this. If it needs to
    be written to, it should be done as root.
    triarius committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    130a7be View commit details
    Browse the repository at this point in the history
  3. Clarify a comment

    triarius committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    04a5d38 View commit details
    Browse the repository at this point in the history
  4. Remove hardcoded subuid and subgid with dynamic values

    In particular we want the root user in the docker container to be
    buildkite-agent:docker on the host, so use id -u and getent group to
    determine these dynamically.
    triarius committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    001fb33 View commit details
    Browse the repository at this point in the history
  5. Formatting change

    triarius committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    9f260ce View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    9aed820 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4705f8e View commit details
    Browse the repository at this point in the history
  8. Fix spelling

    triarius committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    fbdc581 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    c039f63 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. Move Dockerfile

    triarius committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    2ab8737 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. Configuration menu
    Copy the full SHA
    770caf8 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Merge pull request #1149 from buildkite/pdp-1276-fix-first-build-of-d…

    …ockerfilepostgres-on-bkbk-is-failing-and
    triarius authored Jul 17, 2023
    Configuration menu
    Copy the full SHA
    0d1b0a6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    173c4fb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    54da647 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    2e98ada View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2023

  1. Bump buildx to v0.11.2

    triarius committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    ec5c998 View commit details
    Browse the repository at this point in the history
  2. Bump buildkite-agent to v3.50.2

    # Conflicts:
    #	packer/linux/scripts/install-buildkite-agent.sh
    #	packer/windows/scripts/install-buildkite-agent.ps1
    triarius committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    c0a4d5d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    550211a View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Merge pull request #1162 from buildkite/pdp-1356-bump-versions-of-doc…

    …ker-compose-buildx-and-buildkite-agent
    triarius authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    b59c5e7 View commit details
    Browse the repository at this point in the history
  2. Exit status 2 when environment hook fails

    It's useful to use a different exit status when the environment hook
    fails so that customers can build retry logic into their pipelines.
    triarius committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    e34ae69 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #1163 from buildkite/pdp-1369-exit-status-2-when-e…

    …nvironment-hook-fails
    triarius authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    fb6a477 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8cc2a11 View commit details
    Browse the repository at this point in the history
  5. Merge branch 'master' into v6

    # Conflicts:
    #	CHANGELOG.md
    #	packer/linux/conf/bin/bk-install-elastic-stack.sh
    #	packer/linux/scripts/install-buildkite-agent.sh
    #	packer/windows/scripts/install-buildkite-agent.ps1
    #	templates/aws-stack.yml
    triarius committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    380a6ec View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    eee95e6 View commit details
    Browse the repository at this point in the history
  7. Merge pull request #1165 from buildkite/triarius/bump-agent-3.50.3

    Bump buildkite-agent to v3.50.3
    moskyb authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    3efd3e8 View commit details
    Browse the repository at this point in the history
  8. Merge pull request #1166 from buildkite/triarius/fix-spelling

    Correct grammar in an error message
    triarius authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    06e42c5 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. Merge pull request #1168 from buildkite/pdp-1373-resolve-merge-confli…

    …cts-between-v6-and-master
    triarius authored Jul 25, 2023
    Configuration menu
    Copy the full SHA
    53851b0 View commit details
    Browse the repository at this point in the history
  2. Merge remote-tracking branch 'origin/master' into v6

    # Conflicts:
    #	CHANGELOG.md
    triarius committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    0efd182 View commit details
    Browse the repository at this point in the history