Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[build] proxy.golang.org might be not available #21609

Closed
v1v opened this issue Oct 7, 2020 · 3 comments · Fixed by #21614
Closed

[build] proxy.golang.org might be not available #21609

v1v opened this issue Oct 7, 2020 · 3 comments · Fixed by #21614
Labels
Team:Automation Label for the Observability productivity team

Comments

@v1v
Copy link
Member

v1v commented Oct 7, 2020

Command

$ make -C generator/_templates/metricbeat test

Build -> here

Stacktrace

2020-10-07T00:22:59.776Z] 	github.com/klauspost/compress/zstd: github.com/klauspost/[email protected]: reading https://proxy.golang.org/github.com/klauspost/compress/@v/v1.9.8.zip: 503 Service Unavailable
[2020-10-07T00:22:59.776Z] beatpath/testmetricbeat/cmd imports
[2020-10-07T00:22:59.776Z] 	github.com/elastic/beats/v7/libbeat/cmd/instance imports
[2020-10-07T00:22:59.776Z] 	github.com/elastic/beats/v7/libbeat/publisher/includes imports
[2020-10-07T00:22:59.776Z] 	github.com/elastic/beats/v7/libbeat/outputs/kafka imports
[2020-10-07T00:22:59.776Z] 	github.com/Shopify/sarama imports
[2020-10-07T00:22:59.776Z] 	github.com/pierrec/lz4: github.com/pierrec/[email protected]+incompatible: reading https://proxy.golang.org/github.com/pierrec/lz4/@v/v2.4.1+incompatible.zip: 503 Service Unavailable
[2020-10-07T00:22:59.776Z] 	server response: Service Unavailable

Actions

Can the download dependencies independently of the make/mage goal in a way we could run a retry in the CI if there are instabilities in the third party systems?

The below pseudo-code shows what I meant:

   stage('beat foo') {
       steps {
            dir(BASE_DIR) {
                // Download dependencies independently to reduce the third party instabilities.
                retryWithSleep(retries: 2, seconds: 5, backoff: true){
                    sh 'make getDependencies'
                }
                sh 'make -C generator/_templates/metricbeat test'
            }
       }
  }
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Oct 7, 2020
@andresrc
Copy link
Contributor

andresrc commented Oct 7, 2020

My understanding is that we want to add an artifactory proxy (when available) as an additional safety net. The proxy has been pretty stable so far afaik (not 100% of course).

@andresrc andresrc added the Team:Automation Label for the Observability productivity team label Oct 7, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 7, 2020
@andresrc andresrc added [zube]: Inbox needs_team Indicates that the issue/PR needs a Team:* label and removed Team:Automation Label for the Observability productivity team labels Oct 7, 2020
@v1v
Copy link
Member Author

v1v commented Oct 8, 2020

It has failed again

image

build for 7.10

I raised #21614 to add more resilience in the CI by running a few times the go get command

@v1v
Copy link
Member Author

v1v commented Oct 14, 2020

I've just seen another similar error when downloading some dependencies and checking the sum or so:

[2020-10-13T21:03:31.469Z] go: github.com/elastic/beats/v7 fff5f6a2241e4c9c9513c98c7e821f0a5007d362 => v7.0.0-alpha2.0.20201013203502-fff5f6a2241e
[2020-10-13T21:05:22.993Z] go get: github.com/elastic/beats/[email protected]/go.mod: verifying module: github.com/elastic/beats/[email protected]/go.mod: reading https://sum.golang.org/lookup/github.com/elastic/beats/[email protected]: 410 Gone
[2020-10-13T21:05:22.993Z] 	server response: not found: fetch timed out
[2020-10-13T21:05:22.993Z] Error: running "go get -d -u github.com/elastic/beats/v7@fff5f6a2241e4c9c9513c98c7e821f0a5007d362" failed with exit code 1
[2020-10-13T21:05:22.993Z] error while getting required beats version
[2020-10-13T21:05:22.993Z] github.com/elastic/beats/v7/generator/common/beatgen.Generate
[2020-10-13T21:05:22.993Z] 	/var/lib/jenkins/workspace/Beats_beats_master/src/github.com/elastic/beats/generator/common/beatgen/beatgen.go:126
[2020-10-13T21:05:22.993Z] main.GenerateCustomBeat
[2020-10-13T21:05:22.993Z] 	/var/lib/jenkins/workspace/Beats_beats_master/src/github.com/elastic/beats/magefile.go:51
[2020-10-13T21:05:22.993Z] main.main.func18
[2020-10-13T21:05:22.993Z] 	/var/lib/jenkins/workspace/Beats_beats_master/src/github.com/elastic/beats/mage_output_file.go:476
[2020-10-13T21:05:22.993Z] main.main.func12.1
[2020-10-13T21:05:22.993Z] 	/var/lib/jenkins/workspace/Beats_beats_master/src/github.com/elastic/beats/mage_output_file.go:270
[2020-10-13T21:05:22.993Z] runtime.goexit
[2020-10-13T21:05:22.993Z] 	/var/lib/jenkins/workspace/Beats_beats_master/.gvm/versions/go1.14.7.linux.amd64/src/runtime/asm_amd64.s:1373
[2020-10-13T21:05:22.993Z] ../../common/Makefile:29: recipe for target 'prepare-test' failed

build for master

image

@zube zube bot added [zube]: Done and removed [zube]: Inbox labels Oct 15, 2020
@v1v v1v added the Team:Automation Label for the Observability productivity team label Oct 15, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Automation Label for the Observability productivity team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants