[CI] Codecov.io failing with 404

[devinbost]

Search before asking

• I searched in the issues and found nothing similar.

Example failure

https://github.com/devinbost/pulsar/actions/runs/4494617987/jobs/7907322924

Exception stacktrace

[2023-03-22T22:25:28.804Z] ['error'] There was an error running the uploader: Error uploading to https://codecov.io/: Error: There was an error fetching the storage URL during POST: 404 - {'detail': ErrorDetail(string='Could not find a repository, try using repo upload token', code='not_found')}
[2023-03-22T22:25:28.804Z] ['verbose'] The error stack is: Error: Error uploading to https://codecov.io/: Error: There was an error fetching the storage URL during POST: 404 - {'detail': ErrorDetail(string='Could not find a repository, try using repo upload token', code='not_found')}
at main (/snapshot/repo/dist/src/index.js)
at processTicksAndRejections (node:internal/process/task_queues:96:5)
[2023-03-22T22:25:28.804Z] ['verbose'] End of uploader: 1651 milliseconds
. . .

[2023-03-22T22:26:31.441Z] ['error'] There was an error running the uploader: Error uploading to https://codecov.io/: Error: There was an error fetching the storage URL during POST: 404 - {'detail': ErrorDetail(string='Could not find a repository, try using repo upload token', code='not_found')}
[2023-03-22T22:26:31.442Z] ['verbose'] The error stack is: Error: Error uploading to https://codecov.io/: Error: There was an error fetching the storage URL during POST: 404 - {'detail': ErrorDetail(string='Could not find a repository, try using repo upload token', code='not_found')}
at main (/snapshot/repo/dist/src/index.js)
at processTicksAndRejections (node:internal/process/task_queues:96:5)
[2023-03-22T22:26:31.442Z] ['verbose'] End of uploader: 1564 milliseconds
Error: Codecov: Failed to properly upload: The process '/home/runner/work/_actions/codecov/codecov-action/v3/dist/codecov' failed with exit code 255

Are you willing to submit a PR?

• I'm willing to submit a PR!

[devinbost]

I'm getting this repeatedly upon multiple re-runs of the CI.

[tisonkun]

This can be referred to #19947. I'm not sure if it's before or after the PR merged.

cc @lhotari

[lhotari]

For the upload issue, Codecov now recommends to specify an upload token for the build:

Public repositories that rely on PRs via forks will find that they cannot effectively use Codecov if the token is stored as a GitHub secret. The scope of the Codecov token is only to confirm that the coverage uploaded comes from a specific repository, not to pull down source code or make any code changes.

For this reason, we recommend that teams with public repositories that rely on PRs via forks consider the security ramifications of making the Codecov token available as opposed to being in a secret.

I'll first create a ticket to ASF infra for creating the token for apache/pulsar. After the token is available, I can work on an improvement where this token is used for builds and PRs that target apache/pulsar. For builds in own forks, I'll add instructions for setting that up.

[lhotari]

I created https://issues.apache.org/jira/browse/INFRA-24399 for the creation of the Codecov upload token for apache/pulsar.

[tisonkun]

INFRA-24399 closed with:

The ASF does not have a business relationship with CodeCov, we do not pay for their services. If you want to use CodeCov, you are limited to their free offering.

Perhaps nothing we can do from our side :/

[tisonkun]

Closing as Won't Fix on INFRA ticket.

If anyone has ideas to ease the case, please reopen and submit a patch.