Travis flakes are way up

[bradfrizzell]

Flaking on travis has become a constant source of headaches over the last months, and it appears to be getting worse, not better.

I've had to deal with 2 3rd-party ad tech PRs this week alone that have made super simple PRs just modifying a string that's not used anywere, that have had to run through travis multiple times to pass. Is there any info on what is causing these issues / what needs to be done to fix this?

[bradfrizzell]

@keithwrightbos

[rsimha]

We do a lot during Travis builds, so it would help to know where in particular you are seeing flakiness. (Installs? Builds? Lint? Bundle size? Unit tests? Integration tests? Tooling upgrades?)

Can you provide links to one or two failed jobs so I can make sure we're keeping track of all the issues at play? It would also help to identify / fix any potential correlation between different types of flakes and the kinds of PRs where they occur.

There are a few ongoing investigations / efforts meant to track each separate set of symptoms:

#15913: Travis
#15658: Mocha
#14848: Karma
#14360: AMP tests
#15134: Bundle size
#14406: Console errors

[rsimha]

/cc @erwinmombay @danielrozenberg for infra issues while I'm traveling until the end of next week.

[rsimha]

/cc @choumx FYI

[bradfrizzell]

I'll let the A4A team know to save their spurious Travis failures over the next couple days and link here.

[ampprojectbot]

This issue hasn't been updated in awhile. Do you have any updates?

[rsimha]

Closing this issue since it's obsolete. Most individual tracking bugs in #15868 (comment) are now fixed, and the remaining ones can stand on their own.