Build farmer/cop handoff 2017-09-05

[wjwwood]

I'm basing this off of the previous handoff (#44). As with that one, @sloretz you can close this or leave it open to iterate on, up to you.

Farmer:

• Pending tasks:
  • update java on OSX and Windows nodes (Update java on Windows and Mac OS machines #43)
  • update packages on master and linux2:
    • may fix linux_slave_on_master will not run jobs #30 now that docker 17.05 available on trusty, I updated linux3 and havent seen the docker failure since
  • investigate packet.net node failure (packet machine crash on "resource busy" #42)
• Nice to have: Try VS2017 and assess if we can migrate Windows nodes to it
• Recurrent tasks:
  • make system updates on MacOS and Windows machines
    • I just updated the macOS version, homebrew packages, and java versions on all the macOS machines
  • upgrade eatable to windows 10
  • keep chocolatey packages up to date on Windows nodes

Cop:

• Outstanding issues:

  • rcl_get_node_names became flakier than before on all platforms (example here), mainly tracked here. Still confused of why it started failing much more often recently
  • rcl_test_wait / test_timeout became flakier on Windows (has always been flaky but now fail on most CI not only repeated nightlies)

• Job status:

  • Packaging jobs: green
  • Nightlies: green
  • Repeated: all yellow, <15 failing tests per night per platform 🎉. Still 58 different tests failed in the last 5 days (script here)

[sloretz]

Thanks @wjwwood, I'll wait to close this until the next handoff.

[mikaelarguedas]

@sloretz One remark :

• make system updates on MacOS and Windows machines
• keep chocolatey packages up to date on Windows nodes

These 2 items are not only recurrent for this specific cycle but also required given that we are going to make a release and need to have up-to-date packages on the build machines before doing so

[sloretz]

Replaced by #56