[xenial] Investigate noninteractive do-release-upgrade #3968

eloquence · 2018-12-04T21:25:29Z

Once we have addressed all blocking issues for the Xenial migration, we should perform a timeboxed investigation to determine whether it is feasible to perform a noninteractive upgrade.

It is unlikely that we would force the upgrade, but even for a manual upgrade (initiated, for example, via securedrop-admin), it would be ideal to minimize manual steps, which are error-prone and could result in inconsistent system configurations if users make choices different from the documented ones.

This would also unblock automated Trusty->Xenial upgrade testing.

Part of #3204.

The text was updated successfully, but these errors were encountered:

eloquence · 2018-12-04T21:27:50Z

See @zenmonkeykstop’s suggestion here: #3204 (comment)

kushaldas · 2018-12-18T11:29:00Z

Error I got today.

kushaldas · 2018-12-18T13:48:30Z

The above error can be an one time thing. I just wanted that to be documented.

redshiftzero · 2018-12-20T17:35:47Z

Any idea why this error would be happening?

kushaldas · 2018-12-23T07:47:44Z

Any idea why this error would be happening?

The error is due to my ISP it seems :(

kushaldas · 2018-12-23T07:49:30Z

I was trying the command mentioned in that playbook (pointed by @zenmonkeykstop ), it still asked for user input and later gave this error.

Configuration file '/etc/modprobe.d/blacklist.conf'
 ==> Modified (by you or by a script) since installation.
 ==> Package distributor has shipped an updated version.
   What would you like to do about it ?  Your options are:
    Y or I  : install the package maintainer's version
    N or O  : keep your currently-installed version
      D     : show the differences between the versions
      Z     : start a shell to examine the situation
 The default action is to keep your current version.
*** blacklist.conf (Y/I/N/O/D/Z) [default=N] ? 
Error in sys.excepthook:
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/apport_python_hook.py", line 63, in apport_excepthook
    from apport.fileutils import likely_packaged, get_recent_crashes
  File "/usr/lib/python3/dist-packages/apport/__init__.py", line 5, in <module>
    from apport.report import Report
  File "/usr/lib/python3/dist-packages/apport/report.py", line 15, in <module>
    import xml.dom, xml.dom.minidom
ImportError: No module named 'xml.dom'

Original exception was:
Traceback (most recent call last):
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/xenial", line 8, in <module>
    sys.exit(main())
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeMain.py", line 242, in main
    if app.run():
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeController.py", line 1907, in run
    return self.fullUpgrade()
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeController.py", line 1872, in fullUpgrade
    if not self.doDistUpgrade():
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeController.py", line 1213, in doDistUpgrade
    res = self.cache.commit(fprogress,iprogress)
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeCache.py", line 286, in commit
    apt.Cache.commit(self, fprogress, iprogress)
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 534, in commit
    # which is less than optimal!
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 498, in install_archives
    
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeView.py", line 234, in run
    res = os.WEXITSTATUS(self.wait_child())
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeView.py", line 200, in wait_child
    self.update_interface()
  File "/tmp/ubuntu-release-upgrader-_0fp6stt/DistUpgrade/DistUpgradeViewNonInteractive.py", line 221, in update_interface
    os.write(self.master_fd,chr(3))
TypeError: 'str' does not support the buffer interface

kushaldas · 2019-01-02T13:36:53Z

do-release-upgrade -f DistUpgradeViewNonInteractive

Gave me the following error (after user input).

Setting up kmod (22-1ubuntu5.1) ...                                                                                                                  [25/1860]
Installing new version of config file /etc/init.d/kmod ...
Installing new version of config file /etc/modprobe.d/blacklist-framebuffer.conf ...

Configuration file '/etc/modprobe.d/blacklist.conf'
 ==> Modified (by you or by a script) since installation.
 ==> Package distributor has shipped an updated version.
   What would you like to do about it ?  Your options are:
    Y or I  : install the package maintainer's version
    N or O  : keep your currently-installed version
      D     : show the differences between the versions
      Z     : start a shell to examine the situation
 The default action is to keep your current version.
*** blacklist.conf (Y/I/N/O/D/Z) [default=N] ? Y
Error in sys.excepthook:
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/apport_python_hook.py", line 63, in apport_excepthook
    from apport.fileutils import likely_packaged, get_recent_crashes
  File "/usr/lib/python3/dist-packages/apport/__init__.py", line 5, in <module>
    from apport.report import Report
  File "/usr/lib/python3/dist-packages/apport/report.py", line 15, in <module>
    import xml.dom, xml.dom.minidom
ImportError: No module named 'xml.dom'

Original exception was:
Traceback (most recent call last):
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/xenial", line 8, in <module>
    sys.exit(main())
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeMain.py", line 242, in main
    if app.run():
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeController.py", line 1907, in run
    return self.fullUpgrade()
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeController.py", line 1872, in fullUpgrade
    if not self.doDistUpgrade():
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeController.py", line 1213, in doDistUpgrade
    res = self.cache.commit(fprogress,iprogress)
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeCache.py", line 286, in commit
    apt.Cache.commit(self, fprogress, iprogress)
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 534, in commit
    # which is less than optimal!
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 498, in install_archives
    
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeView.py", line 234, in run
    res = os.WEXITSTATUS(self.wait_child())
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeView.py", line 200, in wait_child
    self.update_interface()
  File "/tmp/ubuntu-release-upgrader-7bqopzdr/DistUpgrade/DistUpgradeViewNonInteractive.py", line 221, in update_interface
    os.write(self.master_fd,chr(3))
TypeError: 'str' does not support the buffer interface

I was trying to identify ways to fully unattended upgrade to xenial.

kushaldas · 2019-01-09T17:56:05Z

The required xml.dom package comes from the Python standard library, installing any such xml package on Trusty did not help to solve this issue. I am guessing there is another xml.py in the import path, which is shadowing the original package.

Even if Python3.4 and related minimal package is installed on Trusty, the upgrade still fails on the above mentioned error.

kushaldas · 2019-01-22T17:05:12Z

Note: pexpect seems to be not helpful in this case, I could not manage to provide input as required to the do-release-upgrade command.

eloquence · 2019-01-23T22:18:41Z

We've agreed that we'll focus on providing solid step-by-step docs (#4057) instead; the notes in #3965 can provide a starting point.

eloquence added the ops/deployment label Dec 4, 2018

eloquence mentioned this issue Dec 4, 2018

Migrate SecureDrop servers to Ubuntu 16.04 (Xenial) #3204

Closed

25 tasks

This was referenced Dec 4, 2018

[xenial] Implement nightly CI upgrade test from 14.04 to 16.04 #3969

Closed

[xenial] Implement securedrop-admin os-release-upgrade feature #3970

Closed

eloquence added this to the 0.12.0 milestone Jan 9, 2019

kushaldas mentioned this issue Jan 10, 2019

[xenial] Test upgrade path: Ubuntu 14.04.5 → 14.04.5 with all updates → 16.04 #3965

Closed

eloquence closed this as completed Jan 23, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[xenial] Investigate noninteractive do-release-upgrade #3968

[xenial] Investigate noninteractive do-release-upgrade #3968

eloquence commented Dec 4, 2018

eloquence commented Dec 4, 2018

kushaldas commented Dec 18, 2018

kushaldas commented Dec 18, 2018

redshiftzero commented Dec 20, 2018

kushaldas commented Dec 23, 2018

kushaldas commented Dec 23, 2018

kushaldas commented Jan 2, 2019

kushaldas commented Jan 9, 2019 •

edited

Loading

kushaldas commented Jan 22, 2019

eloquence commented Jan 23, 2019

[xenial] Investigate noninteractive do-release-upgrade #3968

[xenial] Investigate noninteractive do-release-upgrade #3968

Comments

eloquence commented Dec 4, 2018

eloquence commented Dec 4, 2018

kushaldas commented Dec 18, 2018

kushaldas commented Dec 18, 2018

redshiftzero commented Dec 20, 2018

kushaldas commented Dec 23, 2018

kushaldas commented Dec 23, 2018

kushaldas commented Jan 2, 2019

kushaldas commented Jan 9, 2019 • edited Loading

kushaldas commented Jan 22, 2019

eloquence commented Jan 23, 2019

kushaldas commented Jan 9, 2019 •

edited

Loading