macOS installer and framework enhancements and changes for 3.7.0, 3.6.5, and 2.7.15

[ned-deily]

BPO	32726
Nosy	@ronaldoussoren, @ned-deily
PRs	bpo-32726: macOS installer and framework enhancements and changes for 3.7.0 #5448 bpo-32726: Do not force IDLE.app to launch in 32-bit mode. #6279 [3.7] bpo-32726: Do not force IDLE.app to launch in 32-bit mode. (GH-6279) #6280 [3.6] bpo-32726: Do not force IDLE.app to launch in 32-bit mode. (GH-6279) #6281 bpo-32726: macOS 10.6+ installer now builds Tcl/TK 8.6 #6307 [3.7] bpo-32726: macOS 10.6+ installer now builds Tcl/TK 8.6 (GH-6307) #6308 [2.7] Backport macOS universal build and installer fixes from 3.6. #6469

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = 'https://github.com/ned-deily'
closed_at = <Date 2018-04-15.20:13:44.879>
created_at = <Date 2018-01-30.11:58:51.549>
labels = ['OS-mac', 'build', '3.7']
title = 'macOS installer and framework enhancements and changes for 3.7.0, 3.6.5, and 2.7.15'
updated_at = <Date 2018-04-15.20:13:44.876>
user = 'https://github.com/ned-deily'

bugs.python.org fields:

activity = <Date 2018-04-15.20:13:44.876>
actor = 'ned.deily'
assignee = 'ned.deily'
closed = True
closed_date = <Date 2018-04-15.20:13:44.879>
closer = 'ned.deily'
components = ['Build', 'macOS']
creation = <Date 2018-01-30.11:58:51.549>
creator = 'ned.deily'
dependencies = []
files = []
hgrepos = []
issue_num = 32726
keywords = ['patch']
message_count = 13.0
messages = ['311268', '311270', '311386', '311390', '313801', '313802', '314568', '314571', '314572', '314643', '314645', '315291', '315338']
nosy_count = 2.0
nosy_names = ['ronaldoussoren', 'ned.deily']
pr_nums = ['5448', '6279', '6280', '6281', '6307', '6308', '6469']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue32726'
versions = ['Python 2.7', 'Python 3.6', 'Python 3.7']

[ned-deily]

This issue covers various changes for the macOS installers provided via python.org for 3.7.0.

[ned-deily]

New changeset 8c9bb72 by Ned Deily in branch 'master':
bpo-32726: macOS installer and framework enhancements and changes for 3.7.0 (GH-5448)
8c9bb72

[ned-deily]

New changeset 7fdefac by Ned Deily in branch '3.7':
bpo-32726: Build macOS 10.9+ installer with private copy of Tcl/Tk 8.6
7fdefac

[ned-deily]

New changeset 1ca2ffd by Ned Deily in branch 'master':
bpo-32726: Build macOS 10.9+ installer with private copy of Tcl/Tk 8.6
1ca2ffd

[ned-deily]

New changeset 9455244 by Ned Deily in branch '3.6':
bpo-32726: macOS installer changes for 3.6.5
9455244

[ned-deily]

Backport the new 10.9+ installer variant from 3.7 to 3.6 for 3.6.5:

The rationale is that, while the 10.6 variant is still upwards compatible on current systems, it is showing its age. Apple has started deprecating 32-bit support on macOS and apparently plans to drop it entirely in an upcoming release. Also this gives a way to finally provide batteries-included Tcl/Tk support (the single most-requested feature for the macOS installers) and move to Tcl/Tk 8.6.x which is not well supported on older macOS releases (ActiveState currently only supplies 8.6.x binaries for macOS 10.9+, for example). For 3.6.5, the 10.9+ variant will be offered as an additional alternative to the traditional 10.6+ variant in earlier 3.6.x releases. I expect that most Binary extension modules (including wheels) built for earlier versions of 3.6.x with the 10.6 variant should continue to work with either 3.6.5 variant without recompilation. This perhaps will also make it easier to transition to the 10.9+ variant as the default for 3.7.0.

In addition, both installer variants have updated 3rd-party libraries:
OpenSSL 1.0.2m -> 1.0.2n
XZ 5.2.2 -> 5.2.3
SQLite 3.21.0 -> 3.22.0

The 10.6 variant now sets CC=gcc instead of CC=gcc-4.2 and does not search for the outdated 10.6 SDK. The variant is built with the same compiler as before. If necessary for extension module builds, the CC value can be overridden with the CC env variable and an SDK can be specified with the SDKROOT env variable (see man xcrun). These minor changes should be transparent to nearly all users.

[ned-deily]

New changeset df532ab by Ned Deily in branch 'master':
bpo-32726: Do not force IDLE.app to launch in 32-bit mode. (GH-6279)
df532ab

[ned-deily]

New changeset 39c0ef5 by Ned Deily (Miss Islington (bot)) in branch '3.7':
bpo-32726: Do not force IDLE.app to launch in 32-bit mode. (GH-6280)
39c0ef5

[ned-deily]

New changeset fb3d3b7 by Ned Deily (Miss Islington (bot)) in branch '3.6':
bpo-32726: Do not force IDLE.app to launch in 32-bit mode. (GH-6279) (bpo-6281)
fb3d3b7

[ned-deily]

New changeset 7a6f59e by Ned Deily in branch '3.7':
bpo-32726: macOS 10.6+ installer now builds Tcl/TK 8.6 (GH-6308)
7a6f59e

[ned-deily]

New changeset b9e7fe3 by Ned Deily in branch 'master':
bpo-32726: macOS 10.6+ installer now builds Tcl/TK 8.6 (GH-6307)
b9e7fe3

[ned-deily]

New changeset ee8e4b6 by Ned Deily in branch '2.7':
[2.7] Backport macOS universal build and installer fixes from 3.6. (GH-6469)
ee8e4b6

[ned-deily]

I've now backported the changes for 3.6.5 to 2.7.15. along with some long
overdue changes made previously in 3.x. Besides the support for a 10.9+
64-bit-only installer variant (with built-in Tcl/Tk 8.6.x) and other
changes noted above, ee8e4b6 also includes
fixes for the following as there were cross-dependencies and it wasn't
worth the effort to try to separate them out into independent commits:

• bpo-24414: Default macOS deployment target is now set by configure to
  the build system's OS version (as is done by Python 3), not 10.4;
  override with, for example, ./configure MACOSX_DEPLOYMENT_TARGET=10.4.

• bpo-19019: All 2.7 macOS installer variants now supply their own version
  of OpenSSL 1.0.2; the Apple-supplied SSL libraries and root
  certificates are no longer used. The Installer Certificate command
  in /Applications/Python 2.7 may be used to download and install a
  default set of root certificates from the third-party certifi package.

I'm satisfied that 3.6.x and 2.7.x are now in sync enough and up-to-date
enough with regards to macOS universal build and installer support that
we can close these and related issues and move on.