Allow setting python_executable from config file...

[emmatyping]

... and let the python_version and python_executable be different, so that one can install stub packages into the Python used to run mypy.

Fixes #5620.

[emmatyping]

I realized this isn't actually correct yet, so I'm not quite ready for review yet.

[emmatyping]

It appears the new version of flake8 is very picky. The Travis failure is not related to these changes (its just flake8). I will submit a PR to fix this.

[emmatyping]

Okay this should be ready for review.

[msullivan]

This looks good.

It might be worth adding a test that actually does read the version from a config file

[emmatyping]

It might be worth adding a test that actually does read the version from a config file

There are several tests for reading the version from the config file already (in cmdline.test). I would do the same for python_executable, but that is a bit harder to test. I suppose I could add something to testpep561 if such a test is desired.

[emmatyping]

I will merge this later today unless someone has suggestions for changes. (@msullivan not sure if you wanted to respond to my above comment).

[gvanrossum]

I am trying to come up with an end-to-end test for this, and it's not working.

I found a pypi package ordered_set (aka ordered-set) that has stubs on pypi.

I am installing these with:

$ python2.7 -m pip install ordered_set ordered_set_stubs

To prove that it works:

$ python2.7 -c 'import ordered_set'

This gives no errors. Then with mypy from master, I run:

$ mypy -2 -c 'import ordered_set'
/Users/guido/v27/lib/python2.7/site-packages/ordered_set-stubs/__init__.pyi:10: error: Cannot determine consistent method resolution order (MRO) for "OrderedSet"

This error is expected (there's a bug in the stubs that only happens to manifest with Python 2). (Note that ~/v27 is the venv I use.)

But with mypy from this branch I can't get it to work:

$ mypy -2 -c 'import ordered_set'
<string>:1: error: Cannot find module named 'ordered_set'
<string>:1: note: (Perhaps setting MYPYPATH or using the "--ignore-missing-imports" flag would help)

I can get it to work by installing the stubs in the Python 3 venv I use to run mypy, or by explicitly specifying a Python executable:

$ mypy -2 -c 'import ordered_set' --python-executable ~/v27/bin/python
/Users/guido/v27/lib/python2.7/site-packages/ordered_set-stubs/__init__.pyi:10: error: Cannot determine consistent method resolution order (MRO) for "OrderedSet"

But that seems a step back.

[gvanrossum]

Is this testing anything any more? You don't infer the version from the executable any more in the code.

[gvanrossum]

(Unapproving since I can't get it to work as I expect end-to-end.)

[emmatyping]

Ah, yes I have it using the default Python executable. I will need to think this over a bit. I believe the issue is that we want to be able to use options.python_executable, but it already has a default, so there is no way to tell if the config file has set the value and we don't need to do inference, or if it just is using the default value and we want to infer the correct executable based on the Python version.

I suppose the "correct" thing to do would probably be to make python_executable and python_version default to None when unset and have the entry point set their defaults if all else fails.

[gvanrossum]

Hm, it looks like the logic for the Python version could be simplified: just use the default dest (don't bother with special-opts:python_version). For executable I think you could also do away with special-opts: in options.py you set the default to None and then in main.py you compute the value dynamically like this:

• if explicitly specified, keep that
• else if options.no_executable is set, use None
• else compute from version

It looks like everything becomes easier that way.

[gvanrossum]

@ethanhs Any change to get this in for the 0.650 release? I think it would be a nice improvement.

[gvanrossum]

(If you want to push back on my suggestion to simplify the implementation and just merge the current version I could be okay with that too.)

Decided I want the fix more badly than the simplified implementation.

[emmatyping]

Oh, sorry I seem to have missed your message from two weeks back. I will make another PR tomorrow with the simplification.