Add root path to sys.path in build env for embedded Python

[bebound]

Fix #11670, related issue: python/cpython#100399, Azure/azure-cli#24781

In embedded python, the pyd files are put in root folder.
In standard python, they are put into DLLs folder.

  Directory: C:\Users\kk\AppData\Local\Programs\Python\Python310\DLLs

-a----        10/11/2022     16:59        1121152 unicodedata.pyd
-a----        10/11/2022     16:59          29560 winsound.pyd
-a----        10/11/2022     16:59          64384 _asyncio.pyd
-a----        10/11/2022     16:59          83320 _bz2.pyd
-a----        10/11/2022     16:59         123264 _ctypes.pyd

  Directory: C:\Users\kk\Downloads\python_emb

-a----        12/21/2022     14:38        1113976 unicodedata.pyd
-a----        12/21/2022     14:38          90440 vcruntime140.dll
-a----        12/21/2022     14:38          26488 winsound.pyd
-a----        12/21/2022     14:38          55680 _asyncio.pyd
-a----        12/21/2022     14:38          79736 _bz2.pyd
-a----        12/21/2022     14:38         106368 _ctypes.pyd

In build_env.py, the root folder is excluded by this logic, as root folder is in system_paths/system_sites.

pip/src/pip/_internal/build_env.py

Lines 122 to 126 in 07a360d

	original_sys_path = [
	path for path in original_sys_path
	if os.path.normcase(path) not in system_paths
	]
	sys.path = original_sys_path

If these pyd files need to be imported when install new package, ModuleNotFoundError is raised.
Currently, I find pwinput and pendulum can't be installed in embedded Python.

I'm not sure whether this change brings some side effect. Let me know if you have any concern.

Repro step

1. Download https://www.python.org/ftp/python/3.10.9/python-3.10.9-embed-win32.zip and extract it
2. curl -sSL https://bootstrap.pypa.io/get-pip.py -o get-pip.py
3. .\python.exe get-pip.py
4. .\python.exe -m pip install pwinput
5. ModuleNotFoundError: No module named 'pyexpat' raises

It can be installed successfully with this PR.

[uranusjr]

This looks like an issue in the embedded distribution? pip simply uses the sysconfig layout to reference the modules, and if a distribution fails to report the site locations, it’s on the distribution to fix that.

[bebound]

Is there any other way to detect embedded Python?

[bebound]

Yes, it only affects embedded distribution.
I don't know why embedded Python decides to put pyd into root folder. DLLs is in sys.path in build env, everything works fine if pyd is in DLLs folder.
Since we can handle pyd correctly in DLLs folder, I think it's okey to make the logic compatible with pyd in root folder.
Before embedded Python changes its mind, can we fix it in pip?

[pfmoore]

In addition to the point @uranusjr made that this is an issue for the embedded distribution, I will note that the embedded distribution is explicitly documented as not being for general use - see the comment here

Using pip to manage dependencies as for a regular Python installation is not supported with this distribution, though with some care it may be possible to include and use pip for automatic updates.

So this is not intended or supported use anyway, and IMO pip should not try to special case it.

[ichard26]

I'm going to close this PR as pip is not designed for embedded Python and this is duly noted in the CPython documentation.