AB Experiments

The Python extension often uses A/B testing for new features. To see if you are part of an experiment, you can check the first lines in the Python extension output channel. If you wish to opt-out of A/B testing, you can open the user settings.json file (View > Command Palette… and run Preferences: Open Settings (JSON)) and set the python.experiments.enabled setting to false.

Alternatively, you can opt-in and opt-out of specific experiments through the python.experiments.optInto and python.experiments.optOutFrom settings. You can rely on the auto completions in VS Code to see which experiments you can opt-into and out from.

Experiments

See https://github.com/microsoft/vscode-python/blob/main/src/client/common/experiments/groups.ts for any experiments going on currently.

FAQ

Q: Can I opt out of the experiment?

A: You can opt out of any experiment by opening the user settings.json file (View > Command Palette… and run Preferences: Open Settings (JSON)) and set the “python.experiments.optOutFrom” setting to [“All”], or to specific experiments you wish to opt out from.

Q: How do I know if I’m part of the experiment?

A: To see if you are part of an experiment, you can check the first lines in the Python extension output channel.

Q: How do I add myself to the experiment?

A: You can opt in to this functionality by adding the following line to your User settings. First, run Preferences: Open Settings (JSON) and then, once you’ve added the line, reload the window by running Developer: Reload Window. "python.experiments.optInto": ["pythonDeprecatePythonPath"]

Q: How do I report a problem I’m having with this experiment?

A: If you’re having a problem with the experiment or wish to provide feedback, please create a new issue at https://github.com/Microsoft/vscode-python/issues.