Skip to content

AB Experiments

Luciana Abud edited this pageFeb 25, 2023 · 29 revisions

The Python extension and VS Code often A/B test new features. You can check the experiments you're part of byenabling telemetry log tracingand checking the list under the "VSCode.ABExp.Features" key.

If you wish to opt-out of A/B testing in the Python extension, you can open the user settings.json file (View>Command Palette…and runPreferences: Open User Settings (JSON)) and set thePython.experiments.enabledsetting tofalse. Alternatively, you can opt-in and opt-out of specific experiments through thePython.experiments.optIntoandPython.experiments.optOutFromsettings. You can rely on the auto completions in VS Code to see which experiments you can opt-into and out from.

You can alsodisable telemetryto opt out of A/B testing from VS Code and all other Microsoft extensions. You can find more information about how VS Code handles telemetryat our documentationand at theMicrosoft Privacy Statement.

Experiments

Seehttps://github /microsoft/vscode- Python /blob/main/src/client/common/experiments/groups.tsfor any experiments going on currently.

Some experiments may override default settings values. To find out whether you have impacted settings, you can open the settings UI page (File>Preferences>Settings) and search for@modified.This will list all your settings that have been modified by you or by an experiment. In the latter case, you will see a marker indicating that the default value of that setting has been changed by an experiment.

FAQ

Q: Can I opt out of the experiment?

A:You can opt out of any experiment by opening the user settings.json file and set the"Python.experiments.optOutFrom"setting to[ "All" ],or to specific experiments you wish to opt out from. You can alsodisable telemetryto opt out of A/B testing from VS Code and all other Microsoft extensions.

Q: How do I know if I’m part of the experiment?

A:To see if you are part of a Python extension experiment, you can check the first lines in the Python extension output channel. You can also check all the experiments you're part of in VS Code byenabling telemetry log tracingand searching for the "VSCode.ABExp.Features" key.

Q: How do I add myself to an experiment?

A:You can opt in an experiment by addingPython.experiments.optIntoto your User settings. You can rely on the auto completions in VS Code to see which experiments are available.

Q: How do I report a problem I’m having with this experiment?

A:If you’re having a problem with the experiment or wish to provide feedback, please create a new issue athttps://github /Microsoft/vscode- Python /issues.

Clone this wiki locally