Python environments not detected/found in devcontainer on WSL 2

[mhabibav]

Type: Bug

Behaviour

I have a Windows machine where VS Code is installed. The machine has WSL 2 (Ubuntu 22.04) where docker is installed.

I can successfully connect to WSL from my VS Code desktop. I have a repo inside WSL with a devcontainer. I can build and use the container normally except for one frustrating thing. Any Python environment created inside the container using Poetry, is not detected by the "Select Interpreter" button. No matter how many times I press the refresh button (in the select interpreter window) or reopen the container; the environments never show up.

Here's a screenshot of the select interpreter window:

Here's what's inside ~/.cache/pypoetry/virtualenvs:

Here's the output of the Python extension after pressing refresh:

Steps to reproduce:

1. Have WSL 2 with Docker installed inside WSL
2. Reopen folder in devcontainer
3. Create a Poetry environment by any means
4. Open a Python file and press Select Interpreter

Expected behavior: poetry env is automatically detected and is selectable
Current behavior: Environment doesn't show up

Diagnostic data

Output for Python in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)

XXX

Extension version: 2024.14.0
VS Code version: Code 1.93.0 (4849ca9bdf9666755eb463db297b69e5385090e3, 2024-09-04T13:02:38.431Z)
OS version: Windows_NT x64 10.0.22631
Modes:
Remote OS version: Linux x64 5.15.146.1-microsoft-standard-WSL2

• Python version (& distribution if applicable, e.g. Anaconda): 3.12.3
• Type of virtual environment used (e.g. conda, venv, virtualenv, etc.): Global
• Value of the python.languageServer setting: Pylance

User Settings

languageServer: "Pylance"

Installed Extensions

Extension Name	Extension Id	Version
Auto Close Tag	formulahendry.auto-close-tag	0.5.15
Auto Rename Tag	formulahendry.auto-rename-tag	0.1.10
autoDocstring - Python Docstring Generator	njpwerner.autodocstring	0.6.1
Bruno	bruno-api-client.bruno	3.1.0
Conventional Commits	vivaxy.vscode-conventional-commits	1.26.0
DotENV	mikestead.dotenv	1.0.1
ESLint	dbaeumer.vscode-eslint	3.0.10
Even Better TOML	tamasfe.even-better-toml	0.19.2
Gemini Code Assist + Google Cloud Code	googlecloudtools.cloudcode	2.16.7
Git Graph	mhutchie.git-graph	1.30.0
Git History	donjayamanne.githistory	0.6.20
HashiCorp Terraform	hashicorp.terraform	2.32.3
Import Cost	wix.vscode-import-cost	3.3.0
IntelliCode API Usage Examples	VisualStudioExptTeam.intellicode-api-usage-examples	0.2.8
JavaScript Debugger	ms-vscode.js-debug	1.93.0
Jupyter	ms-toolsai.jupyter	2024.8.0
Jupyter Cell Tags	ms-toolsai.vscode-jupyter-cell-tags	0.1.9
Jupyter Notebook Renderers	ms-toolsai.jupyter-renderers	1.0.19
Jupyter Slide Show	ms-toolsai.vscode-jupyter-slideshow	0.1.6
Live Server	ritwickdey.LiveServer	5.7.9
Markdown Preview Enhanced	shd101wyy.markdown-preview-enhanced	0.8.13
Markdown Preview Mermaid Support	bierner.markdown-mermaid	1.24.0
npm Intellisense	christian-kohler.npm-intellisense	1.4.5
OpenAPI (Swagger) Editor	42Crunch.vscode-openapi	4.28.1
PDF Viewer	mathematic.vscode-pdf	0.0.6
Prettier - Code formatter	esbenp.prettier-vscode	11.0.0
Pylance	ms-python.vscode-pylance	2024.8.2
Python	ms-python.python	2024.14.0
Python Debugger	ms-python.debugpy	2024.10.0
Python Environment Manager	donjayamanne.python-environment-manager	1.2.4
Rainbow CSV	mechatroner.rainbow-csv	3.12.0
Ruff	charliermarsh.ruff	2024.44.0
Simple React Snippets	burkeholland.simple-react-snippets	1.2.8
Table Visualizer for JavaScript Profiles	ms-vscode.vscode-js-profile-table	1.0.9
XML	redhat.vscode-xml	0.27.1
YAML	redhat.vscode-yaml	1.15.0

[mhabibav]

Here's the output of the Python Extension:

Python extension output

2024-09-07 13:03:30.766 [info] Python interpreter path: /bin/python3
2024-09-07 13:03:30.899 [info] > pyenv which python
2024-09-07 13:03:30.899 [info] cwd: .
2024-09-07 13:03:31.418 [info] > conda info --json
2024-09-07 13:03:32.370 [info] Starting Pylance language server.
2024-09-07 13:03:41.321 [info] Starting Environment refresh
2024-09-07 13:03:41.321 [info] Searching for interpreters in posix paths locator
2024-09-07 13:03:41.323 [info] Searching for pyenv environments
2024-09-07 13:03:41.323 [info] Searching for conda environments
2024-09-07 13:03:41.323 [info] Searching for global virtual environments
2024-09-07 13:03:41.323 [info] Searching for custom virtual environments
2024-09-07 13:03:41.333 [info] > pixi --version
2024-09-07 13:03:41.333 [info] > hatch env show --json
2024-09-07 13:03:41.333 [info] cwd: .
2024-09-07 13:03:41.336 [info] pyenv is not installed
2024-09-07 13:03:41.336 [info] Finished searching for pyenv environments: 14 milliseconds
2024-09-07 13:03:41.336 [info] Finished searching for custom virtual envs: 13 milliseconds
2024-09-07 13:03:41.337 [info] Finished searching for global virtual envs: 14 milliseconds
2024-09-07 13:03:41.351 [info] Found: /bin/python3 --> /bin/python3.12
2024-09-07 13:03:41.352 [info] Found: /bin/python3.12 --> /bin/python3.12
2024-09-07 13:03:41.358 [info] > C:\Users\mhabiba\AppData\Local\Programs\Python\Python312\python.exe -I ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py
2024-09-07 13:03:41.368 [error] Error: Command failed: C:\Users\mhabiba\AppData\Local\Programs\Python\Python312\python.exe -I /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py
/bin/sh: 1: C:UsersmhabibaAppDataLocalProgramsPythonPython312python.exe: not found

    at genericNodeError (node:internal/errors:984:15)
    at wrappedFn (node:internal/errors:538:14)
    at ChildProcess.exithandler (node:child_process:422:12)
    at ChildProcess.emit (node:events:531:35)
    at maybeClose (node:internal/child_process:1105:16)
    at Socket.<anonymous> (node:internal/child_process:457:11)
    at Socket.emit (node:events:519:28)
    at Pipe.<anonymous> (node:net:338:12) {
  code: 127,
  killed: false,
  signal: null,
  cmd: 'C:\\Users\\mhabiba\\AppData\\Local\\Programs\\Python\\Python312\\python.exe -I /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py'
}
2024-09-07 13:03:41.371 [info] Found: /usr/bin/python3 --> /usr/bin/python3.12
2024-09-07 13:03:41.371 [info] Found: /usr/bin/python3.12 --> /usr/bin/python3.12
2024-09-07 13:03:41.387 [info] Finished searching for interpreters in posix paths locator: 64 milliseconds
2024-09-07 13:03:41.387 [info] > /bin/python3 -I ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py
2024-09-07 13:03:41.399 [info] > /usr/bin/python3 -I ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py
2024-09-07 13:03:41.399 [info] Environments refresh paths discovered (event): 80 milliseconds
2024-09-07 13:03:41.399 [info] Environments refresh paths discovered: 81 milliseconds
2024-09-07 13:03:43.375 [info] > C:\Users\mhabiba\AppData\Local\Programs\Python\Python312\python.exe -I ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py ~/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py
2024-09-07 13:03:43.378 [error] Error: Command failed: C:\Users\mhabiba\AppData\Local\Programs\Python\Python312\python.exe -I /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py
/bin/sh: 1: C:UsersmhabibaAppDataLocalProgramsPythonPython312python.exe: not found

    at genericNodeError (node:internal/errors:984:15)
    at wrappedFn (node:internal/errors:538:14)
    at ChildProcess.exithandler (node:child_process:422:12)
    at ChildProcess.emit (node:events:531:35)
    at maybeClose (node:internal/child_process:1105:16)
    at Socket.<anonymous> (node:internal/child_process:457:11)
    at Socket.emit (node:events:519:28)
    at Pipe.<anonymous> (node:net:338:12) {
  code: 127,
  killed: false,
  signal: null,
  cmd: 'C:\\Users\\mhabiba\\AppData\\Local\\Programs\\Python\\Python312\\python.exe -I /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/get_output_via_markers.py /home/vscode/.vscode-server/extensions/ms-python.python-2024.14.0-linux-x64/python_files/interpreterInfo.py'
}
2024-09-07 13:03:43.418 [info] Environments refresh finished (event): 2100 milliseconds
2024-09-07 13:03:43.428 [info] Environment refresh took 2111 milliseconds
2024-09-07 13:03:47.621 [info] Starting Environment refresh
2024-09-07 13:03:47.621 [info] Searching for interpreters in posix paths locator
2024-09-07 13:03:47.622 [info] Searching for pyenv environments
2024-09-07 13:03:47.622 [info] Searching for conda environments
2024-09-07 13:03:47.622 [info] Searching for global virtual environments
2024-09-07 13:03:47.622 [info] Searching for custom virtual environments
2024-09-07 13:03:47.623 [info] pyenv is not installed
2024-09-07 13:03:47.623 [info] Finished searching for pyenv environments: 1 milliseconds
2024-09-07 13:03:47.624 [info] Finished searching for custom virtual envs: 2 milliseconds
2024-09-07 13:03:47.625 [info] Finished searching for global virtual envs: 3 milliseconds
2024-09-07 13:03:47.628 [info] Found: /bin/python3 --> /bin/python3.12
2024-09-07 13:03:47.628 [info] Found: /bin/python3.12 --> /bin/python3.12
2024-09-07 13:03:47.634 [info] Found: /usr/bin/python3 --> /usr/bin/python3.12
2024-09-07 13:03:47.634 [info] Found: /usr/bin/python3.12 --> /usr/bin/python3.12
2024-09-07 13:03:47.649 [info] Finished searching for interpreters in posix paths locator: 28 milliseconds
2024-09-07 13:03:47.654 [info] Environments refresh paths discovered (event): 34 milliseconds
2024-09-07 13:03:47.654 [info] Environments refresh finished (event): 34 milliseconds
2024-09-07 13:03:47.654 [info] Environments refresh paths discovered: 34 milliseconds
2024-09-07 13:03:47.658 [info] Environment refresh took 37 milliseconds

I noticed it had 2 errors and both apparently are due to the extension mixing up Windows and Unix paths?

[mhabibav]

The 2 errors turned out to be because I had set python.defaultInterpreterPath in the user settings in Windows. I removed it and indeed the error in the output is gone. But the first issue remains: environments are still not detected.

[karthiknadig]

@mhabibav We don't know the paths where poetry creates it. You can try one of two things:
[Option 1]: Set python.locator to native and see if it helps.
[Option 2]: Set python.venvFolder setting to point to the poetry envs path ~/.cache/pypoetry/virtualenvs.

In both cases you can set it and then do refresh by running Python: Clear cache and reload

[mhabibav]

Hello @karthiknadig thanks for your reply!

We don't know the paths where poetry creates it.

I haven't changed any of Poetry's configurations so I guess all environments are created in ~/.cache/pypoetry/virtualenvs.

[Option 1]: Set python.locator to native and see if it helps.

Still not showing up, here's a screenshot from the logs.

[Option 2]: Set python.venvFolder setting to point to the poetry envs path ~/.cache/pypoetry/virtualenvs.

Also not showing up. Logs:

[karthiknadig]

Can you share your settings.json?

@DonJayamanne is the ~/.cache/pypoetry/virtualenvs searched by pet?

[DonJayamanne]

I do not hardcode that path in pet,
We try to find poetry and read the configuration files and then go from there.
I can add some logging to see why we're not getting those.