no model named 'torch'

[DeForestDiamond]

I'm really not used to using command prompt and I'm guessing this is an issue with torch but i even reinstalled it and im still getting this error. Any ideas?

(I know the absolute bare minimum about this stuff. So, please talk to me like I'm an idiot, lol)

(venv) C:\Users\Nutri>pip install -U xformers
Collecting xformers
  Using cached xformers-0.0.16.tar.gz (7.3 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [21 lines of output]
      Traceback (most recent call last):
        File "C:\Users\Nutri\venv\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 353, in <module>
          main()
        File "C:\Users\Nutri\venv\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\venv\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 488, in run_setup
          self).run_setup(setup_script=setup_script)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 23, in <module>
      ModuleNotFoundError: No module named 'torch'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.```

[danthe3rd]

You should install torch before installing xFormers.

[DeForestDiamond]

I already had torch, I needed it to install stable diffusion.

[ivanprado]

I think the problem is that torch is imported in setup.py (see here https://github.com/facebookresearch/xformers/blob/main/setup.py#L23).

This is problematic when installing all the dependencies of a project from scratch in an environment. All the dependencies are resolved properly and torch is also going to be installed... but previously, the setup.py of all projects are invoked and at this stage, torch has not been installed yet. I don't know exactly the solution to that, but it seems that this breaking the contract of setup.py

The workaround I found is to install the torch dependency in advance. For example:

pip install torch
pip install -r requirements. txt

[DeForestDiamond]

Thank you, I'll give that a try after work :)

[worthy7]

I am also getting this issue, and am unsure how to solve it.

I am adding this package inside a venv which already has the latest pytorch installed. So I can only assum ethat this "subprocess" doing something in another environment. I not a python/pip expert at all.

[JosefWN]

Same issue for me, torch is already installed and working but I can't install xformers. Seems specific to Windows, as I could install xformers without issues on macOS the other day.

[adampauls]

I'm hitting this issue with poetry on macOS.

[jimmy-evo]

I'm hitting this issue with poetry on macOS.

a trick way is to install torch correctly, you make sure yourself.
and then you just pip install xformers --no-dependencies

[rkique]

Yep, installing pytorch from source and then pip install xformers --no-dependencies works for me.

[adampauls]

@jinmingyi1998 do I understand correctly that the suggested workaround requires not putting xformers in my pyproject.toml and manually installing it instead? That's definitely not an ideal use of poetry?

Am I understanding correctly that xformers is expressly choosing to disregard the recommendation against "building packages in the destination environment" mentioned in this comment?

[danthe3rd]

That's definitely not a good situation, but we couldn't find a satisfying solution. The problem with not building in the destination environment is that you might end up building xFormers with a different version of Pytorch than the one in your environment, which will break everything.
We had some discussion in this PR: #743

[adampauls]

Yes, I saw that discussion. Is it possible to provide some pre-built wheels that build in that relationship? E.g. I could declare a dependency on xformers-pytorch-2-0-1 = "^0.0.20". It's a little annoying for the library user that they need to put the version number of pytorch twice, but it's less annoying that not be able to use poetry properly. And you could still use the base xformers dependency with custom build if you don't want to use one of the already built xformers binaries?

[danthe3rd]

You can also use the pypi wheels which are already built:
https://pypi.org/project/xformers/#history
As the binaries are built with a specific version of pytorch, they have that version pinned as a requirement. I hope this helps ...

[adampauls]

Hmm, maybe I missed something. The issue above happens when you use xformers = "^0.0.20" with poetry, which should be fetching one of those wheels. A minimal poetry project with pyproject.toml:

[tool.poetry]
name = "xformers-test"
version = "0.1.0"
description = ""
authors = []
readme = "README.md"
packages = [{include = "xformers_test"}]

[tool.poetry.dependencies]
python = "^3.11"
xformers = "^0.0.20"

[build-system]
requires = ["poetry-core"]
build-backend = "poetry.core.masonry.api"

will crash on poetry install with

  Backend subprocess exited when trying to invoke get_requires_for_build_wheel
...
  ModuleNotFoundError: No module named 'torch'

I'm using

xformers-test % poetry --version
Poetry (version 1.5.1)
xformers-test % pip3 --version
pip 22.3.1 from /opt/homebrew/lib/python3.11/site-packages/pip (python 3.11)