Skip to content

Warning: Could not find flash_attn #213

@AetherPrior

Description

@AetherPrior

I have activated an environment as mentioned in the repository and run python -m pip install flash_attn --no-build-isolation, but when I run the alignment handbook scripts as mentions it gives me
"Warning: Could not find flash_attn"
"Warning: Could not find xformers"
I've pip freezed to check if it's there and it is present.
I've checked if pip and python points to the environment, and if the environment is activated and it appears so.
I'm not sure what's going on. Here's my pip freeze dump:

absl-py==2.1.0
accelerate==1.4.0
aiohappyeyeballs==2.4.6
aiohttp==3.11.13
aiosignal==1.3.2
-e git+ssh://git@github.com/CMU-Trusted-AI-Challenge-Team/alignment-handbook-clone.git@7f01856a70f213eab823698d23625d648436a00c#egg=alignment_handbook&subdirectory=../../../code/alignment-handbook-clone
annotated-types==0.7.0
async-timeout==5.0.1
attrs==25.1.0
bitsandbytes==0.45.3
Brotli @ file:///croot/brotli-split_1736182456865/work
certifi @ file:///croot/certifi_1738623731865/work/certifi
charset-normalizer @ file:///croot/charset-normalizer_1721748349566/work
click==8.1.8
datasets==3.3.2
deepspeed==0.16.4
dill==0.3.8
docker-pycreds==0.4.0
docstring_parser==0.16
einops==0.8.1
evaluate==0.4.0
filelock @ file:///croot/filelock_1700591183607/work
flash_attn==2.0.2
frozenlist==1.5.0
fsspec==2024.12.0
gitdb==4.0.12
GitPython==3.1.44
gmpy2 @ file:///croot/gmpy2_1738085463648/work
grpcio==1.70.0
hf_transfer==0.1.9
hjson==3.1.0
huggingface-hub==0.29.1
idna @ file:///croot/idna_1714398848350/work
Jinja2 @ file:///croot/jinja2_1737760107953/work
Markdown==3.7
markdown-it-py==3.0.0
MarkupSafe @ file:///croot/markupsafe_1738584038848/work
mdurl==0.1.2
mkl-service==2.4.0
mkl_fft @ file:///io/mkl313/mkl_fft_1730824109137/work
mkl_random @ file:///io/mkl313/mkl_random_1730823916628/work
mpmath @ file:///croot/mpmath_1690848262763/work
msgpack==1.1.0
multidict==6.1.0
multiprocess==0.70.16
networkx @ file:///croot/networkx_1737039604450/work
ninja==1.11.1.3
numpy==1.26.4
nvidia-ml-py==12.570.86
packaging==24.2
pandas==2.2.3
peft==0.14.0
pillow @ file:///croot/pillow_1738010226202/work
platformdirs==4.3.6
propcache==0.3.0
protobuf==3.20.2
psutil==7.0.0
py-cpuinfo==9.0.0
pyarrow==19.0.1
pydantic==2.10.6
pydantic_core==2.27.2
Pygments==2.19.1
PySocks @ file:///home/builder/ci_310/pysocks_1640793678128/work
python-dateutil==2.9.0.post0
pytz==2025.1
PyYAML @ file:///croot/pyyaml_1728657952215/work
regex==2024.11.6
requests @ file:///croot/requests_1730999120400/work
responses==0.18.0
rich==13.9.4
safetensors==0.5.3
scipy==1.15.2
sentencepiece==0.2.0
sentry-sdk==2.22.0
setproctitle==1.3.5
shtab==1.7.1
six==1.17.0
smmap==5.0.2
sympy @ file:///croot/sympy_1738108488918/work
tensorboard==2.19.0
tensorboard-data-server==0.7.2
tokenizers==0.21.0
torch==2.1.2
torchaudio==2.1.2
torchvision==0.16.2
tqdm==4.67.1
transformers==4.49.0
trl==0.9.6
typeguard==4.4.2
typing_extensions @ file:///croot/typing_extensions_1734714854207/work
tyro==0.9.16
tzdata==2025.1
urllib3 @ file:///croot/urllib3_1737133630106/work
wandb==0.19.7
Werkzeug==3.1.3
xformers @ file:///home/conda/feedstock_root/build_artifacts/xformers_1699939412219/work
xxhash==3.5.0
yarl==1.18.3

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions