I have activated an environment as mentioned in the repository and run python -m pip install flash_attn --no-build-isolation, but when I run the alignment handbook scripts as mentions it gives me
"Warning: Could not find flash_attn"
"Warning: Could not find xformers"
I've pip freezed to check if it's there and it is present.
I've checked if pip and python points to the environment, and if the environment is activated and it appears so.
I'm not sure what's going on. Here's my pip freeze dump:
absl-py==2.1.0
accelerate==1.4.0
aiohappyeyeballs==2.4.6
aiohttp==3.11.13
aiosignal==1.3.2
-e git+ssh://git@github.com/CMU-Trusted-AI-Challenge-Team/alignment-handbook-clone.git@7f01856a70f213eab823698d23625d648436a00c#egg=alignment_handbook&subdirectory=../../../code/alignment-handbook-clone
annotated-types==0.7.0
async-timeout==5.0.1
attrs==25.1.0
bitsandbytes==0.45.3
Brotli @ file:///croot/brotli-split_1736182456865/work
certifi @ file:///croot/certifi_1738623731865/work/certifi
charset-normalizer @ file:///croot/charset-normalizer_1721748349566/work
click==8.1.8
datasets==3.3.2
deepspeed==0.16.4
dill==0.3.8
docker-pycreds==0.4.0
docstring_parser==0.16
einops==0.8.1
evaluate==0.4.0
filelock @ file:///croot/filelock_1700591183607/work
flash_attn==2.0.2
frozenlist==1.5.0
fsspec==2024.12.0
gitdb==4.0.12
GitPython==3.1.44
gmpy2 @ file:///croot/gmpy2_1738085463648/work
grpcio==1.70.0
hf_transfer==0.1.9
hjson==3.1.0
huggingface-hub==0.29.1
idna @ file:///croot/idna_1714398848350/work
Jinja2 @ file:///croot/jinja2_1737760107953/work
Markdown==3.7
markdown-it-py==3.0.0
MarkupSafe @ file:///croot/markupsafe_1738584038848/work
mdurl==0.1.2
mkl-service==2.4.0
mkl_fft @ file:///io/mkl313/mkl_fft_1730824109137/work
mkl_random @ file:///io/mkl313/mkl_random_1730823916628/work
mpmath @ file:///croot/mpmath_1690848262763/work
msgpack==1.1.0
multidict==6.1.0
multiprocess==0.70.16
networkx @ file:///croot/networkx_1737039604450/work
ninja==1.11.1.3
numpy==1.26.4
nvidia-ml-py==12.570.86
packaging==24.2
pandas==2.2.3
peft==0.14.0
pillow @ file:///croot/pillow_1738010226202/work
platformdirs==4.3.6
propcache==0.3.0
protobuf==3.20.2
psutil==7.0.0
py-cpuinfo==9.0.0
pyarrow==19.0.1
pydantic==2.10.6
pydantic_core==2.27.2
Pygments==2.19.1
PySocks @ file:///home/builder/ci_310/pysocks_1640793678128/work
python-dateutil==2.9.0.post0
pytz==2025.1
PyYAML @ file:///croot/pyyaml_1728657952215/work
regex==2024.11.6
requests @ file:///croot/requests_1730999120400/work
responses==0.18.0
rich==13.9.4
safetensors==0.5.3
scipy==1.15.2
sentencepiece==0.2.0
sentry-sdk==2.22.0
setproctitle==1.3.5
shtab==1.7.1
six==1.17.0
smmap==5.0.2
sympy @ file:///croot/sympy_1738108488918/work
tensorboard==2.19.0
tensorboard-data-server==0.7.2
tokenizers==0.21.0
torch==2.1.2
torchaudio==2.1.2
torchvision==0.16.2
tqdm==4.67.1
transformers==4.49.0
trl==0.9.6
typeguard==4.4.2
typing_extensions @ file:///croot/typing_extensions_1734714854207/work
tyro==0.9.16
tzdata==2025.1
urllib3 @ file:///croot/urllib3_1737133630106/work
wandb==0.19.7
Werkzeug==3.1.3
xformers @ file:///home/conda/feedstock_root/build_artifacts/xformers_1699939412219/work
xxhash==3.5.0
yarl==1.18.3
I have activated an environment as mentioned in the repository and run
python -m pip install flash_attn --no-build-isolation, but when I run the alignment handbook scripts as mentions it gives me"Warning: Could not find flash_attn"
"Warning: Could not find xformers"
I've pip freezed to check if it's there and it is present.
I've checked if pip and python points to the environment, and if the environment is activated and it appears so.
I'm not sure what's going on. Here's my pip freeze dump: