0.30.0 installation fails under Python 3.10

[TheRisenPhoenix]

Describe the bug
I'm trying to install mlagents 0.30.0 with Python 3.10, as it is now officially supported. However, installation fails, because some dependency installs numpy==1.21.2, which is incomaptible with Python 3.10.
The problem seems to be with mlagents-env, which directly depends on numpy==1.21.2

To Reproduce
Run pip3 install mlagents in an Python 3.10.x environment and watch it fail

Console logs / stack traces

  Building wheel for numpy (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for numpy (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [271 lines of output]
      setup.py:63: RuntimeWarning: NumPy 1.21.2 may not yet support Python 3.10.
[....]
[....]
      TypeError: CCompiler_spawn() got an unexpected keyword argument 'env'

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for numpy

Environment (please complete the following information):

• Unity Version: Unity 2021.3.12f1
• OS + version: Windows 10
• ML-Agents version: 0.30.0
• Torch version: 1.18.0

[TheRisenPhoenix]

It looks like Dependabot already created PR #5814 which would solve this issue.
I also noticed, that numpy is referenced twice in the setup file, which probably shouldn't be the case:

    install_requires=[
        "cloudpickle",
        "grpcio>=1.11.0",
        "numpy>=1.14.1",             <====
        "Pillow>=4.2.1",
        "protobuf>=3.6",
        "pyyaml>=3.1.0",
        "gym>=0.21.0",
        "pettingzoo==1.15.0",
        "numpy==1.21.2",             <====
        "filelock>=3.4.0",
    ],

[hughperkins]

Interestingly I have python 3.10 and numpy 1.21.2 installed, and everyting works swimmingly.

(10-unityml) Hughs-MacBook-Air:python hugh$ pip freeze | grep numpy
numpy==1.21.2
(10-unityml) Hughs-MacBook-Air:python hugh$ python -V
Python 3.10.7

Maybe this problem is specific to windows though? (I'm on a Macbook M2)

[TheRisenPhoenix]

Also, please be aware that numpy 1.24 removed the already deprecated float type and replaced it with the python equivalent. However, it is still used in some places of the mlagents lib, which breaks the code.
I therefore suggest to either migrate those code segments, or restrict numpy to <1.24.

@hughperkins Perhaps, I think it has something to do with building the wheels, and some build dependencies might be OS specific, do it's possible that this is a Windows-only issue.

[flysqu]

Having this issue on Arch Linux
Python 3.10.9
Pip 22.3.1
Same error message as original post

[StefanoCecere]

ml-agents 0.30.0 has this consttraints: python_requires=">=3.8.13,<=3.10.8",
latest Python is 3.10.9 ... we have ot to install Python 3.10.8 or modify /ml-agents/setup.py

[hughperkins]

Good observation. Really that constraint should probably be >=3.8.13,<4.0.0 I reckon?

[hughperkins]

(or I suppose one could do >=3.8.13,<3.11.0, if one doesn't feel that python follows semver. But I think python do a reasonable job on semver?)

[Marioc9955]

I am having the exact issue in windows 10 with python 3.10.8, torch 1.13.1, pip 22.3.1. What can I do?

[TheRisenPhoenix]

Currently, you have to clone the repository, and adjust the following lines:
In ml-agents/setup.py:
python_requires=">=3.8.13,<3.11.0" (line 82)

In ml-agents-envs/setup.py:
"numpy>=1.14.1,<1.24" (line 54)
and
python_requires=">=3.8.13,<3.11.0" (line 63)

and delete "numpy==1.21.2" (line 60)

Then, first install torch using your needed configuration (https://pytorch.org/get-started/locally/) and then install your locally changed python packages:

pip3 install -e ./ml-agents-envs
pip3 install -e ./ml-agents

I hope this helps!

[StefanoCecere]

anyway i solved installing Python 3.9.x

I hope the maintainers fix these limits ASAP, since it's quite an issue to manage so many different Python versions (especially in multi-platform mac+windows classes)

[zalogarciam]

Hello

I could make it work with this config with r20, mlagents 0.30.0 in w11

1. Create Conda env with Python 3.8.16 and install mlagents

2. Install these
   % conda install numpy
   % conda install Pytorch=1.8.0
   % conda install h5py
   % conda install grpcio

3. If pytorch is not available from current channels try this
   conda install -c conda-forge Pytorch=1.8.0
   or try this
   conda install -c pytorch pytorch=1.8.0

4. Then you may have problems with PIL error
   Just:
   pip uninstall pillow
   pip install pillow

5. Same, you may have an error with DLL load from h5py
   pip uninstall h5py
   pip install h5py

If is still missing something (that I dont think so) ... pip install scipy

Test with mlagents-learn --help

Regards