Description
Add support for https://huggingface.co/mistralai/mamba-codestral-7B-v0.1
I'm guessing this also means adding support for mamba models in general
Additional Context
Probably would have to be a separate model loader, from what I'm understanding either https://github.com/state-spaces/mamba or https://github.com/mistralai/mistral-inference could be used, although the original mamba package would probably be better for future models based on the mamba architecture from other sources.
Description
Add support for https://huggingface.co/mistralai/mamba-codestral-7B-v0.1
I'm guessing this also means adding support for mamba models in general
Additional Context
Probably would have to be a separate model loader, from what I'm understanding either https://github.com/state-spaces/mamba or https://github.com/mistralai/mistral-inference could be used, although the original mamba package would probably be better for future models based on the mamba architecture from other sources.