Skip to content

ops: add MUSA #14941

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

ops: add MUSA #14941

wants to merge 1 commit into from

Conversation

yeahdongcn
Copy link
Collaborator

Make sure to read the contributing guidelines before submitting a PR

root@ff759de5dd90:/ws# ./build/bin/test-backend-ops support --output csv > docs/ops/MUSA.csv
root@ff759de5dd90:/ws# ./scripts/create_ops_docs.py 
INFO:__main__:Parsing GGML operation support files...
INFO:__main__:Parsing support files from docs/ops...
INFO:__main__:  Reading: OpenCL.csv
INFO:__main__:  Reading: Metal.csv
INFO:__main__:  Reading: CUDA.csv
INFO:__main__:  Reading: MUSA.csv
INFO:__main__:  Reading: SYCL.csv
INFO:__main__:  Reading: BLAS.csv
INFO:__main__:  Reading: CPU.csv
INFO:__main__:  Reading: Vulkan.csv
INFO:__main__:Found 86 operations across 8 backends
INFO:__main__:Generating markdown...
INFO:__main__:Generated: docs/ops.md
INFO:__main__:Operations: 86
INFO:__main__:Backends: 8

Signed-off-by: Xiaodong Ye <[email protected]>
@yeahdongcn yeahdongcn requested a review from ggerganov July 29, 2025 09:27
@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jul 29, 2025
@CISC
Copy link
Collaborator

CISC commented Jul 29, 2025

I don't think it makes sense to add MUSA as it's basically just the CUDA backend.

@yeahdongcn
Copy link
Collaborator Author

I don't think it makes sense to add MUSA as it's basically just the CUDA backend.

I understand your point, but there are some differences (for example, FLASH_ATTN_EXT is not supported in MUSA).

@CISC
Copy link
Collaborator

CISC commented Jul 29, 2025

I don't think it makes sense to add MUSA as it's basically just the CUDA backend.

I understand your point, but there are some differences (for example, FLASH_ATTN_EXT is not supported in MUSA).

That's not likely to change though is it?

@IMbackK
Copy link
Collaborator

IMbackK commented Jul 29, 2025

Certainly if we are going to add musa here we should also add hip

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants