-
-
Notifications
You must be signed in to change notification settings - Fork 2.7k
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe.
Since the market of consumer's adapting NPU backed pcs from AMD such Ryzen AI series, and localai target is the general public, it would be great to support this from the start.
Describe the solution you'd like
Configuration to detect NPU, configuration to deploy NPU modules from huggingface Onix ,
Configuration for Hybrid support (NPU+GPU)
Describe alternatives you've considered
This is core requirement, I can't think of alternative, skipping untapped resource is a waste.
Additional context
tommerty
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request