[Feature]: AutoDeploy: Add torch.export support for GraniteMoe models

[karthikvetrivel]

🚀 The feature, motivation and pitch

Feature: Add an export patch for IBM Granite MoE models (ibm-granite/granite-3.x-*b-a800m-instruct) to enable torch.export compatibility in AutoDeploy.

Motivation: GraniteMoe models currently fail during AutoDeploy engine compilation with the error:

"Cannot copy out of meta tensor; no data!"

This is caused by GraniteMoeTopKGating calling .tolist() on a tensor, which is incompatible with meta tensors used during torch.export tracing.

Failure observed on AutoDeploy Dashboard for models including ibm-granite/granite-3.1-3b-a800m-instruct.

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

[coderabbitai]

📝 CodeRabbit Plan Mode

Generate an implementation plan and prompts that you can use with your favorite coding agent.

• Create Plan

Examples

• Example 1
• Example 2

---

---

🧪 Issue enrichment is currently in open beta.

You can configure auto-planning by selecting labels in the issue_enrichment configuration.

To disable automatic issue enrichment, add the following to your .coderabbit.yaml:

issue_enrichment:
  auto_enrich:
    enabled: false

💬 Have feedback or questions? Drop into our discord or schedule a call!