Skip to content

megatron lm custom flow#152

Merged
ajassani merged 1 commit intomainfrom
feat/megatron_lm_custom_workflow
May 12, 2025
Merged

megatron lm custom flow#152
ajassani merged 1 commit intomainfrom
feat/megatron_lm_custom_workflow

Conversation

@ajassani
Copy link
Copy Markdown
Collaborator

No description provided.

@ajassani ajassani requested a review from Copilot May 12, 2025 16:02
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces a new custom workflow for generating performance reports for Megatron LM, utilizing trace data and custom performance model adjustments.

  • Introduces a new script for consolidating trace data and outputting Excel reports.
  • Updates performance model mappings to include FusedAttnFunc for SDPA operations.
Comments suppressed due to low confidence (1)

examples/custom_workflows/generate_perf_report_megatron_lm.py:9

  • [nitpick] Python class names should follow the CamelCase convention. Consider renaming 'transformer_engine_attention' to 'TransformerEngineAttention'.
class transformer_engine_attention(SDPA):

@ajassani ajassani merged commit f7196e0 into main May 12, 2025
@ajassani ajassani deleted the feat/megatron_lm_custom_workflow branch May 12, 2025 16:03
lauri9 pushed a commit that referenced this pull request Jun 11, 2025
This PR introduces a new custom workflow for generating performance reports for Megatron LM, utilizing trace data and custom performance model adjustments.

Introduces a new script for consolidating trace data and outputting Excel reports.
Updates performance model mappings to include FusedAttnFunc for SDPA operations.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants