Skip to content

deepEP fp4 post quant all2all dispatch #5881

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Jul 11, 2025
Merged

deepEP fp4 post quant all2all dispatch #5881

merged 3 commits into from
Jul 11, 2025

Conversation

yilin-void
Copy link
Collaborator

@yilin-void yilin-void commented Jul 9, 2025 •
edited
Loading

No description provided.

@yilin-void yilin-void force-pushed the dev/postquant_rebase branch 3 times, most recently from 4cc45c7 to 229dd60 Compare July 9, 2025 13:26
@yilin-void yilin-void marked this pull request as ready for review July 9, 2025 13:27
@yilin-void yilin-void requested a review from a team as a code owner July 9, 2025 13:27
@yilin-void
Copy link
Collaborator Author

/bot run

@yilin-void yilin-void requested review from yuantailing and hyukn and removed request for yuxianq and juney-nvidia July 9, 2025 13:27
@tensorrt-cicd
Copy link
Collaborator

PR_Github #11436 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11436 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #8458 completed with status: 'FAILURE'

@yilin-void yilin-void force-pushed the dev/postquant_rebase branch from 229dd60 to 1f727d1 Compare July 10, 2025 01:47
@yilin-void
Copy link
Collaborator Author

/bot run --disable-fail-fast --add-multi-gpu-test

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11486 [ run ] triggered by Bot

yuantailing
yuantailing reviewed Jul 10, 2025
View reviewed changes
hyukn
hyukn approved these changes Jul 10, 2025
View reviewed changes
Copy link
Collaborator

@hyukn hyukn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just some nits and questions.

@yilin-void
Copy link
Collaborator Author

/bot run --disable-fail-fast --add-multi-gpu-test

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11500 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11486 [ run ] completed with state ABORTED

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11500 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8509 completed with status: 'FAILURE'

@yilin-void yilin-void force-pushed the dev/postquant_rebase branch from d939b2d to 03a8fd9 Compare July 10, 2025 07:20
@yilin-void
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11523 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11523 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8527 completed with status: 'FAILURE'

@yilin-void
resolve review comments
2028b1a 
Signed-off-by: Yilin Zhang <[email protected]>
@yilin-void yilin-void force-pushed the dev/postquant_rebase branch from 03a8fd9 to 2028b1a Compare July 10, 2025 11:50
@yilin-void
Copy link
Collaborator Author

/bot run --disable-fail-fast --add-multi-gpu-test

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11546 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #11546 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8548 completed with status: 'SUCCESS'

@yilin-void yilin-void merged commit 854655f into NVIDIA:main Jul 11, 2025
3 checks passed
zhou-yuxin pushed a commit to zhou-yuxin/TensorRT-LLM that referenced this pull request Jul 15, 2025
@yilin-void @zhou-yuxin
deepEP fp4 post quant all2all dispatch (NVIDIA#5881)
a7e9953 
Signed-off-by: Yilin Zhang <[email protected]>
Signed-off-by: Yuxin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yuantailing yuantailing yuantailing approved these changes

@hyukn hyukn hyukn approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@yilin-void @tensorrt-cicd @yuantailing @hyukn