Skip to content

fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances #4727

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Jun 18, 2025
Merged

fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances #4727

merged 2 commits into from
Jun 18, 2025

Conversation

Superjomn
Copy link
Collaborator

No description provided.

@Superjomn Superjomn marked this pull request as draft May 28, 2025 07:40
@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 020c89e to e6aa0bc Compare June 13, 2025 08:26
@Superjomn Superjomn changed the title chore: fix trtllm-llmapi-launch multiple LLM instances fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances Jun 13, 2025
@Superjomn Superjomn marked this pull request as ready for review June 13, 2025 12:42
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8809 [ run ] triggered by Bot

@Superjomn Superjomn requested review from yizhang-nv June 13, 2025 12:51
@tensorrt-cicd
Copy link
Collaborator

PR_Github #8809 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6397 completed with status: 'FAILURE'

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 9c3b000 to 0a1c4b5 Compare June 15, 2025 08:00
@Superjomn
Copy link
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8923 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8923 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6507 completed with status: 'FAILURE'

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 0a1c4b5 to 8df0133 Compare June 16, 2025 03:23
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8964 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8964 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6542 completed with status: 'FAILURE'

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 8df0133 to 1ed9991 Compare June 16, 2025 07:27
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8993 [ run ] triggered by Bot

@Superjomn Superjomn enabled auto-merge (squash) June 16, 2025 07:34
@tensorrt-cicd
Copy link
Collaborator

PR_Github #8993 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6566 completed with status: 'FAILURE'

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 1ed9991 to 9d9f504 Compare June 16, 2025 14:25
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9039 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9039 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6606 completed with status: 'FAILURE'

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 9d9f504 to 5a0aa94 Compare June 17, 2025 00:05
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9072 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9072 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #6634 completed with status: 'FAILURE'

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 5a0aa94 to 2de8580 Compare June 17, 2025 07:19
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9151 [ run ] triggered by Bot

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 2de8580 to 13dd395 Compare June 17, 2025 23:57
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9251 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9251 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6787 completed with status: 'FAILURE'

@Superjomn Superjomn force-pushed the fix-launch-multiple-instances branch from 13dd395 to 35856e0 Compare June 18, 2025 06:59
@Superjomn
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9329 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9329 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6847 completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.

@Superjomn Superjomn merged commit 3946e79 into NVIDIA:main Jun 18, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@litaotju litaotju litaotju approved these changes

@kaiyux kaiyux Awaiting requested review from kaiyux

@VALLIS-NERIA VALLIS-NERIA Awaiting requested review from VALLIS-NERIA

@yizhang-nv yizhang-nv Awaiting requested review from yizhang-nv

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Superjomn @tensorrt-cicd @litaotju