[Compiled Pipeline] Add naive logic of Compiled pipeline for pre-check of key logic & Serving management. #191
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
先不要合并，后续还要完善一些关于Serving 的管理逻辑。 |
MOLYHECI
commented
Jul 25, 2025
| self.max_workers = max_workers | ||
| self.process = None | ||
| self.backend_initialized = False | ||
|
|
There was a problem hiding this comment.
在这块考虑temperature等参数是否设置
MOLYHECI
commented
Jul 25, 2025
| except Exception as e: | ||
| self.logger.debug(f"[{i+1}/90] Connection failed: {repr(e)}") | ||
| time.sleep(1) | ||
|
|
There was a problem hiding this comment.
这里的启动逻辑写得很粗糙，有没有更加优雅的实现，另外想办法规范化输出，服务器的输出和算子的输出在同一个命令行非常乱
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.