Skip to content

Conversation

eternalNight
Copy link
Contributor

In deepcompile free-activation mode, only activations larger than a threshold are eagerly freed. The threshold is hardcoded today and thus may not be suitable in all cases.

This PR first generalizes the dc.init() interface to take the whole compile_config object, and then converts the threshold into a config item.

This corresponds to issue 3 of #7577.

With the increasing number of compile options, passing each option as a
separate argument becomes tedious.

Signed-off-by: Junjie Mao <[email protected]>
@eternalNight eternalNight force-pushed the eternalNight/make_free_threshold_configurable branch from 39c49bb to 7038689 Compare September 23, 2025 09:47
@eternalNight eternalNight force-pushed the eternalNight/make_free_threshold_configurable branch from 7038689 to f9a6c1a Compare September 23, 2025 10:48
@sfc-gh-truwase sfc-gh-truwase removed the request for review from loadams September 23, 2025 15:31
Copy link
Contributor

@tohtana tohtana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@eternalNight Thank you for the improvement! Other config items are now easier to extend as well.

@tohtana tohtana enabled auto-merge (squash) September 24, 2025 01:17
@tohtana tohtana merged commit 17d80ce into deepspeedai:master Sep 24, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants