Skip to content

Various performance and memory optimizations #558

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 24 commits into from
Jul 23, 2025
Merged

Conversation

jpsamaroo
Copy link
Member

@jpsamaroo jpsamaroo commented Jul 22, 2024

This PR implements a variety of performance tweaks and memory usage optimizations to improve the overall performance of Dagger under various conditions, particularly when dealing with many small tasks.

Todo:

  • Remove unnecessary reusable data structures
  • Ensure that all reusable objects are cleared on error
  • Implement full test suite for reusable utilities
  • Fix warnings
  • Final review

@jpsamaroo jpsamaroo force-pushed the jps/optimizations branch 2 times, most recently from 4b20e45 to 948fbd6 Compare July 22, 2025 01:42
Sch: Don't return values in Tasks
Sch: Switch from state.cache to thunk.cache_ref
tests: Improve test_throws_unwrap error comparisons
@jpsamaroo jpsamaroo force-pushed the jps/optimizations branch from 948fbd6 to a683f3f Compare July 22, 2025 14:30
@jpsamaroo jpsamaroo force-pushed the jps/optimizations branch from 88b576f to 1899a86 Compare July 23, 2025 18:18
@jpsamaroo jpsamaroo merged commit 5361c43 into master Jul 23, 2025
3 of 12 checks passed
@jpsamaroo jpsamaroo deleted the jps/optimizations branch July 23, 2025 18:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Memory leak when copying data from one worker to another
1 participant