Skip to content

Conversation

ndr-ds
Copy link
Contributor

@ndr-ds ndr-ds commented Sep 15, 2025

Motivation

jemalloc is more performant than the system allocator (and was even the Rust default for a while)

Proposal

Add a feature that when enabled will use jemalloc as the allocator. We might decide to have this feature on by default eventually, but for now it'll be used for memory profiling, which is coming in the following PRs.

Test Plan

Deployed a network with this featured turned on, saw a slight performance improvement, and tested with the profiling code.

Release Plan

  • Nothing to do / These changes follow the usual release cycle.

@ndr-ds ndr-ds force-pushed the 09-15-add_feature_to_use_jemalloc_as_memory_allocator branch from 8ce35c8 to d69326d Compare September 16, 2025 03:05
@ndr-ds ndr-ds force-pushed the 09-03-optimize_rocksdb_prefix_searches branch 2 times, most recently from 4da37f2 to c18be16 Compare September 16, 2025 13:01
@ndr-ds ndr-ds force-pushed the 09-15-add_feature_to_use_jemalloc_as_memory_allocator branch from d69326d to 23a8d18 Compare September 16, 2025 13:01
@ndr-ds ndr-ds changed the base branch from 09-03-optimize_rocksdb_prefix_searches to graphite-base/4571 September 16, 2025 17:19
@ndr-ds ndr-ds force-pushed the 09-15-add_feature_to_use_jemalloc_as_memory_allocator branch from 23a8d18 to a043826 Compare September 16, 2025 17:24
@ndr-ds ndr-ds changed the base branch from graphite-base/4571 to 09-03-optimize_rocksdb_prefix_searches September 16, 2025 17:24
@ndr-ds ndr-ds changed the base branch from 09-03-optimize_rocksdb_prefix_searches to graphite-base/4571 September 16, 2025 17:32
@ndr-ds ndr-ds force-pushed the 09-15-add_feature_to_use_jemalloc_as_memory_allocator branch from a043826 to 20adbf7 Compare September 16, 2025 17:39
@ndr-ds ndr-ds changed the base branch from graphite-base/4571 to 09-03-optimize_rocksdb_prefix_searches September 16, 2025 17:39
@ndr-ds ndr-ds changed the base branch from 09-03-optimize_rocksdb_prefix_searches to graphite-base/4571 September 16, 2025 17:56
@ndr-ds ndr-ds force-pushed the 09-15-add_feature_to_use_jemalloc_as_memory_allocator branch from 20adbf7 to ef98053 Compare September 16, 2025 17:56
@ndr-ds ndr-ds changed the base branch from graphite-base/4571 to 09-03-optimize_rocksdb_prefix_searches September 16, 2025 17:56
@ndr-ds ndr-ds force-pushed the 09-03-optimize_rocksdb_prefix_searches branch from 22c5f8e to f800271 Compare September 16, 2025 17:58
@ndr-ds ndr-ds force-pushed the 09-15-add_feature_to_use_jemalloc_as_memory_allocator branch from ef98053 to eee424e Compare September 16, 2025 17:58
Base automatically changed from 09-03-optimize_rocksdb_prefix_searches to main September 16, 2025 19:39
@ndr-ds ndr-ds added this pull request to the merge queue Sep 16, 2025
Merged via the queue into main with commit f4bb825 Sep 16, 2025
34 of 36 checks passed
@ndr-ds ndr-ds deleted the 09-15-add_feature_to_use_jemalloc_as_memory_allocator branch September 16, 2025 20:21
deuszx pushed a commit that referenced this pull request Sep 19, 2025
## Motivation

jemalloc is more performant than the system allocator (and was even the
Rust default for a while)

## Proposal

Add a feature that when enabled will use jemalloc as the allocator. We
might decide to have this feature on by default eventually, but for now
it'll be used for memory profiling, which is coming in the following
PRs.

## Test Plan

Deployed a network with this featured turned on, saw a slight
performance improvement, and tested with the profiling code.

## Release Plan

- Nothing to do / These changes follow the usual release cycle.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants