Benchmarks

These are benchmarks collected from the community used to measure the effects of changes to the Go core (compiler, runtime, garbage collector, and libraries). They should have the following properties:

• they matter; someone cares, perhaps in a dollars-and-cents way, that they run well
• they are go-gettable and don't require customized steps for building the benchmark
• they run under go test -bench ...
• they run relatively quickly, ideally a single "run" takes less than a second (there should perhaps be a separate set of longer-running benchmarks)
• their timings are not gratuitously noisy
• they run cleanly in a restricted environment, such as a Docker or rkt container
• they're not gratuitously redundant with other benchmarks already in the list; we don't need ten microbenchmarks of Go transcendental functions

These benchmarks change over time, and that is okay. Their intended use is for performance testing of proposed changes; is the geometric mean better, were any benchmarks made substantially worse?

Information for each benchmark includes (or should include):

• a short name for the benchmark
• the path to go get the benchmark
• a regexp for the benchmark suite excluding individual benchmarks that might be noisy, long-running, or redundant
• (ideally) a contact person for questions about the benchmarks

short name	notes	go get path	benchmark regexp	contact
ajstarks_deck_generate		github.com/ajstarks/deck/generate	Benchmark(Polygon|Arc)
benhoyt_goawk		github.com/benhoyt/goawk/interp	BenchmarkR
bindata		github.com/kevinburke/go-bindata	Benchmark
capnproto2		zombiezen.com/go/capnproto2/	Benchmark(TextMovementBetweenSegments|Growth_MultiSegment)
cespare_mph		github.com/cespare/mph	BenchmarkBuild
cespare_xxhash		github.com/cespare/xxhash	BenchmarkHashes/xxhash-string,n=10_MB
ericlagergren_decimal		github.com/ericlagergren/decimal/benchmarks	BenchmarkPi_decimal_Go_9
ethereum_bitutil		github.com/ethereum/go-ethereum/common/bitutil	Benchmark(BaseTest2KB|FastTest2KB|Encoding4KBVerySparse)
ethereum_core		github.com/ethereum/go-ethereum/core	BenchmarkChainRead_full_10k
ethereum_corevm		github.com/ethereum/go-ethereum/core/vm	BenchmarkOpDiv128
ethereum_ecies		github.com/ethereum/go-ethereum/crypto/ecies	BenchmarkGenSharedKeyP256
ethereum_ethash		github.com/ethereum/go-ethereum/consensus/ethash	BenchmarkHashimotoLight
ethereum_sha3		github.com/ethereum/go-ethereum/crypto/sha3	BenchmarkSha3_224_MTU
ethereum_storage		github.com/ethereum/go-ethereum/swarm/storage	BenchmarkJoin_8
ethereum_trie		github.com/ethereum/go-ethereum/trie	Benchmark
gonum_blas_native		gonum.org/v1/gonum/blas/gonum	Benchmark(DasumMediumUnitaryInc|Dnrm2MediumPosInc)
gonum_community		gonum.org/v1/gonum/graph/community/	BenchmarkLouvainDirectedMultiplex
gonum_lapack_native		gonum.org/v1/gonum/lapack/gonum	BenchmarkDgeev/Circulant10
gonum_mat		gonum.org/v1/gonum/mat	Benchmark(MulWorkspaceDense1000Hundredth|ScaleVec10000Inc20)
gonum_path		gonum.org/v1/gonum/graph/path/	Benchmark(AStarUndirectedmallWorld_10_2_2_2_Heur|Dominators/nested_if_n256)
gonum_topo		gonum.org/v1/gonum/graph/topo/	Benchmark(TarjanSCCGnp_1000_half|TarjanSCCGnp_10_tenth)
gonum_traverse		gonum.org/v1/gonum/graph/traverse/	BenchmarkWalkAllBreadthFirstGnp_(10|1000)_tenth
gtank_blake2s		github.com/gtank/blake2s	BenchmarkHash8K
gtank_ed25519		github.com/gtank/ed25519	Benchmark(IsOnCurve|ScalarMult)
hugo_helpers		github.com/gohugoio/hugo/helpers	Benchmark(StripHTML|ReaderContains)
hugo_hugolib		github.com/gohugoio/hugo/hugolib	BenchmarkParsePage
hugo_hugolib_sitebuilding		github.com/gohugoio/hugo/hugolib	BenchmarkSiteBuilding/YAML,num_pages=10,num_tags=10,tags_per_page=20,shortcodes,render-12
k8s_api		k8s.io/kubernetes/pkg/api/testing	BenchmarkEncodeCodecFromInternalProtobuf
k8s_schedulercache		k8s.io/kubernetes/pkg/scheduler/cache	BenchmarkList1kNodes30kPods
minio		github.com/minio/minio/cmd	BenchmarkGetObject5MbFS
nelsam_gxui_interval		github.com/nelsam/gxui/interval	Benchmark
pilosa_bitmaps	benchmarks in roaring/ subdirectory	github.com/pilosa/pilosa	BenchmarkBitmap_IntersectionCount	[email protected]
semver		github.com/Masterminds/semver	BenchmarkValidateVersionTildeFail
spexs2		github.com/egonelbre/spexs2/_benchmark/	BenchmarkRun/10k/1
uber_zap		go.uber.org/zap/benchmarks	BenchmarkAddingFields/(Zap.Sugar|^[ais])
uuid		github.com/satori/go.uuid/	Benchmark(NewV5|MarshalToString)

There is a benchmark runner that automates downloading, building, and running these benchmarks under various (user-defined) configurations. Benchmarking noise on Linux can be somewhat reduced with perflock.

A few have been proposed but have so far failed to make the cut (for fetch, build, or noise problems):

short name	notes	go get path	benchmark regexp	contact
eolian_dsp		buddin.us/eolian/dsp	Benchmark
ethereum_whisperv5		github.com/ethereum/go-ethereum/whisper/whisperv5	Benchmark
kanzi		github.com/flanglet/kanzi/go/src/kanzi/benchmark	Benchmark