-
Notifications
You must be signed in to change notification settings - Fork 4
Performance
flanglet edited this page Aug 3, 2025
·
4 revisions
Kanzi 2.4.0
Apple M3 24 GB Sonoma 14.6.1
using a modified version of Lzbench 2.1 (https://github.com/inikep/lzbench).
lzbench provide a means to run in memory benchmarks of compression and decompression.
lzbench 2.1 supports multi-threading by adding a thread pool external to the codecs and splitting the input into blocks.
bsc & bzip3 are run using 4 threads based on the multi-threading support in lzbench.
kanzi uses 4 threads natively (since the multi-threading support is baked into the library) instead of using the lzbench multi-threading approach.
For lz4 and zstd which support multi-threading compression but single-threaded decompression, a test was run with 4 threads and another one with 1 thread and the results were combined.
This testing method should provide results closer to real life scenarios than blindly running all compressors either with 1 or 4 threads.
Compressor name C,D Threads Compress. Decompress. Compr. size Ratio Filename
lz4 1.10.0 4, 1 2522 MB/s 5135 MB/s 57262281 57.26 /tmp/enwik8
lzav 4.22 -1 1, 1 503 MB/s 3208 MB/s 46466041 46.47 /tmp/enwik8
kanzi 2.4 -1 4, 4 596 MB/s 4993 MB/s 43644009 43.64 /tmp/enwik8
lzav 4.22 -2 1, 1 141 MB/s 3769 MB/s 39209855 39.21 /tmp/enwik8
kanzi 2.4 -2 4, 4 842 MB/s 3171 MB/s 37570400 37.57 /tmp/enwik8
brotli 1.1.0 -2 1, 1 171 MB/s 487 MB/s 36949842 36.95 /tmp/enwik8
zstd 1.5.7 -3 4, 1 1169 MB/s 1350 MB/s 35566782 35.57 /tmp/enwik8
kanzi 2.4 -3 4, 4 352 MB/s 1051 MB/s 32466228 32.47 /tmp/enwik8
zstd 1.5.7 -9 4, 1 240 MB/s 1483 MB/s 31784323 31.78 /tmp/enwik8
brotli 1.1.0 -6 1, 1 51.2 MB/s 596 MB/s 31003210 31.00 /tmp/enwik8
kanzi 2.4 -4 4, 4 330 MB/s 672 MB/s 29536513 29.54 /tmp/enwik8
zstd 1.5.7 -19 4, 1 14.5 MB/s 1317 MB/s 28993324 28.99 /tmp/enwik8
kanzi 2.4 -5 4, 4 149 MB/s 267 MB/s 26523936 26.52 /tmp/enwik8
bsc 3.3.9 -m0 -e0 4, 4 120 MB/s 211 MB/s 24169136 24.17 /tmp/enwik8
kanzi 2.4 -6 4, 4 97.7 MB/s 124 MB/s 24076761 24.08 /tmp/enwik8
bsc 3.3.9 -m0 -e2 4, 4 86.2 MB/s 105 MB/s 23567976 23.57 /tmp/enwik8
bzip3 1.5.1 -5 4, 4 25.5 MB/s 53.1 MB/s 23518120 23.52 /tmp/enwik8
kanzi 2.4 -7 4, 4 59.9 MB/s 75.0 MB/s 22817356 22.82 /tmp/enwik8
kanzi 2.4 -8 4, 4 15.7 MB/s 14.8 MB/s 21181988 21.18 /tmp/enwik8
kanzi 2.4 -9 4, 4 12.1 MB/s 11.4 MB/s 20035836 20.04 /tmp/enwik8
Compressor name C,D Threads Compress. Decompress. Compr. size Ratio Filename
lz4 1.10.0 4, 1 3038 MB/s 5256 MB/s 56819478 56.82 /tmp/zhwiki100.xml
lzav 4.22 -1 1, 1 603 MB/s 3288 MB/s 47404733 47.40 /tmp/zhwiki100.xml
kanzi 2.4 -1 4, 4 523 MB/s 4842 MB/s 43602012 43.60 /tmp/zhwiki100.xml
lzav 4.22 -2 1, 1 141 MB/s 3449 MB/s 40990565 40.99 /tmp/zhwiki100.xml
kanzi 2.4 -2 4, 4 929 MB/s 3071 MB/s 40228397 40.23 /tmp/zhwiki100.xml
zstd 1.5.7 -3 4, 1 1318 MB/s 1409 MB/s 38247915 38.25 /tmp/zhwiki100.xml
brotli 1.1.0 -2 1, 1 194 MB/s 488 MB/s 39685613 39.69 /tmp/zhwiki100.xml
kanzi 2.4 -3 4, 4 388 MB/s 1900 MB/s 34425146 34.43 /tmp/zhwiki100.xml
zstd 1.5.7 -9 4, 1 255 MB/s 1462 MB/s 33730655 33.73 /tmp/zhwiki100.xml
brotli 1.1.0 -6 1, 1 51.6 MB/s 506 MB/s 31921113 31.92 /tmp/zhwiki100.xml
brotli 1.1.0 -9 1, 1 23.9 MB/s 516 MB/s 31200268 31.20 /tmp/zhwiki100.xml
kanzi 2.4 -4 4, 4 353 MB/s 913 MB/s 31845252 31.85 /tmp/zhwiki100.xml
kanzi 2.4 -5 4, 4 126 MB/s 253 MB/s 30240983 30.24 /tmp/zhwiki100.xml
zstd 1.5.7 -19 4, 1 18.7 MB/s 1128 MB/s 30180443 30.18 /tmp/zhwiki100.xml
kanzi 2.4 -6 4, 4 88.9 MB/s 115 MB/s 26668641 26.67 /tmp/zhwiki100.xml
bsc 3.3.9 -m0 -e0 4, 4 128 MB/s 209 MB/s 26005746 26.01 /tmp/zhwiki100.xml
bsc 3.3.9 -m0 -e1 4, 4 118 MB/s 149 MB/s 25480792 25.48 /tmp/zhwiki100.xml
bzip3 1.5.1 -5 4, 4 26.3 MB/s 56.6 MB/s 25244042 25.24 /tmp/zhwiki100.xml
kanzi 2.4 -7 4, 4 48.8 MB/s 64.2 MB/s 24769788 24.77 /tmp/zhwiki100.xml
kanzi 2.4 -8 4, 4 11.8 MB/s 10.6 MB/s 22619348 22.62 /tmp/zhwiki100.xml
kanzi 2.4 -9 4, 4 7.76 MB/s 7.32 MB/s 21433364 21.43 /tmp/zhwiki100.xml
Compressor name C,D Threads Compress. Decompress. Compr. size Ratio Filename
lz4 1.10.0 1, 1 3584 MB/s 5648 MB/s 119271159 87.49 /tmp/polaroid.pnm
lzav 4.22 -1 1, 1 511 MB/s 3284 MB/s 100716303 73.88 /tmp/polaroid.pnm
kanzi 2.4 -1 4, 4 400 MB/s 4231 MB/s 89043775 65.32 /tmp/polaroid.pnm
brotli 1.1.0 -2 1, 1 164 MB/s 344 MB/s 85967961 63.06 /tmp/polaroid.pnm
lzav 4.22 -2 1, 1 97.7 MB/s 2861 MB/s 85054214 62.39 /tmp/polaroid.pnm
zstd 1.5.7 -3 4, 1 880 MB/s 1004 MB/s 84304010 61.84 /tmp/polaroid.pnm
kanzi 2.4 -2 4, 4 780 MB/s 2426 MB/s 84081413 61.68 /tmp/polaroid.pnm
zstd 1.5.7 -9 4, 1 205 MB/s 1084 MB/s 72720775 53.34 /tmp/polaroid.pnm
brotli 1.1.0 -6 1, 1 35.0 MB/s 344 MB/s 70388802 51.63 /tmp/polaroid.pnm
brotli 1.1.0 -9 1, 1 11.1 MB/s 334 MB/s 67744026 49.69 /tmp/polaroid.pnm
kanzi 2.4 -3 4, 4 314 MB/s 1517 MB/s 65803850 48.27 /tmp/polaroid.pnm
zstd 1.5.7 -19 4, 1 17.6 MB/s 726 MB/s 62441879 45.80 /tmp/polaroid.pnm
kanzi 2.4 -4 4, 4 233 MB/s 789 MB/s 57802301 42.40 /tmp/polaroid.pnm
kanzi 2.4 -5 4, 4 116 MB/s 197 MB/s 51275976 37.61 /tmp/polaroid.pnm
kanzi 2.4 -6 4, 4 78.5 MB/s 77.1 MB/s 47626556 34.94 /tmp/polaroid.pnm
bsc 3.3.9 -m0 -e0 4, 4 131 MB/s 180 MB/s 47469296 34.82 /tmp/polaroid.pnm
bsc 3.3.9 -m0 -e1 4, 4 115 MB/s 125 MB/s 46134092 33.84 /tmp/polaroid.pnm
bzip3 1.5.1 -5 4, 4 24.0 MB/s 53.7 MB/s 43809195 32.14 /tmp/polaroid.pnm
kanzi 2.4 -7 4, 4 59.6 MB/s 62.3 MB/s 43308731 31.77 /tmp/polaroid.pnm
kanzi 2.4 -8 4, 4 11.2 MB/s 10.1 MB/s 43179539 31.67 /tmp/polaroid.pnm
kanzi 2.4 -9 4, 4 8.00 MB/s 7.22 MB/s 41955088 30.78 /tmp/polaroid.pnm
Compressor name C,D Threads Compress. Decompress. Compr. size Ratio Filename
lz4 1.10.0 1, 1 38323 MB/s 45720 MB/s 19675533 99.37 /tmp/Chopin.wav
lzav 4.22 -1 1, 1 19860 MB/s 49306 MB/s 19604967 99.01 /tmp/Chopin.wav
kanzi 2.4 -1 4, 4 2935 MB/s 5191 MB/s 19550540 98.74 /tmp/Chopin.wav
lzav 4.22 -2 1, 1 184 MB/s 21094 MB/s 19504527 98.50 /tmp/Chopin.wav
kanzi 2.4 -2 4, 4 1268 MB/s 2050 MB/s 16713209 84.41 /tmp/Chopin.wav
brotli 1.1.0 -2 1, 1 352 MB/s 298 MB/s 16710744 84.40 /tmp/Chopin.wav
zstd 1.5.7 -3 4, 1 2364 MB/s 1404 MB/s 16693810 84.31 /tmp/Chopin.wav
zstd 1.5.7 -9 4, 1 540 MB/s 1344 MB/s 16672841 84.20 /tmp/Chopin.wav
brotli 1.1.0 -6 1, 1 115 MB/s 308 MB/s 16639934 84.04 /tmp/Chopin.wav
zstd 1.5.7 -19 4, 4 32.2 MB/s 850 MB/s 16605746 83.86 /tmp/Chopin.wav
brotli 1.1.0 -9 1, 1 14.4 MB/s 312 MB/s 16584053 83.76 /tmp/Chopin.wav
kanzi 2.4 -5 4, 4 54.6 MB/s 88.2 MB/s 15820855 79.90 /tmp/Chopin.wav
bsc 3.3.9 -m0 -e0 4, 4 46.6 MB/s 61.5 MB/s 15335290 77.45 /tmp/Chopin.wav
kanzi 2.4 -6 4, 4 29.9 MB/s 37.2 MB/s 15270975 77.12 /tmp/Chopin.wav
bsc 3.3.9 -m0 -e1 4, 4 44.1 MB/s 37.2 MB/s 15176748 76.65 /tmp/Chopin.wav
bzip3 1.5.1 -5 3, 4 15.8 MB/s 22.9 MB/s 14729731 74.39 /tmp/Chopin.wav
kanzi 2.4 -7 4, 4 15.5 MB/s 13.2 MB/s 14279062 72.11 /tmp/Chopin.wav
kanzi 2.4 -3 4, 4 226 MB/s 1193 MB/s 13839314 69.89 /tmp/Chopin.wav
kanzi 2.4 -4 4, 4 525 MB/s 586 MB/s 11970309 60.45 /tmp/Chopin.wav
kanzi 2.4 -8 4, 4 4.13 MB/s 3.70 MB/s 11567748 58.42 /tmp/Chopin.wav
kanzi 2.4 -9 4, 4 2.74 MB/s 2.43 MB/s 10606102 53.56 /tmp/Chopin.wav
Compressor name C,D Threads Compress. Decompress. Compr. size Ratio Filename
lz4 1.10.0 4, 1 3413 MB/s 5274 MB/s 304155719 29.73 /tmp/linux-5.10.236.tar
lzav 4.22 -1 1, 1 907 MB/s 5315 MB/s 247991269 24.24 /tmp/linux-5.10.236.tar
kanzi 2.4 -1 4, 4 1116 MB/s 6985 MB/s 225052056 22.00 /tmp/linux-5.10.236.tar
lzav 4.22 -2 1, 1 253 MB/s 5791 MB/s 203544745 19.90 /tmp/linux-5.10.236.tar
kanzi 2.4 -2 4, 4 1322 MB/s 4977 MB/s 183612654 17.95 /tmp/linux-5.10.236.tar
brotli 1.1.0 -2 1, 1 304 MB/s 856 MB/s 181686800 17.76 /tmp/linux-5.10.236.tar
zstd 1.5.7 -3 4, 1 2227 MB/s 2081 MB/s 175993497 17.20 /tmp/linux-5.10.236.tar
kanzi 2.4 -3 4, 4 503 MB/s 1416 MB/s 164832278 16.11 /tmp/linux-5.10.236.tar
zstd 1.5.7 -9 4, 1 417 MB/s 2357 MB/s 149569888 14.62 /tmp/linux-5.10.236.tar
kanzi 2.4 -4 4, 4 383 MB/s 946 MB/s 148792375 14.55 /tmp/linux-5.10.236.tar
brotli 1.1.0 -6 1, 1 95.0 MB/s 997 MB/s 146289852 14.30 /tmp/linux-5.10.236.tar
kanzi 2.4 -5 4, 4 160 MB/s 296 MB/s 145512525 14.23 /tmp/linux-5.10.236.tar
brotli 1.1.0 -9 1, 1 41.9 MB/s 1043 MB/s 141440824 13.83 /tmp/linux-5.10.236.tar
bsc 3.3.9 -m3 -e1 4, 4 374 MB/s 170 MB/s 138855536 13.57 /tmp/linux-5.10.236.tar
zstd 1.5.7 -19 4, 1 21.1 MB/s 2235 MB/s 132877529 12.99 /tmp/linux-5.10.236.tar
kanzi 2.4 -6 4, 4 92.2 MB/s 140 MB/s 124917197 12.21 /tmp/linux-5.10.236.tar
kanzi 2.4 -7 4, 4 87.8 MB/s 124 MB/s 121301239 11.86 /tmp/linux-5.10.236.tar
bzip3 1.5.1 -5 4, 4 41.4 MB/s 113 MB/s 120219436 11.75 /tmp/linux-5.10.236.tar
bsc 3.3.9 -m0 -e2 4, 4 158 MB/s 192 MB/s 118726800 11.61 /tmp/linux-5.10.236.tar
kanzi 2.4 -8 4, 4 26.8 MB/s 24.7 MB/s 94184625 9.21 /tmp/linux-5.10.236.tar
kanzi 2.4 -9 4, 4 19.8 MB/s 19.0 MB/s 89120330 8.71 /tmp/linux-5.10.236.tar
Compressor name C,D Threads Compress. Decompress. Compr. size Ratio Filename
lz4 1.10.0 4, 1 3369 MB/s 5723 MB/s 100930264 47.61 /tmp/silesia.tar
lzav 4.22 -1 1, 1 802 MB/s 4655 MB/s 87717578 41.38 /tmp/silesia.tar
kanzi 2.4 -1 4, 4 675 MB/s 5758 MB/s 80245852 37.86 /tmp/silesia.tar
zstd 1.5.7 -2 4, 1 2051 MB/s 1620 MB/s 69557924 32.81 /tmp/silesia.tar
kanzi 2.4 -2 4, 4 1011 MB/s 3490 MB/s 68860095 32.49 /tmp/silesia.tar
brotli 1.1.0 -2 1, 1 250 MB/s 577 MB/s 68298004 32.22 /tmp/silesia.tar
zstd 1.5.7 -4 4, 1 1471 MB/s 1570 MB/s 65437636 30.87 /tmp/silesia.tar
brotli 1.1.0 -4 1, 1 165 MB/s 621 MB/s 65054509 30.69 /tmp/silesia.tar
kanzi 2.4 -3 4, 4 444 MB/s 1577 MB/s 64266932 30.32 /tmp/silesia.tar
zstd 1.5.7 -6 4, 1 576 MB/s 1556 MB/s 61446741 28.99 /tmp/silesia.tar
zstd 1.5.7 -9 4, 1 291 MB/s 1762 MB/s 59560121 28.10 /tmp/silesia.tar
kanzi 2.4 -4 4, 4 303 MB/s 834 MB/s 61131550 28.84 /tmp/silesia.tar
brotli 1.1.0 -6 1, 1 56.9 MB/s 634 MB/s 58785023 27.73 /tmp/silesia.tar
xz 5.6.3 -1 1, 1 35.1 MB/s 121 MB/s 58530096 27.61 /tmp/silesia.tar
brotli 1.1.0 -9 1, 1 20.8 MB/s 655 MB/s 57246954 27.01 /tmp/silesia.tar
zstd 1.5.7 -d22 -16 4, 4 26.1 MB/s 1720 MB/s 55903025 26.37 /tmp/silesia.tar
zstd 1.5.7 -d22 -22 4, 4 15.8 MB/s 1444 MB/s 54267560 25.60 /tmp/silesia.tar
kanzi 2.4 -5 4, 4 104 MB/s 200 MB/s 54025584 25.49 /tmp/silesia.tar
xz 5.6.3 -9 1, 1 5.44 MB/s 133 MB/s 50165370 23.67 /tmp/silesia.tar
kanzi 2.4 -6 4, 4 70.5 MB/s 96.4 MB/s 49521388 23.36 /tmp/silesia.tar
bsc 3.3.9 -m0 -e0 4, 4 142 MB/s 208 MB/s 49299506 23.26 /tmp/silesia.tar
bsc 3.3.9 -m0 -e2 4, 4 99.3 MB/s 105 MB/s 47726588 22.52 /tmp/silesia.tar
bzip3 1.5.1 -5 4, 4 31.6 MB/s 70.8 MB/s 47631364 22.47 /tmp/silesia.tar
kanzi 2.4 -7 4, 4 56.7 MB/s 66.7 MB/s 47312768 22.32 /tmp/silesia.tar
kanzi 2.4 -8 4, 4 14.0 MB/s 13.0 MB/s 43260250 20.41 /tmp/silesia.tar
kanzi 2.4 -9 4, 4 10.3 MB/s 9.58 MB/s 41858882 19.75 /tmp/silesia.tar
Compressor name C,D Threads Compress. Decompress. Compr. size Ratio Filename
lz4 1.10.0 4, 1 2536 MB/s 3381 MB/s 429579611 45.32 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -1 4, 4 1483 MB/s 5406 MB/s 337622411 35.62 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
lzav 4.22 -1 1, 1 692 MB/s 4992 MB/s 304140071 32.08 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
lzav 4.22 -2 1, 1 270 MB/s 5241 MB/s 236059393 24.90 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
brotli 1.1.0 -2 1, 1 232 MB/s 571 MB/s 229720774 24.23 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
zstd 1.5.7 -3 4, 1 2232 MB/s 1694 MB/s 152643296 16.10 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
zstd 1.5.7 -9 4, 1 398 MB/s 1896 MB/s 141364224 14.91 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -2 4, 4 781 MB/s 4454 MB/s 130144315 13.73 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
brotli 1.1.0 -6 1, 1 59.7 MB/s 1027 MB/s 124640937 13.15 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -3 4, 4 556 MB/s 4516 MB/s 121948088 12.86 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -4 4, 4 414 MB/s 1945 MB/s 118485641 12.50 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
brotli 1.1.0 -9 1, 1 16.9 MB/s 1249 MB/s 101153353 10.67 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -5 4, 4 107 MB/s 239 MB/s 98505969 10.39 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -6 4, 4 80.2 MB/s 141 MB/s 84251532 8.89 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
bsc 3.3.9 -m0 -e0 4, 4 182 MB/s 298 MB/s 83780886 8.84 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
bzip3 1.5.1 -5 4, 4 30.2 MB/s 61.8 MB/s 83400126 8.80 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
bsc 3.3.9 -m0 -e1 4, 4 174 MB/s 251 MB/s 81870280 8.64 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
zstd 1.5.7 -19 4, 1 13.0 MB/s 2390 MB/s 79287270 8.36 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -7 4, 4 62.3 MB/s 110 MB/s 77255347 8.15 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -8 4, 4 27.5 MB/s 25.0 MB/s 73786715 7.78 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta
kanzi 2.4 -9 4, 4 20.5 MB/s 19.0 MB/s 66592785 7.02 /tmp/SILVA_123_SSURef_Nr99_tax_silva.fasta