Skip to content

Run Benchmarks

Run Benchmarks #1574

Triggered via schedule February 9, 2026 00:23
Status Failure
Total duration 1h 33m 49s
Artifacts

benchmarks.yml

on: schedule
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 16 warnings
benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'Criterion.rs Benchmark'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: 5c75842bcd24fee941f5d6c9a3eda4abc9984a10 | Previous: 4b53af2ca3df47dedd7b4bb2dddb7503b9e130be | Ratio | |-|-|-|-| | `end-to-end/wasmtime/wasi-demo-app:latest` | `314663104` ns/iter (`± 9447100`) | `138006331` ns/iter (`± 2552141`) | `2.28` | | `end-to-end/wasmtime/wasi-demo-oci:latest` | `230334131` ns/iter (`± 4414980`) | `81509222` ns/iter (`± 1472686`) | `2.83` | | `end-to-end/wasmedge/wasi-demo-app:latest` | `329579884` ns/iter (`± 5633766`) | `111181048` ns/iter (`± 2177067`) | `2.96` | | `end-to-end/wasmedge/wasi-demo-oci:latest` | `336051500` ns/iter (`± 6102060`) | `119592647` ns/iter (`± 1657417`) | `2.81` | | `end-to-end/wasmer/wasi-demo-app:latest` | `298157017` ns/iter (`± 4614214`) | `133520814` ns/iter (`± 4330039`) | `2.23` | | `end-to-end/wasmer/wasi-demo-oci:latest` | `304210956` ns/iter (`± 5286100`) | `134456642` ns/iter (`± 4984492`) | `2.26` | | `end-to-end/wamr/wasi-demo-app:latest` | `231548044` ns/iter (`± 4384803`) | `83548596` ns/iter (`± 3696604`) | `2.77` | | `end-to-end/wamr/wasi-demo-oci:latest` | `234088700` ns/iter (`± 5927810`) | `84845221` ns/iter (`± 2092269`) | `2.76` | This comment was automatically generated by [workflow](https://github.com/containerd/runwasi/actions?query=workflow%3ARun%20Benchmarks) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @runwasi-committers
benchmark-stress
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'Stress Test Benchmark'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: 5c75842bcd24fee941f5d6c9a3eda4abc9984a10 | Previous: 4b53af2ca3df47dedd7b4bb2dddb7503b9e130be | Ratio | |-|-|-|-| | `Stress Test Throughput with containerd service - wamr (app)` | `1.1253411921335865` tasks/s | `48.837098041762395` tasks/s | `43.40` | | `Stress Test Throughput with containerd service - wasmedge (app)` | `1.4044647894759426` tasks/s | `33.3436443674253` tasks/s | `23.74` | | `Stress Test Throughput with containerd service - wasmer (app)` | `1.342838795849569` tasks/s | `14.174772996114093` tasks/s | `10.56` | | `Stress Test Throughput with containerd service - wasmtime (app)` | `3.7347559634305743` tasks/s | `14.349195864743637` tasks/s | `3.84` | | `Stress Test Throughput with containerd service - wamr (oci)` | `1.1144768909413143` tasks/s | `37.13893249751937` tasks/s | `33.32` | | `Stress Test Throughput with containerd service - wasmedge (oci)` | `1.346361558043205` tasks/s | `28.696274348117935` tasks/s | `21.31` | | `Stress Test Throughput with containerd service - wasmer (oci)` | `1.3203199319318968` tasks/s | `13.074618889998785` tasks/s | `9.90` | | `Stress Test Throughput with containerd service - wasmtime (oci)` | `4.513229074896112` tasks/s | `59.105781935505334` tasks/s | `13.10` | This comment was automatically generated by [workflow](https://github.com/containerd/runwasi/actions?query=workflow%3ARun%20Benchmarks) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @runwasi-committers
benchmark
Performance alert! Previous value was 84845221 and current value is 234088700. It is 2.759008665909421x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 83548596 and current value is 231548044. It is 2.7714175352509813x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 134456642 and current value is 304210956. It is 2.2625208504017227x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 133520814 and current value is 298157017. It is 2.233037741965833x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 119592647 and current value is 336051500. It is 2.8099679071406456x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 111181048 and current value is 329579884. It is 2.9643530973012595x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 81509222 and current value is 230334131. It is 2.825865900179982x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 138006331 and current value is 314663104. It is 2.280062818277518x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 59.105781935505334 and current value is 4.513229074896112. It is 13.096118312334026x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 13.074618889998785 and current value is 1.3203199319318968. It is 9.902614187508293x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 28.696274348117935 and current value is 1.346361558043205. It is 21.313943625830312x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 37.13893249751937 and current value is 1.1144768909413143. It is 33.324093841148134x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 14.349195864743637 and current value is 3.7347559634305743. It is 3.842070540952595x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 14.174772996114093 and current value is 1.342838795849569. It is 10.555826239102805x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 33.3436443674253 and current value is 1.4044647894759426. It is 23.741175013627103x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 48.837098041762395 and current value is 1.1253411921335865. It is 43.39759211086007x worse than previous exceeding a ratio threshold 1.3