Skip to content

Run Benchmarks

Run Benchmarks #1575

Triggered via schedule February 10, 2026 00:27
Status Failure
Total duration 1h 32m 5s
Artifacts

benchmarks.yml

on: schedule
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 16 warnings
benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'Criterion.rs Benchmark'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: 5c75842bcd24fee941f5d6c9a3eda4abc9984a10 | Previous: 4b53af2ca3df47dedd7b4bb2dddb7503b9e130be | Ratio | |-|-|-|-| | `end-to-end/wasmtime/wasi-demo-app:latest` | `352898945` ns/iter (`± 6907281`) | `138006331` ns/iter (`± 2552141`) | `2.56` | | `end-to-end/wasmtime/wasi-demo-oci:latest` | `272428099` ns/iter (`± 6194351`) | `81509222` ns/iter (`± 1472686`) | `3.34` | | `end-to-end/wasmedge/wasi-demo-app:latest` | `386558297` ns/iter (`± 4651032`) | `111181048` ns/iter (`± 2177067`) | `3.48` | | `end-to-end/wasmedge/wasi-demo-oci:latest` | `392158201` ns/iter (`± 8120499`) | `119592647` ns/iter (`± 1657417`) | `3.28` | | `end-to-end/wasmer/wasi-demo-app:latest` | `335130692` ns/iter (`± 9827222`) | `133520814` ns/iter (`± 4330039`) | `2.51` | | `end-to-end/wasmer/wasi-demo-oci:latest` | `346157027` ns/iter (`± 8792231`) | `134456642` ns/iter (`± 4984492`) | `2.57` | | `end-to-end/wamr/wasi-demo-app:latest` | `269984306` ns/iter (`± 7872303`) | `83548596` ns/iter (`± 3696604`) | `3.23` | | `end-to-end/wamr/wasi-demo-oci:latest` | `270218216` ns/iter (`± 6923764`) | `84845221` ns/iter (`± 2092269`) | `3.18` | This comment was automatically generated by [workflow](https://github.com/containerd/runwasi/actions?query=workflow%3ARun%20Benchmarks) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @runwasi-committers
benchmark-stress
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'Stress Test Benchmark'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: 5c75842bcd24fee941f5d6c9a3eda4abc9984a10 | Previous: 4b53af2ca3df47dedd7b4bb2dddb7503b9e130be | Ratio | |-|-|-|-| | `Stress Test Throughput with containerd service - wamr (app)` | `1.1593352429196013` tasks/s | `48.837098041762395` tasks/s | `42.13` | | `Stress Test Throughput with containerd service - wasmedge (app)` | `1.4272251793288318` tasks/s | `33.3436443674253` tasks/s | `23.36` | | `Stress Test Throughput with containerd service - wasmer (app)` | `1.3732084904361344` tasks/s | `14.174772996114093` tasks/s | `10.32` | | `Stress Test Throughput with containerd service - wasmtime (app)` | `3.664008145172884` tasks/s | `14.349195864743637` tasks/s | `3.92` | | `Stress Test Throughput with containerd service - wamr (oci)` | `1.154234850250585` tasks/s | `37.13893249751937` tasks/s | `32.18` | | `Stress Test Throughput with containerd service - wasmedge (oci)` | `1.3677843165322379` tasks/s | `28.696274348117935` tasks/s | `20.98` | | `Stress Test Throughput with containerd service - wasmer (oci)` | `1.3538668045889772` tasks/s | `13.074618889998785` tasks/s | `9.66` | | `Stress Test Throughput with containerd service - wasmtime (oci)` | `4.440276617161735` tasks/s | `59.105781935505334` tasks/s | `13.31` | This comment was automatically generated by [workflow](https://github.com/containerd/runwasi/actions?query=workflow%3ARun%20Benchmarks) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @runwasi-committers
benchmark
Performance alert! Previous value was 84845221 and current value is 270218216. It is 3.1848371990214983x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 83548596 and current value is 269984306. It is 3.2314643085085475x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 134456642 and current value is 346157027. It is 2.5744881163996345x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 133520814 and current value is 335130692. It is 2.509950935439923x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 119592647 and current value is 392158201. It is 3.279116323932524x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 111181048 and current value is 386558297. It is 3.476836241011148x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 81509222 and current value is 272428099. It is 3.342297869068116x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 138006331 and current value is 352898945. It is 2.557121419306481x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 59.105781935505334 and current value is 4.440276617161735. It is 13.311283740085159x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 13.074618889998785 and current value is 1.3538668045889772. It is 9.657241647170846x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 28.696274348117935 and current value is 1.3677843165322379. It is 20.980116529535877x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 37.13893249751937 and current value is 1.154234850250585. It is 32.17623561570376x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 14.349195864743637 and current value is 3.664008145172884. It is 3.9162565409817285x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 14.174772996114093 and current value is 1.3732084904361344. It is 10.322375003385066x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 33.3436443674253 and current value is 1.4272251793288318. It is 23.362567344212295x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 48.837098041762395 and current value is 1.1593352429196013. It is 42.12508706176648x worse than previous exceeding a ratio threshold 1.3