Skip to content

Run Benchmarks

Run Benchmarks #1577

Triggered via schedule February 12, 2026 00:21
Status Failure
Total duration 1h 33m 28s
Artifacts

benchmarks.yml

on: schedule
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 16 warnings
benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'Criterion.rs Benchmark'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: 5c75842bcd24fee941f5d6c9a3eda4abc9984a10 | Previous: 4b53af2ca3df47dedd7b4bb2dddb7503b9e130be | Ratio | |-|-|-|-| | `end-to-end/wasmtime/wasi-demo-app:latest` | `358126886` ns/iter (`± 12046017`) | `138006331` ns/iter (`± 2552141`) | `2.60` | | `end-to-end/wasmtime/wasi-demo-oci:latest` | `279738412` ns/iter (`± 9056540`) | `81509222` ns/iter (`± 1472686`) | `3.43` | | `end-to-end/wasmedge/wasi-demo-app:latest` | `393646082` ns/iter (`± 6756023`) | `111181048` ns/iter (`± 2177067`) | `3.54` | | `end-to-end/wasmedge/wasi-demo-oci:latest` | `403324110` ns/iter (`± 3151916`) | `119592647` ns/iter (`± 1657417`) | `3.37` | | `end-to-end/wasmer/wasi-demo-app:latest` | `352177479` ns/iter (`± 9861000`) | `133520814` ns/iter (`± 4330039`) | `2.64` | | `end-to-end/wasmer/wasi-demo-oci:latest` | `360063707` ns/iter (`± 5828708`) | `134456642` ns/iter (`± 4984492`) | `2.68` | | `end-to-end/wamr/wasi-demo-app:latest` | `277401743` ns/iter (`± 6217176`) | `83548596` ns/iter (`± 3696604`) | `3.32` | | `end-to-end/wamr/wasi-demo-oci:latest` | `283470657` ns/iter (`± 8183480`) | `84845221` ns/iter (`± 2092269`) | `3.34` | This comment was automatically generated by [workflow](https://github.com/containerd/runwasi/actions?query=workflow%3ARun%20Benchmarks) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @runwasi-committers
benchmark-stress
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'Stress Test Benchmark'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.30`. | Benchmark suite | Current: 5c75842bcd24fee941f5d6c9a3eda4abc9984a10 | Previous: 4b53af2ca3df47dedd7b4bb2dddb7503b9e130be | Ratio | |-|-|-|-| | `Stress Test Throughput with containerd service - wamr (app)` | `1.169122018653888` tasks/s | `48.837098041762395` tasks/s | `41.77` | | `Stress Test Throughput with containerd service - wasmedge (app)` | `1.3769214646298522` tasks/s | `33.3436443674253` tasks/s | `24.22` | | `Stress Test Throughput with containerd service - wasmer (app)` | `1.324781412085034` tasks/s | `14.174772996114093` tasks/s | `10.70` | | `Stress Test Throughput with containerd service - wasmtime (app)` | `3.7483413462989255` tasks/s | `14.349195864743637` tasks/s | `3.83` | | `Stress Test Throughput with containerd service - wamr (oci)` | `1.1574162144164548` tasks/s | `37.13893249751937` tasks/s | `32.09` | | `Stress Test Throughput with containerd service - wasmedge (oci)` | `1.3184439896725788` tasks/s | `28.696274348117935` tasks/s | `21.77` | | `Stress Test Throughput with containerd service - wasmer (oci)` | `1.3077786192507912` tasks/s | `13.074618889998785` tasks/s | `10.00` | | `Stress Test Throughput with containerd service - wasmtime (oci)` | `4.583958249834206` tasks/s | `59.105781935505334` tasks/s | `12.89` | This comment was automatically generated by [workflow](https://github.com/containerd/runwasi/actions?query=workflow%3ARun%20Benchmarks) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @runwasi-committers
benchmark
Performance alert! Previous value was 84845221 and current value is 283470657. It is 3.341032690574287x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 83548596 and current value is 277401743. It is 3.3202442205013236x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 134456642 and current value is 360063707. It is 2.6779168484662885x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 133520814 and current value is 352177479. It is 2.6376223185697474x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 119592647 and current value is 403324110. It is 3.37248250722304x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 111181048 and current value is 393646082. It is 3.5405861797597016x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 81509222 and current value is 279738412. It is 3.431984812712358x worse than previous exceeding a ratio threshold 1.3
benchmark
Performance alert! Previous value was 138006331 and current value is 358126886. It is 2.595003311840817x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 59.105781935505334 and current value is 4.583958249834206. It is 12.894048923251667x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 13.074618889998785 and current value is 1.3077786192507912. It is 9.99757810499231x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 28.696274348117935 and current value is 1.3184439896725788. It is 21.76525857214787x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 37.13893249751937 and current value is 1.1574162144164548. It is 32.08779351362729x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 14.349195864743637 and current value is 3.7483413462989255. It is 3.828145448629402x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 14.174772996114093 and current value is 1.324781412085034. It is 10.699707036049698x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 33.3436443674253 and current value is 1.3769214646298522. It is 24.216082924082258x worse than previous exceeding a ratio threshold 1.3
benchmark-stress
Performance alert! Previous value was 48.837098041762395 and current value is 1.169122018653888. It is 41.7724559648554x worse than previous exceeding a ratio threshold 1.3