Skip to content

General graphing updates: Median, normalization, rounding, tooltips, toolbar #116

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Ivorforce
Copy link
Member

@Ivorforce Ivorforce commented Jul 14, 2025

Here's the changes:

  • Update ApexCharts (I noticed that it was quite unreliable with tick values; it's a bit better in the new version)
  • Always use relative values to display benchmarks. Actual values are platform dependent and therefore meaningless to a reader, without knowing how the benchmark was implemented and where it runs. What's important is seeing at a glance which benchmarks are improving and which are regressing. Therefore, a reference of 1.0 is appropriate for every benchmark.
  • Use the median of the last 10 values as reference, such that new benchmarks are always on the graph. Using the average of all values can look nicer, but it can make the graph useless for day to day improvements. The important values are the very newest ones. The median should be used instead of mean because it's more robust against outliers.
  • Don't round values in the data aggregator, round them on visualization instead. This should be obvious why it's important, otherwise we'll get artifacts in the graph.
  • Toolbar, zoom especially, is enabled in detail view.
  • Tooltips are no longer shared, such that singular lines can be dissected by hovering.
  • I tried to add logarithmic scales, but apex charts appears to be very buggy with them. Scrapped for the moment.

Some comparisons

Before:
SCR-20250714-nnxn

After: (the colors should still appear the same, my dataset just seems to be slightly different)
SCR-20250714-nnzn

Before:
SCR-20250714-nobn

After:
SCR-20250714-nods

Before:
SCR-20250714-nrxd

After:
SCR-20250714-nscy

@Ivorforce Ivorforce changed the title General graphing updates: Median, normalization, rounding General graphing updates: Median, normalization, rounding, tooltips, toolbar Jul 14, 2025
@Ivorforce Ivorforce force-pushed the graph-relative-values branch from fb50cf8 to 20f90cf Compare July 14, 2025 13:39
    Always use relative values to display benchmarks (actual values are platform dependent and meaningless).
    Use the median of the last 10 values as middle, such that new benchmarks are always on the graph.
    Don't round values in the data aggregator, round them on visualization instead.
    Use toolbar in detail charts.
    Don't use shared tooltip.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants