Provide more high level, overview information #889
Description
I used Criterion to benchmark 5 YAML parsing libraries. It provided me with a lot of data (the benchmarking project page is here), but essentially nothing suitable for a small article, blog post, or announcement. All information is too focused on a single particular library, whereas a comparison publication would require a summary table or summary charts that plot all cases together. For instance,
- A simple table somehow estimates the duration of the cases (after warming), with +- statistical information.
- Statistical distribution curves of duration could be drawn in a combined plot.
- Box and whisker plot.
- If there is some other changing parameter like data set size, then also relative vs baseline:
To get the plots I need, I quickly wrote the code in Python. I would like to have this information immediately available out of the box, rather than scripting, before I can see the big picture.