[Caml-list] OCaml benchmarks

["Török Edwin" <edwin+ml-ocaml@etorok.net>]

On 02/25/2013 06:32 PM, Gabriel Scherer wrote:
> Thanks for the friendly poking. I did get some code (I've actually
> been surprised by how dedicated some submitters one, eg. Edwin Török),
> but my plate has been full non-stop since and I haven't yet taken the
> time to put this into shape. It's on my TODO list and I hope to share
> some results in the coming weeks.


Thanks, its not yet finished though: I meant to add a benchmark for ocaml-re too and then publish it.
I got sidetracked trying to find some meaningful way to easily represent the results though (the text output is a bit too verbose).

But since you brought it up I'd like your opinion on plots:

Currently I'm thinking of generating from the .csv:
 - one SVG boxplot for (weighted) median/mean of OCaml version X vs Y performance
 - one SVG paired barplot with confidence intervals for the individual benchmarks
  - instead of X-axis labels have on-mouse-over tooltips (SVG title element) describing benchmark name and time statistics

Initially I tried boxplots for the individual measurements (using PNG/PDF output of archimedes),
but the graphs either looked too crowded (not enough room to place all labels),
or there were too many graphs and hard to get an overall picture (if I put fewer benchmarks/page).


Best regards,
--Edwin