From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <edwin+ml-ocaml@etorok.net>
X-Original-To: caml-list@sympa.inria.fr
Delivered-To: caml-list@sympa.inria.fr
Received: from mail2-relais-roc.national.inria.fr (mail2-relais-roc.national.inria.fr [192.134.164.83])
	by sympa.inria.fr (Postfix) with ESMTPS id BAEB57F30A
	for <caml-list@sympa.inria.fr>; Mon, 25 Feb 2013 17:52:12 +0100 (CET)
Received-SPF: None (mail2-smtp-roc.national.inria.fr: no sender
  authenticity information available from domain of
  edwin+ml-ocaml@etorok.net) identity=pra;
  client-ip=176.9.138.55;
  receiver=mail2-smtp-roc.national.inria.fr;
  envelope-from="edwin+ml-ocaml@etorok.net";
  x-sender="edwin+ml-ocaml@etorok.net";
  x-conformance=sidf_compatible
Received-SPF: Pass (mail2-smtp-roc.national.inria.fr: domain of
  edwin+ml-ocaml@etorok.net designates 176.9.138.55 as
  permitted sender) identity=mailfrom; client-ip=176.9.138.55;
  receiver=mail2-smtp-roc.national.inria.fr;
  envelope-from="edwin+ml-ocaml@etorok.net";
  x-sender="edwin+ml-ocaml@etorok.net";
  x-conformance=sidf_compatible; x-record-type="v=spf1"
Received-SPF: Pass (mail2-smtp-roc.national.inria.fr: domain of
  postmaster@mail.etorok.net designates 176.9.138.55 as
  permitted sender) identity=helo; client-ip=176.9.138.55;
  receiver=mail2-smtp-roc.national.inria.fr;
  envelope-from="edwin+ml-ocaml@etorok.net";
  x-sender="postmaster@mail.etorok.net";
  x-conformance=sidf_compatible; x-record-type="v=spf1"
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: AgEFAHaWK1GwCYo3/2dsb2JhbABFgma+b4EFFnOCHwEBBQwmAQ0BATYCDyMJFg8JAwIBAgFFEwgCiBADrGeEOwEFjgkGjxUWgyqWQJBlgwk
X-IPAS-Result: AgEFAHaWK1GwCYo3/2dsb2JhbABFgma+b4EFFnOCHwEBBQwmAQ0BATYCDyMJFg8JAwIBAgFFEwgCiBADrGeEOwEFjgkGjxUWgyqWQJBlgwk
X-IronPort-AV: E=Sophos;i="4.84,735,1355094000"; 
   d="scan'208";a="4417236"
Received: from mail.etorok.net ([176.9.138.55])
  by mail2-smtp-roc.national.inria.fr with ESMTP; 25 Feb 2013 17:52:12 +0100
Received: from [IPv6:2a02:2f09:4080:18b:1e6f:65ff:fe23:db0d] (unknown [IPv6:2a02:2f09:4080:18b:1e6f:65ff:fe23:db0d])
	by mail.etorok.net (Postfix) with ESMTPSA id 9CEB046DE
	for <caml-list@inria.fr>; Mon, 25 Feb 2013 17:52:11 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=etorok.net;
	s=MAILOUT; t=1361811131;
	bh=gfVdMA1PzBUc3SisYAgsUyjwF0Rur7prZxBABi8U1l0=;
	h=Message-ID:Date:From:MIME-Version:To:Subject:References:
	 In-Reply-To:Content-Type:Content-Transfer-Encoding;
	b=DD+H4GRXEcO7LLS4WrU1V/71Nz9VdBFyrmNXuEUvxvGeLseD5+Fi2GJLDL51WCsUx
	 +slNzJGRuNPDPe2Z1Z6GpUhQS6PX9NhJNShi7xPfHOwVbv+mj9F7ccWi2oDtzDmY8k
	 rqKZk2N7stdxjbfAR+R/Nri0ZH0+k0adEbHhynrQ=
Message-ID: <512B96BA.6090406@etorok.net>
Date: Mon, 25 Feb 2013 18:52:10 +0200
From: =?ISO-8859-1?Q?T=F6r=F6k_Edwin?= <edwin+ml-ocaml@etorok.net>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.12) Gecko/20130116 Icedove/10.0.12
MIME-Version: 1.0
To: caml-list@inria.fr
References: <1361799073.2723.5@samsung> <512B872B.60809@lexifi.com> <CAPFanBE7xveakSOhZNsOWWgH6LgPi87bakA=nUw-rXiVzCb0Ew@mail.gmail.com>
In-Reply-To: <CAPFanBE7xveakSOhZNsOWWgH6LgPi87bakA=nUw-rXiVzCb0Ew@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-Virus-Scanned: clamav-milter 0.97.6 at mail
X-Virus-Status: Clean
Subject: [Caml-list] OCaml benchmarks

On 02/25/2013 06:32 PM, Gabriel Scherer wrote:
> Thanks for the friendly poking. I did get some code (I've actually
> been surprised by how dedicated some submitters one, eg. Edwin Török),
> but my plate has been full non-stop since and I haven't yet taken the
> time to put this into shape. It's on my TODO list and I hope to share
> some results in the coming weeks.


Thanks, its not yet finished though: I meant to add a benchmark for ocaml-re too and then publish it.
I got sidetracked trying to find some meaningful way to easily represent the results though (the text output is a bit too verbose).

But since you brought it up I'd like your opinion on plots:

Currently I'm thinking of generating from the .csv:
 - one SVG boxplot for (weighted) median/mean of OCaml version X vs Y performance
 - one SVG paired barplot with confidence intervals for the individual benchmarks
  - instead of X-axis labels have on-mouse-over tooltips (SVG title element) describing benchmark name and time statistics

Initially I tried boxplots for the individual measurements (using PNG/PDF output of archimedes),
but the graphs either looked too crowded (not enough room to place all labels),
or there were too many graphs and hard to get an overall picture (if I put fewer benchmarks/page).


Best regards,
--Edwin