OCamlBuild + OCamlDoc is slooooow

OCamlBuild + OCamlDoc is slooooow

[David Rajchenbach-Teller]

      Dear list,
 As a number of people on this list have noticed already, the
documentation generation of Batteries Included is awfully slow.
According to our experiments, this is due to the fact that the
combination of ocamlbuild and ocamldoc keeps loading stuff, marshalling
it to the disk and immediately unmarshalling. Alone, this unmarshalling
seems much more costly than all other operations together.

Which brings me to my question: is there a simple way of obtaining the
traditional behaviour of ocamldoc, without this wasteful partial
compilation?

Thanks,
 David

-- 
David Teller-Rajchenbach
 Security of Distributed Systems
  http://www.univ-orleans.fr/lifo/Members/David.Teller
   « Ce matin Un crétin A tué un chercheur. » (air connu)
   Latest News of French Research: System being liquidated. Researchers angry.

Re: [Caml-list] OCamlBuild + OCamlDoc is slooooow

[David Rajchenbach-Teller]

I'm using ocamldoc, as I need a custom generator.

I've considered using ocamldoc.opt to generate the n first dumps and I
may do this, if I find out how to get OCamlBuild to do this. However,
the last load already takes something like 8 minutes, so that would not
solve all issues.

Thanks,
 David

On Wed, 2009-03-11 at 07:30 +0100, Maxence Guesdon wrote:
> On Tue, 10 Mar 2009 23:23:18 +0100
> Hello David,
> 
> Do you use ocamldoc.opt or ocamldoc ? It should be faster with the native
> version. Of course, if you use a custom generators, you will have to wait
> until I add the -g option to the native version of ocamldoc (which will be
> possible since native code loading is now available). Another way could be
> to use ocamldoc.opt until the last dump, then use ocamldoc only for output.
> I don't know how to do this with ocamlbuild.
> 
> Friendly,
> 
> Maxence
> 
-- 
David Teller-Rajchenbach
 Security of Distributed Systems
  http://www.univ-orleans.fr/lifo/Members/David.Teller
   « Ce matin Un crétin A tué un chercheur. » (air connu)
   Latest News of French Research: System being liquidated. Researchers angry.

Re: [Caml-list] OCamlBuild + OCamlDoc is slooooow

[Maxence Guesdon]

On Wed, 11 Mar 2009 08:40:33 +0100
David Rajchenbach-Teller <David.Teller@ens-lyon.org> wrote:

> I'm using ocamldoc, as I need a custom generator.
> 
> I've considered using ocamldoc.opt to generate the n first dumps and I
> may do this, if I find out how to get OCamlBuild to do this. However,
> the last load already takes something like 8 minutes, so that would not
> solve all issues.

Ok. So you may be happy to learn that I just added the -g and -i options to
ocamldoc.opt in the trunk of ocaml repostiory (available within some
hours). You may give it a try and see if it reduces the computation to an
acceptable duration.

Regards,

-- 
Maxence Guesdon                           http://yquem.inria.fr/~guesdon/
Service Expérimentation et Développements https://devel.inria.fr/rocq/
INRIA Paris-Rocquencourt                  http://www.inria.fr/rocquencourt/

Re: [Caml-list] OCamlBuild + OCamlDoc is slooooow

[David Rajchenbach-Teller]

That's good news indeed. However, I'm afraid that since it's not yet
part of the OCaml distribution, and since we can't compile it without
the source of OCaml, we can't use it for the current release of
Batteries :(


On Wed, 2009-03-11 at 08:46 +0100, Maxence Guesdon wrote:
> Ok. So you may be happy to learn that I just added the -g and -i options to
> ocamldoc.opt in the trunk of ocaml repostiory (available within some
> hours). You may give it a try and see if it reduces the computation to an
> acceptable duration.
> 
> Regards,
> 
-- 
David Teller-Rajchenbach
 Security of Distributed Systems
  http://www.univ-orleans.fr/lifo/Members/David.Teller
   « Ce matin Un crétin A tué un chercheur. » (air connu)
   Latest News of French Research: System being liquidated. Researchers angry.