caml-list - the Caml user's mailing list
 help / color / mirror / Atom feed
* RE: Portability of applications written in OCAML
@ 2000-02-21 19:02 Don Syme
  0 siblings, 0 replies; 12+ messages in thread
From: Don Syme @ 2000-02-21 19:02 UTC (permalink / raw)
  To: 'caml-list@pauillac.inria.fr'


Under Windows, I would ideally I'd like to package up binary distributions
in the same way I would any other kind of application, e.g. using a "do it
all for you" packager like InstallShield.  Has anyone had experience of
doing this with Caml applications?  

Thanks,
Don


-----Original Message-----
From: Xavier Leroy [mailto:Xavier.Leroy@inria.fr]
Sent: 21 February 2000 17:04
To: caml-redistribution@pauillac.inria.fr
Subject: Re: Portability of applications written in OCAML


Claude Marche asks:

>One idea could be distributing bytecode: is it true the any bytecode
>can be executed on any architecture and OS as soon as the right
>ocamlrun is used? (Even under non unix OSs like Microsoft-Windows or
>Mac-OS?) 

For MacOS, there are some problems with end-of-line being represented
by different control characters in MacOS and in Unix and Windows.  So,
newlines in program output are broken.

For MacOS and Windows, there is also the fact that file path names are
represented differently.  So, if your program manipulates file names,
even though the Filename module, the bytecode may not work well under
a different OS.

I think the easiest way to distribute an OCaml application is as
sources, plus binaries for a couple of popular architectures
(typically, Linux/Intel and Windows).  Novice users can pick the
binaries, and experienced users should have no problems installing
OCaml for compiling your application.

Gerd Stolpmann wrote:
> My suggestion: Every modern operating system can link libraries
dynamically.
> This is also possible for the parts of the OCaml libraries written in C
> which need to be available in the runtime system.

Right, I have been considering dynamic loading of C libraries as an
alternative to -custom.  This would allow, among other benefits,
dynamic loading of Caml libraries that contain some C code.

There are some portability issues with old or exotic versions of Unix,
but I think it can be made to work under, say, Linux, Solaris,
Digital/Tru64 Unix, and Windows.  There are some issues still to be
resolved, however, such as how to build shared C libraries in a
portable fashion, perhaps by using the GNU libtool package.

> - Only libraries needed for the application are loaded into memory;
>   the memory footprints become much smaller

Yes and no, because static linking under C is able to remove members
of the .a archive that are not referenced, while dynamic loading
typically loads everything.  But memory footprint of code is not much
of an issue these days.

- Xavier Leroy



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-22  8:13     ` Sven LUTHER
@ 2000-02-22  9:21       ` Xavier Leroy
  0 siblings, 0 replies; 12+ messages in thread
From: Xavier Leroy @ 2000-02-22  9:21 UTC (permalink / raw)
  To: Gerd.Stolpmann, Claude Marche, caml-list

> Would that make -custom bytecode arch independent again ?

That's the idea, yes.

> how do you handle libraries with different exported symbols per arch ?

Typically, when interfacing an existing C library with Caml, you have
two libraries: the C library and a library containing the stub
functions for communication with Caml.  The latter must export the
same stub functions on all platforms, indeed, but it can then adapt to
variations in the underlying C library using #ifdefs and so on.

> Euh, ...
> is the member removal not done using the strip program ? 

Not at all.  I was talking about the following feature of Unix
linkers: when a ".a" library is statically linked, not all ".o" object
files contained in the library are linked and put in the executable,
but only those that define symbols actually referenced by the program.

> stripping ocaml
> bytecode executable is a very bad idea, as can be seen when trying to strip
> ocamldebug for example. Notice that ocamlc, ocamlopt and ocaml don't seem to
> suffer from this problem.

Yes, all bytecode executables produced with the -custom option must
not be stripped.  This is even mentioned in the manual, I think.

- Xavier Leroy



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-18  9:36   ` Xavier Leroy
  2000-02-21 20:45     ` skaller
@ 2000-02-22  8:13     ` Sven LUTHER
  2000-02-22  9:21       ` Xavier Leroy
  1 sibling, 1 reply; 12+ messages in thread
From: Sven LUTHER @ 2000-02-22  8:13 UTC (permalink / raw)
  To: Xavier Leroy; +Cc: Gerd.Stolpmann, Claude Marche, caml-list

On Fri, Feb 18, 2000 at 10:36:03AM +0100, Xavier Leroy wrote:
> Claude Marche asks:
> 
> >One idea could be distributing bytecode: is it true the any bytecode
> >can be executed on any architecture and OS as soon as the right
> >ocamlrun is used? (Even under non unix OSs like Microsoft-Windows or
> >Mac-OS?) 
> 
> For MacOS, there are some problems with end-of-line being represented
> by different control characters in MacOS and in Unix and Windows.  So,
> newlines in program output are broken.
> 
> For MacOS and Windows, there is also the fact that file path names are
> represented differently.  So, if your program manipulates file names,
> even though the Filename module, the bytecode may not work well under
> a different OS.
> 
> I think the easiest way to distribute an OCaml application is as
> sources, plus binaries for a couple of popular architectures
> (typically, Linux/Intel and Windows).  Novice users can pick the
> binaries, and experienced users should have no problems installing
> OCaml for compiling your application.
> 
> Gerd Stolpmann wrote:
> > My suggestion: Every modern operating system can link libraries dynamically.
> > This is also possible for the parts of the OCaml libraries written in C
> > which need to be available in the runtime system.
> 
> Right, I have been considering dynamic loading of C libraries as an
> alternative to -custom.  This would allow, among other benefits,
> dynamic loading of Caml libraries that contain some C code.

Would that make -custom bytecode arch independent again ? how do you handle
libraries with different exported symbols per arch ?

> There are some portability issues with old or exotic versions of Unix,
> but I think it can be made to work under, say, Linux, Solaris,
> Digital/Tru64 Unix, and Windows.  There are some issues still to be
> resolved, however, such as how to build shared C libraries in a
> portable fashion, perhaps by using the GNU libtool package.
> 
> > - Only libraries needed for the application are loaded into memory;
> >   the memory footprints become much smaller
> 
> Yes and no, because static linking under C is able to remove members
> of the .a archive that are not referenced, while dynamic loading
> typically loads everything.  But memory footprint of code is not much
> of an issue these days.

Euh, ...

is the member removal not done using the strip program ? stripping ocaml
bytecode executable is a very bad idea, as can be seen when trying to strip
ocamldebug for example. Notice that ocamlc, ocamlopt and ocaml don't seem to
suffer from this problem.

Friendly,

Sven LUTHER




^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-18  9:36   ` Xavier Leroy
@ 2000-02-21 20:45     ` skaller
  2000-02-22  8:13     ` Sven LUTHER
  1 sibling, 0 replies; 12+ messages in thread
From: skaller @ 2000-02-21 20:45 UTC (permalink / raw)
  To: caml-list

Xavier Leroy wrote:
 
> I think the easiest way to distribute an OCaml application is as
> sources, plus binaries for a couple of popular architectures
> (typically, Linux/Intel and Windows).  Novice users can pick the
> binaries, and experienced users should have no problems installing
> OCaml for compiling your application.

I have no problem compiling Ocaml on my Linux box but I CANNOT
do so on my WinNT box -- I don't have a C compiler for Windows
[except gcc for Cygwin]

-- 
John (Max) Skaller, mailto:skaller@maxtal.com.au
10/1 Toxteth Rd Glebe NSW 2037 Australia voice: 61-2-9660-0850
checkout Vyper http://Vyper.sourceforge.net
download Interscript http://Interscript.sourceforge.net




^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-16 22:49 ` Gerd Stolpmann
@ 2000-02-18  9:36   ` Xavier Leroy
  2000-02-21 20:45     ` skaller
  2000-02-22  8:13     ` Sven LUTHER
  0 siblings, 2 replies; 12+ messages in thread
From: Xavier Leroy @ 2000-02-18  9:36 UTC (permalink / raw)
  To: Gerd.Stolpmann, Claude Marche, caml-list

Claude Marche asks:

>One idea could be distributing bytecode: is it true the any bytecode
>can be executed on any architecture and OS as soon as the right
>ocamlrun is used? (Even under non unix OSs like Microsoft-Windows or
>Mac-OS?) 

For MacOS, there are some problems with end-of-line being represented
by different control characters in MacOS and in Unix and Windows.  So,
newlines in program output are broken.

For MacOS and Windows, there is also the fact that file path names are
represented differently.  So, if your program manipulates file names,
even though the Filename module, the bytecode may not work well under
a different OS.

I think the easiest way to distribute an OCaml application is as
sources, plus binaries for a couple of popular architectures
(typically, Linux/Intel and Windows).  Novice users can pick the
binaries, and experienced users should have no problems installing
OCaml for compiling your application.

Gerd Stolpmann wrote:
> My suggestion: Every modern operating system can link libraries dynamically.
> This is also possible for the parts of the OCaml libraries written in C
> which need to be available in the runtime system.

Right, I have been considering dynamic loading of C libraries as an
alternative to -custom.  This would allow, among other benefits,
dynamic loading of Caml libraries that contain some C code.

There are some portability issues with old or exotic versions of Unix,
but I think it can be made to work under, say, Linux, Solaris,
Digital/Tru64 Unix, and Windows.  There are some issues still to be
resolved, however, such as how to build shared C libraries in a
portable fashion, perhaps by using the GNU libtool package.

> - Only libraries needed for the application are loaded into memory;
>   the memory footprints become much smaller

Yes and no, because static linking under C is able to remove members
of the .a archive that are not referenced, while dynamic loading
typically loads everything.  But memory footprint of code is not much
of an issue these days.

- Xavier Leroy



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-16 14:08   ` Claude Marche
  2000-02-16 14:28     ` Jean-Francois Monin
@ 2000-02-18  9:18     ` Patrick Goldbronn - SYSCO
  1 sibling, 0 replies; 12+ messages in thread
From: Patrick Goldbronn - SYSCO @ 2000-02-18  9:18 UTC (permalink / raw)
  To: Inria, caml; +Cc: Claude Marche

Claude Marche wrote:
> >>>>> "Jean-Francois" == Jean-Francois Monin <JeanFrancois.Monin@cnet.francetelecom.fr> writes:
> 
>     >> Mon but est de pouvoir distribuer le plus largement possible
>     >> une application écrite en Ocaml, en évitant des remarques du
>     >> genre « cette application m'intéresse mais je ne peux pas
>     >> compiler le Ocaml et vous ne fournissez pas un binaire adapté à
>     >> ma configuration »
> 
>     Jean-Francois> Tiens, cela arrive qu'on ne puisse pas compiler les
>     Jean-Francois> sources de Ocaml ?  Peut-être sur une config très
>     Jean-Francois> exotique ?  De plus on trouve facilement des .deb
>     Jean-Francois> et .rpm tout prêts (sans compter les binaires pour
>     Jean-Francois> Wxx), ce qui assure, me semble-t-il, une bonne
>     Jean-Francois> couverture actuellement.
> 
> Le piege c'est que quand un utilisateur dit « je ne peux pas
> compiler le Ocaml » il veut dire qu'il ne peut pas compiler des
> fichiers .ml, et soit il ne s'est pas rendu compte qu'il lui fallait
> installer le compilateur, soit il s'en est rendu compte et a décidé de
> ne pas le faire en pensant que ce sera la galere. On ne peut pas
> savoir que ocaml est facile a installer tant qu'on ne l'a pas fait !
> 

C'est encore plus vrai si l'utilisateur potentiel est de mauvaise fois :
toutes les excuses sont bonnes pour ne pas utiliser un produit, meme
s'il a été fait pour lui s'il a décidé de ne pas entendre parlé de ocaml
(meme s'il n'a pas regardé ;-( .



>     >> My goal is be able to distribute as widely as possible an
>     >> application written in Ocaml, avoiding remarks like ``I'm
>     >> interested in this application but I cannot compile Ocaml
>     >> sources, and you do not offer a suitable binary for my
>     >> configuration »,
> 
>     Jean-Francois> I didn't imagine that Ocaml compiling sources could
>     Jean-Francois> be difficult excepted, may be, on exotic
>     Jean-Francois> architectures. Then why care ?
> 
> How do you say "Le client est roi" in english ?
> 

"Customers are kings", aren't they ?

-- 
#####################################
# Patrick GOLDBRONN                 #
# CEA - DRN/DMT/SYSCO               #
# CE-Saclay, Bâtiment 460           #
# 91191 GIF/YVETTE CEDEX (FRANCE)   #
#                                   #
# Tél : 01 69 08 73 55              #
# Fax : 01 69 08 96 96              #
#####################################



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-15 13:01 Claude Marche
  2000-02-16 13:09 ` Jean-Francois Monin
  2000-02-16 22:49 ` Gerd Stolpmann
@ 2000-02-17  8:05 ` skaller
  2 siblings, 0 replies; 12+ messages in thread
From: skaller @ 2000-02-17  8:05 UTC (permalink / raw)
  To: Claude Marche; +Cc: caml-list

Claude Marche wrote:
> Pour résumer mon propos, voici donc les questions que je me pose :
[]
> another application doing the same thing but easier to install.

 
> If this is technically feasible, I would like to know people who are
> interested in using this for distribution of their own application in
> bytecode form. 

> Any comments, remarks and suggestions will be welcome. My goal is be
> able to distribute as widely as possible an application written in
> Ocaml, avoiding remarks like ``I'm interested in this application but
> I cannot compile Ocaml sources, and you do not offer a suitable binary
> for my configuration », and I would be glad to hear any suggestion for
> achieving this goal.

I believe one fundamental obstacle to configuring ocaml is the lack of
dynamic loading.
Ideally, it should be possible for ocamlopt to build 'extensions' to the
bytecode
interpreter, efficively doing '-custom' linkage at load time.

The reason this is necessary is that if you have multiple ocaml
applications,
you may not want a special 'run time' for each one: each application
might
use the core, and a single separate extension module. 

I have no idea how to implement this. However, one of the things that
you can do -- albiet clumbsily -- in python, is generate C code,
run the compiler, and then load the resulting shared library as a python
extension module.

-- 
John (Max) Skaller, mailto:skaller@maxtal.com.au
10/1 Toxteth Rd Glebe NSW 2037 Australia voice: 61-2-9660-0850
homepage: http://www.maxtal.com.au/~skaller
download: ftp://ftp.cs.usyd.edu/au/jskaller



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-15 13:01 Claude Marche
  2000-02-16 13:09 ` Jean-Francois Monin
@ 2000-02-16 22:49 ` Gerd Stolpmann
  2000-02-18  9:36   ` Xavier Leroy
  2000-02-17  8:05 ` skaller
  2 siblings, 1 reply; 12+ messages in thread
From: Gerd Stolpmann @ 2000-02-16 22:49 UTC (permalink / raw)
  To: Claude Marche, caml-list

On Tue, 15 Feb 2000, Claude Marche wrote:

>One idea could be distributing bytecode: is it true the any bytecode
>can be executed on any architecture and OS as soon as the right
>ocamlrun is used? (Even under non unix OSs like Microsoft-Windows or
>Mac-OS?) 

As far as I know: Yes. I did it already, and it worked even for systems
with different endianess. But I did it only for Unixes.

>If yes, anyone interested in using the application would
>need only to install the suitable ocamlrun for its architecture/OS
>combination.  It would allow any potentially interested user to try
>the application, and in case he finds it suitable for its need, he
>would be motivated to install ocaml for compiling from the sources and
>getting a faster application.
>
>For this to work, a kind of archive of various versions of ocamlrun
>should exist somewhere on the web, allowing to choose the right
>architecture/OS, also the right ocaml version, the right libraries
>like libc 5 or 6 or glibc.

Good idea.

>Nevertheless, there is a problem for applications that use other
>libraries like unix, str, nums, threads, that need to be compiled in
>-custom mode. If I understand well, binaries compiled with -custom
>contain the native code of the interpreter itself, so are not portable
>anymore. Techically speaking, is it possible to build an ocamlrun
>interpreter that contains those libraries statically linked?

This is possible by using the -make-runtime option.

But: This is not the best solution, as the number of libraries is growing,
and every time a new library (even a new version) would be needed by an
application, also new bytecode interpreters for all platforms would be
necessary. With two consequences:

1) The interpreters become very large, and there will be certainly people
   saying that OCaml is a big fat all-memory-eating language

2) The interpreters for platforms which are not everybody's darling will
   rapidly become too old to execute many applications.

My suggestion: Every modern operating system can link libraries dynamically.
This is also possible for the parts of the OCaml libraries written in C
which need to be available in the runtime system. The runtime system consists
of three parts:

1) The bytecode interpreter
2) The additional C-libraries
3) A startup routine which initializes the interpreter and configures the
   additional primitives available by 2)

There are no problems with parts 1 and 2 and dynamic libraries. Unfortunately,
part 3 is a generated C function, i.e. a different version is needed for every
combination of C-libraries. If we want dynamic libraries part 3 must be
replaced by a configurable dynamic loader. This is not too difficult, I think
I can write one (at least for Unix); the task of the dynamic loader is 
reading the list of necessary primitives from the bytecode file, loading the
associated libraries, and setting up the table that maps the primitives to
object-code symbols.

If this is done, we can link part 1 and the new loader that replaces part 3 to
the new, generic main executable which is able to run EVERY application for
which the necessary dynamic libraries are available.

So:

- For every platform, we need only one generic bytecode interpreter and one
  set of shared libraries

- Only libraries needed for the application are loaded into memory; the memory
  footprints become much smaller

- If new libraries are available, it is possible to compile them independently
  of the other libraries

- Multiple versions of the same library can easily be supported.

- It is often not necessary to recompile the libraries if a new version
  of the OCaml interpreter is available (at least if symbol-level 
  compatibility is given; the C FFI did not change often in the past).

>If this is technically feasible, I would like to know people who are
>interested in using this for distribution of their own application in
>bytecode form. Moreover, for building this archive of ocamlrun
>binaries, many people are needed to cover a wide range of
>architecture/OS combinations. I have access myself to PCs under Linux
>(Redhat distribution) and SPARC/Solaris 2.7, that's all.

Interested. I have some Web applications, and some TK applications.

I can offer 
 - Linux with libc5
 - Linux with glibc6.0
 - Linux with glibc6.1
   (Yes, I had problems to run OCaml applications compiled for glibc6.0 under
    glibc6.1!)
 - FreeBSD 3.3
 - Solaris 2.6
 - AIX 4.2

Gerd
-- 
----------------------------------------------------------------------------
Gerd Stolpmann      Telefon: +49 6151 997705 (privat)
Viktoriastr. 100             
64293 Darmstadt     EMail:   Gerd.Stolpmann@darmstadt.netsurf.de (privat)
Germany                     
----------------------------------------------------------------------------



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-16 14:08   ` Claude Marche
@ 2000-02-16 14:28     ` Jean-Francois Monin
  2000-02-18  9:18     ` Patrick Goldbronn - SYSCO
  1 sibling, 0 replies; 12+ messages in thread
From: Jean-Francois Monin @ 2000-02-16 14:28 UTC (permalink / raw)
  To: Claude Marche; +Cc: caml-list

> On ne peut pas savoir que ocaml est facile a installer tant qu'on ne
> l'a pas fait !

C'est juste. Il faudrait mettre dans la license Ocaml :
"Tout logiciel diffusé sous forme de sources Ocaml doit
préciser en grosses lettres que Ocaml est facile a installer" :-)

  JF



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-16 13:09 ` Jean-Francois Monin
@ 2000-02-16 14:08   ` Claude Marche
  2000-02-16 14:28     ` Jean-Francois Monin
  2000-02-18  9:18     ` Patrick Goldbronn - SYSCO
  0 siblings, 2 replies; 12+ messages in thread
From: Claude Marche @ 2000-02-16 14:08 UTC (permalink / raw)
  To: Jean-Francois Monin; +Cc: caml-list


Je me répond en partie a moi-meme car je viens de découvrir l'option
-make-runtime de ocamlc, qui me semble repondre a ma demande, je n'ai
pas encore testé. Je répond aussi a Jean-Francois ci-dessous.

[English]

It seems that option -make-runtime of ocamlc may answer to my
problem. Not tested yet.

- Claude


>>>>> "Jean-Francois" == Jean-Francois Monin <JeanFrancois.Monin@cnet.francetelecom.fr> writes:

    >> Mon but est de pouvoir distribuer le plus largement possible
    >> une application écrite en Ocaml, en évitant des remarques du
    >> genre « cette application m'intéresse mais je ne peux pas
    >> compiler le Ocaml et vous ne fournissez pas un binaire adapté à
    >> ma configuration »

    Jean-Francois> Tiens, cela arrive qu'on ne puisse pas compiler les
    Jean-Francois> sources de Ocaml ?  Peut-être sur une config très
    Jean-Francois> exotique ?  De plus on trouve facilement des .deb
    Jean-Francois> et .rpm tout prêts (sans compter les binaires pour
    Jean-Francois> Wxx), ce qui assure, me semble-t-il, une bonne
    Jean-Francois> couverture actuellement.

Le piege c'est que quand un utilisateur dit « je ne peux pas
compiler le Ocaml » il veut dire qu'il ne peut pas compiler des
fichiers .ml, et soit il ne s'est pas rendu compte qu'il lui fallait
installer le compilateur, soit il s'en est rendu compte et a décidé de
ne pas le faire en pensant que ce sera la galere. On ne peut pas
savoir que ocaml est facile a installer tant qu'on ne l'a pas fait !

    >> My goal is be able to distribute as widely as possible an
    >> application written in Ocaml, avoiding remarks like ``I'm
    >> interested in this application but I cannot compile Ocaml
    >> sources, and you do not offer a suitable binary for my
    >> configuration »,

    Jean-Francois> I didn't imagine that Ocaml compiling sources could
    Jean-Francois> be difficult excepted, may be, on exotic
    Jean-Francois> architectures. Then why care ?

How do you say "Le client est roi" in english ?




-- 
| Claude Marché           | mailto:Claude.Marche@lri.fr |
| LRI - Bât. 490          | http://www.lri.fr/~marche/  |
| Université de Paris-Sud | phoneto: +33 1 69 15 64 85  |
| F-91405 ORSAY Cedex     | faxto: +33 1 69 15 65 86    |



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: Portability of applications written in OCAML
  2000-02-15 13:01 Claude Marche
@ 2000-02-16 13:09 ` Jean-Francois Monin
  2000-02-16 14:08   ` Claude Marche
  2000-02-16 22:49 ` Gerd Stolpmann
  2000-02-17  8:05 ` skaller
  2 siblings, 1 reply; 12+ messages in thread
From: Jean-Francois Monin @ 2000-02-16 13:09 UTC (permalink / raw)
  To: Claude Marche; +Cc: caml-list

> Mon but est de pouvoir distribuer le plus largement possible une
> application écrite en Ocaml, en évitant des remarques du genre «cette
> application m'intéresse mais je ne peux pas compiler le Ocaml et vous
> ne fournissez pas un binaire adapté à ma configuration»

Tiens, cela arrive qu'on ne puisse pas compiler les sources de Ocaml ?
Peut-être sur une config très exotique ?  De plus on trouve
facilement des .deb et .rpm tout prêts (sans compter les binaires pour
Wxx), ce qui assure, me semble-t-il, une bonne couverture actuellement.

> My goal is be able to distribute as widely as possible an application
> written in Ocaml, avoiding remarks like ``I'm interested in this
> application but I cannot compile Ocaml sources, and you do not offer
> a suitable binary for my configuration'',

I didn't imagine that Ocaml compiling sources could be difficult
excepted, may be, on exotic architectures. Then why care ?

  Jean-Francois





^ permalink raw reply	[flat|nested] 12+ messages in thread

* Portability of applications written in OCAML
@ 2000-02-15 13:01 Claude Marche
  2000-02-16 13:09 ` Jean-Francois Monin
                   ` (2 more replies)
  0 siblings, 3 replies; 12+ messages in thread
From: Claude Marche @ 2000-02-15 13:01 UTC (permalink / raw)
  To: caml-list


Bonjour,

[long message, english translation follows]

J'ai des remarques et des questions à propos de la façon dont on peut
distribuer une application écrite en Objective CAML, et sur la
portabilité à laquelle on peut s'attendre.

Voici mon problème : supposons que l'on ait programmé une application
en ocaml, que l'on a envie de distribuer (gratuitement) sur le
Web, comment doit-on procéder pour la distribuer ? Supposons que cette
application n'ait en elle-meme rien à voir avec CAML, et que l'on
souhaite atteindre un public qui a priori ne connait pas ce langage,
et ne dispose pas du compilateur ni de l'interpréteur.

Pour distribuer, on peut proposer a priori les sources, et aussi des
exécutables (compilés avec ocamlopt pour que ça aille
vite). Proposer les sources pose un problème car une personne
intéressée par cette application devra au préalable installer ocaml
sur son ordinateur, et cela rebuterait je pense une grande partie des
personnes intéressées au départ. Proposer des binaires contourne ce
problème mais on entre dans de multiples problemes de configuration,
car l'exécutable ne pourra fonctionner que sur la bonne architecture,
avec la bonne version du bon OS, sans oublier les problèmes de
versions de bibliothèques dynamiques (curses/ncurses, libc/glibc,
etc.) 

Le juste milieu me semble être d'utiliser le bytecode : Est-ce que
c'est vrai qu'il est possible d'executer n'importe quel bytecode sur
n'importe quel archi et OS à partir du moment où on a le ocamlrun
approprié pour cette architecture et cet OS ? (Meme sous des OS non
unix comme Microsoft-Windows ou Mac-OS ?) Si oui, un utilisateur
potentiel de l'application n'aurait pas besoin d'installer tout ocaml
mais seulement une version de ocamlrun appropriée pour sa combinaison
architecture/OS. Cela permettrait a cet utilisateur potentiel de
facilement essayer l'application qui l'interesse, et s'il la trouve
utile pour lui, il sera alors motivé pour faire l'effort d'installer
ocaml pour compiler une version en code natif de cette application
pour son archi et son OS.

Pour que cela fonctionne, il faudrait qu'il existe quelque part sur le
Web une sorte d'archive de versions de ocamlrun, permettant de choisir
son architecture, son OS, la version ocaml requise, peut-etre aussi
certaines variantes de bibliotheques comme libc 5 ou 6, glibc.

Je pense qu'il y a potentiellement un nombre non negligeable
d'applications concernées, il suffit de se promener un peu sur la «
bosse » : HeVeA, GeneWeb, Bibtex2html, et bien d'autres.

Il y a néanmoins un problème ennuyeux: dès qu'une application devient
un peu conséquente, il arrive que l'on commence à utiliser des
bibliothèques comme unix, str, nums, threads, qui nécessitent une
compilation en -custom. Si j'ai bien compris, les binaires obtenus
contiennent le code natif de l'interpréteur de bytecode lui-même, et
ne sont plus portables. Est-il techniquement possible de changer cela
en utilisant un ocamlrun linké avec ces bibliothèques ?

Pour résumer mon propos, voici donc les questions que je me pose :

1) Un fichier de bytecode est-il exécutable par ocamlrun sur n'importe
   quelle combinaison d'une architecture et d'un OS ? Y compris OS non
   unix ?

2) Est-il possible de fabriquer des versions d'ocamlrun contenant en
   plus des bibliothèques linkées habituellement avec -custom : unix,
   str, nums, threads ; et par conséquent pourraient exécuter des
   bytecode portables utilisant ces bibliotheques ?

Si ceci est techniquement faisable, cela m'intéresserait de connaitre
les personnes intéressées par l'utiliser, pour distribuer leur propre
application sous forme de bytecode portable. De plus, pour constituer
cette archive de binaires ocamlrun, il faudrait la participation du
plus grand nombre de personnes possible afin de couvrir largement les
combinaisons d'architectures et d'OS. Personnellement j'ai accès à des
PC sous Linux (Distribution Redhat en général) et des SPARC sous
Solaris 2.7, mais c'est tout.

Toutes remarques, toutes suggestions et tous commentaires sont les
bienvenus. Mon but est de pouvoir distribuer le plus largement
possible une application écrite en Ocaml, en évitant des remarques du
genre « cette application m'intéresse mais je ne peux pas compiler le
Ocaml et vous ne fournissez pas un binaire adapté à ma configuration
», et je serais heureux d'entendre toute suggestion permettant
d'atteindre ce but.

[English translation]

I have a few remarks and questions about how one may distribute an
application written in Objective CAML, and how much portability one
may expect.

Here is my problem: suppose one has written an application in ocaml,
and wants to distribute it (freely) on the Web, how should he proceed?
Suppose that the application itself has nothing to do with CAML, and
one wants to reach people that do not know a priori this langage, so
do not have caml installed on their computer.

Distribution could be achieve by making the source files available,
and also some binary executables (compiled with ocamlopt for
efficiency). Installing from source is not nice because anyone
interested must first install ocaml on his computer, and I think that
many people in that case would not do it, and will better try to find
another application doing the same thing but easier to install.
Distributing binaries is not nice also, because one may encounter many
configuration problems, the program will run only for the right
architecture, the right version of the right OS, not to mention
problems with versions of dynamic libraries (curses/ncurses,
libc/glibc, etc.)

One idea could be distributing bytecode: is it true the any bytecode
can be executed on any architecture and OS as soon as the right
ocamlrun is used? (Even under non unix OSs like Microsoft-Windows or
Mac-OS?) If yes, anyone interested in using the application would
need only to install the suitable ocamlrun for its architecture/OS
combination.  It would allow any potentially interested user to try
the application, and in case he finds it suitable for its need, he
would be motivated to install ocaml for compiling from the sources and
getting a faster application.

For this to work, a kind of archive of various versions of ocamlrun
should exist somewhere on the web, allowing to choose the right
architecture/OS, also the right ocaml version, the right libraries
like libc 5 or 6 or glibc.

I think there is a significant number of applications that could be
interested in being distributed like this, like the ones that are on
the ``hump'': HeVeA, GeneWeb, Bibtex2html, and many others.

Nevertheless, there is a problem for applications that use other
libraries like unix, str, nums, threads, that need to be compiled in
-custom mode. If I understand well, binaries compiled with -custom
contain the native code of the interpreter itself, so are not portable
anymore. Techically speaking, is it possible to build an ocamlrun
interpreter that contains those libraries statically linked?

So to conclude, I would like to know two things:

1) Can a bytecode file be run using any ocamlrun version, on any
   combination of architecture and OS? Even a non-unix OS?

2) Is it possible to build an ocamlrun interpreter containing also
   some librairies usually linked with -custom: unix, str, nums,
   threads ; hence being able to run portable bytecode files using
   such libraries ? 

If this is technically feasible, I would like to know people who are
interested in using this for distribution of their own application in
bytecode form. Moreover, for building this archive of ocamlrun
binaries, many people are needed to cover a wide range of
architecture/OS combinations. I have access myself to PCs under Linux
(Redhat distribution) and SPARC/Solaris 2.7, that's all.

Any comments, remarks and suggestions will be welcome. My goal is be
able to distribute as widely as possible an application written in
Ocaml, avoiding remarks like ``I'm interested in this application but
I cannot compile Ocaml sources, and you do not offer a suitable binary
for my configuration », and I would be glad to hear any suggestion for
achieving this goal.

- Claude



-- 
| Claude Marché           | mailto:Claude.Marche@lri.fr |
| LRI - Bât. 490          | http://www.lri.fr/~marche/  |
| Université de Paris-Sud | phoneto: +33 1 69 15 64 85  |
| F-91405 ORSAY Cedex     | faxto: +33 1 69 15 65 86    |



^ permalink raw reply	[flat|nested] 12+ messages in thread

end of thread, other threads:[~2000-02-24 17:43 UTC | newest]

Thread overview: 12+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2000-02-21 19:02 Portability of applications written in OCAML Don Syme
  -- strict thread matches above, loose matches on Subject: below --
2000-02-15 13:01 Claude Marche
2000-02-16 13:09 ` Jean-Francois Monin
2000-02-16 14:08   ` Claude Marche
2000-02-16 14:28     ` Jean-Francois Monin
2000-02-18  9:18     ` Patrick Goldbronn - SYSCO
2000-02-16 22:49 ` Gerd Stolpmann
2000-02-18  9:36   ` Xavier Leroy
2000-02-21 20:45     ` skaller
2000-02-22  8:13     ` Sven LUTHER
2000-02-22  9:21       ` Xavier Leroy
2000-02-17  8:05 ` skaller

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).