Utilizing more than 4GB of memory in caml?

Utilizing more than 4GB of memory in caml?

[Koprowski, A.]

[-- Attachment #1: Type: text/plain, Size: 761 bytes --]

    Hello,

 I have a 32-bit linux machine with 48-bit addressing of its 128GB of
RAM. I'd very much like to use this amount of memory; however I get
Out_of_memory exception after ocaml consumes 4GB. Is there anything I
can do to get my hands on more than 4GB?
  Thanks a lot in advance!

   Greetings,

   Adam

 

--

========================================================================

 Adam Koprowski, (A.Koprowski@tue.nl, http://www.win.tue.nl/~akoprows)

 Department of Mathematics and Computer Science

 Eindhoven University of Technology (TU/e)

 The difference between impossible and possible lies in determination

      Tommy Lasorda 

========================================================================

 


[-- Attachment #2: Type: text/html, Size: 5984 bytes --]

Re: [Caml-list] Utilizing more than 4GB of memory in caml?

[Lionel Elie Mamane]

On Tue, Aug 14, 2007 at 04:16:14PM +0200, Koprowski, A. wrote:

>  I have a 32-bit linux machine with 48-bit addressing of its 128GB of
> RAM. I'd very much like to use this amount of memory; however I get
> Out_of_memory exception after ocaml consumes 4GB. Is there anything I
> can do to get my hands on more than 4GB?

Run a 64 bit GNU/Linux on that machine, either as the master system or
in a chroot (requires the master system to boot on a 64 bit kernel) or
a virtualised machine.

-- 
Lionel

Re: [Caml-list] Utilizing more than 4GB of memory in caml?

[Lionel Elie Mamane]

On Tue, Aug 14, 2007 at 04:36:27PM +0200, Koprowski, A. wrote:

>> -----Original Message-----
>> From: Lionel Elie Mamane [mailto:lionel@mamane.lu]

>> On Tue, Aug 14, 2007 at 04:16:14PM +0200, Koprowski, A. wrote:

>>>  I have a 32-bit linux machine with 48-bit addressing of its 128GB
>>>  of RAM. I'd very much like to use this amount of memory; however
>>>  I get Out_of_memory exception after ocaml consumes 4GB. Is there
>>>  anything can do to get my hands on more than 

>> Run a 64 bit GNU/Linux on that machine, (...)

>   Thanks for the suggestion but I'm afraid I cannot do that. This is
> a faculty server to which I only have a user access.

Type:
 uname -m
in a shell. If the answer is x86_64, there are things you can do. If
it says i386, i486 or i686, all you can do is complain to the system
administrator (if you are in informatica, I presume that would be bcf
in room HG 8.73 - 8th floor of Hoofdgebouw; is the machine by any
chance elephant?).


In case of x86_64: How much manual hacking are you willing to do?

The 32 bit GNU/Linux installation installed may be a mixed 32/64
installation. Look whether it contains /lib64/ld-linux-x86-64.so.2 or
/lib/ld-linux-x86-64.so.2 or /usr/lib/ld-linux-x86-64.so.2 or
/usr/lib64/ld-linux-x86-64.so.2 . If it does, look for
/lib64/libc.so.6 or /usr/lib64/libc.so.6 . Their presence means you
can _run_ 64 bit binaries.

Then, see whether the gcc installed can produce 64 binaries (option
-m64).

If both of these tests are positive, you can compile a 64 bit OCaml
(force OCaml's make system to use the -m64 option to gcc and force it
to produce OCaml compilers for the x86_64 architecture instead of
i386; details of how to do that left for you to find out) and run it.

If these tests are negative (or one of them is), you can:

 - if the gcc cannot build 64 bit binaries, compile a gcc that can
   (http://gcc.gnu.org/) and install it in your home.

 - if there is no 64 bit libc installed, compile it and install it in
   your home. You may have to set LD_LIBRARY_PATH and/or execute your
   64 bit binaries with "$HOME/usr/lib/ld-linux-x86-64.so.2
   EXECUTABLE" instead of with "EXECUTABLE".

Again, details left for you to discover.

-- 
Lionel

Re: [Caml-list] Utilizing more than 4GB of memory in caml?

[Richard Jones]

On Tue, Aug 14, 2007 at 06:17:41PM +0200, Lionel Elie Mamane wrote:
> On Tue, Aug 14, 2007 at 04:36:27PM +0200, Koprowski, A. wrote:
> 
> >> -----Original Message-----
> >> From: Lionel Elie Mamane [mailto:lionel@mamane.lu]
> 
> >> On Tue, Aug 14, 2007 at 04:16:14PM +0200, Koprowski, A. wrote:
> 
> >>>  I have a 32-bit linux machine with 48-bit addressing of its 128GB
> >>>  of RAM. I'd very much like to use this amount of memory; however
> >>>  I get Out_of_memory exception after ocaml consumes 4GB. Is there
> >>>  anything can do to get my hands on more than 
> 
> >> Run a 64 bit GNU/Linux on that machine, (...)
> 
> >   Thanks for the suggestion but I'm afraid I cannot do that. This is
> > a faculty server to which I only have a user access.
> 
> Type:
>  uname -m
> in a shell. If the answer is x86_64, there are things you can do. If
> it says i386, i486 or i686, all you can do is complain to the system
> administrator (if you are in informatica, I presume that would be bcf
> in room HG 8.73 - 8th floor of Hoofdgebouw; is the machine by any
> chance elephant?).
> 
> In case of x86_64: How much manual hacking are you willing to do?

Is this machine really x86-based?  32-bit x86 machines have at most
36-bit addresses (through PAE), although that is only usable through
page tables, not to ordinary user processes.  64-bit x86-64 machines
have 48-bit addressing in current incarnations so if they are running
a 32-bit kernel or a 32-bit Xen domain they may fit the description,
but the original poster is still s.o.l.  My bet though is it's not x86
at all.

Rich.

-- 
Richard Jones
Red Hat

RE: [Caml-list] Utilizing more than 4GB of memory in caml?

[Koprowski, A.]

  Dear Lionel,
 Thank you so much for your detailed instructions and help! And indeed you are completely right, it's not a x86, I don't know what led me to believe it was. And yes, we are talking about elephant here :-). All in all, thank you so much for your time and help. I'll try to apply your hints tomorrow and see whether I can get a 64-bit ocaml application up and running.

  Best wishes,
   Adam

-----Original Message-----
From: Richard Jones [mailto:rich@annexia.org]
Sent: Tue 8/14/2007 18:25
To: Lionel Elie Mamane; Koprowski, A.; caml-list@yquem.inria.fr
Subject: Re: [Caml-list] Utilizing more than 4GB of memory in caml?
 
On Tue, Aug 14, 2007 at 06:17:41PM +0200, Lionel Elie Mamane wrote:
> On Tue, Aug 14, 2007 at 04:36:27PM +0200, Koprowski, A. wrote:
> 
> >> -----Original Message-----
> >> From: Lionel Elie Mamane [mailto:lionel@mamane.lu]
> 
> >> On Tue, Aug 14, 2007 at 04:16:14PM +0200, Koprowski, A. wrote:
> 
> >>>  I have a 32-bit linux machine with 48-bit addressing of its 128GB
> >>>  of RAM. I'd very much like to use this amount of memory; however
> >>>  I get Out_of_memory exception after ocaml consumes 4GB. Is there
> >>>  anything can do to get my hands on more than 
> 
> >> Run a 64 bit GNU/Linux on that machine, (...)
> 
> >   Thanks for the suggestion but I'm afraid I cannot do that. This is
> > a faculty server to which I only have a user access.
> 
> Type:
>  uname -m
> in a shell. If the answer is x86_64, there are things you can do. If
> it says i386, i486 or i686, all you can do is complain to the system
> administrator (if you are in informatica, I presume that would be bcf
> in room HG 8.73 - 8th floor of Hoofdgebouw; is the machine by any
> chance elephant?).
> 
> In case of x86_64: How much manual hacking are you willing to do?

Is this machine really x86-based?  32-bit x86 machines have at most
36-bit addresses (through PAE), although that is only usable through
page tables, not to ordinary user processes.  64-bit x86-64 machines
have 48-bit addressing in current incarnations so if they are running
a 32-bit kernel or a 32-bit Xen domain they may fit the description,
but the original poster is still s.o.l.  My bet though is it's not x86
at all.

Rich.

-- 
Richard Jones
Red Hat

Re: [Caml-list] Utilizing more than 4GB of memory in caml?

[Lionel Elie Mamane]

On Tue, Aug 14, 2007 at 06:28:38PM +0200, Koprowski, A. wrote:

>  Thank you so much for your detailed instructions and help! And
>  indeed you are completely right, it's not a x86, I don't know what
>  led me to believe it was.

Oh, now you got me all curious. What architecture is it then? Sparc,
maybe? I had assumed it was an amd64/x86-64 and that the GNU/Linux
installed on it was a 32 bit one. Make me drool a bit, show me
/proc/cpuinfo .

Ah yes, it makes sense now. Contrary to amd64, as far as I know most
GNU/Linux sparc64 installations have a 32 bit userland, but 64 bit
kernel, libraries and compilers ready for programs that benefit from
it.

> -----Original Message-----
> From: Richard Jones [mailto:rich@annexia.org]
> Sent: Tue 8/14/2007 18:25
> To: Lionel Elie Mamane; Koprowski, A.; caml-list@yquem.inria.fr
> Subject: Re: [Caml-list] Utilizing more than 4GB of memory in caml?
>  
> On Tue, Aug 14, 2007 at 06:17:41PM +0200, Lionel Elie Mamane wrote:
> > On Tue, Aug 14, 2007 at 04:36:27PM +0200, Koprowski, A. wrote:
> > 
> > >> -----Original Message-----
> > >> From: Lionel Elie Mamane [mailto:lionel@mamane.lu]
> > 
> > >> On Tue, Aug 14, 2007 at 04:16:14PM +0200, Koprowski, A. wrote:
> > 
> > >>>  I have a 32-bit linux machine with 48-bit addressing of its 128GB
> > >>>  of RAM. I'd very much like to use this amount of memory; however
> > >>>  I get Out_of_memory exception after ocaml consumes 4GB. Is there
> > >>>  anything can do to get my hands on more than 
> > 
> > >> Run a 64 bit GNU/Linux on that machine, (...)
> > 
> > >   Thanks for the suggestion but I'm afraid I cannot do that. This is
> > > a faculty server to which I only have a user access.
> > 
> > Type:
> >  uname -m
> > in a shell. If the answer is x86_64, there are things you can do. If
> > it says i386, i486 or i686, all you can do is complain to the system
> > administrator (if you are in informatica, I presume that would be bcf
> > in room HG 8.73 - 8th floor of Hoofdgebouw; is the machine by any
> > chance elephant?).
> > 
> > In case of x86_64: How much manual hacking are you willing to do?
> 
> Is this machine really x86-based?  32-bit x86 machines have at most
> 36-bit addresses (through PAE), although that is only usable through
> page tables, not to ordinary user processes.  64-bit x86-64 machines
> have 48-bit addressing in current incarnations so if they are running
> a 32-bit kernel or a 32-bit Xen domain they may fit the description,
> but the original poster is still s.o.l.  My bet though is it's not x86
> at all.
> 
> Rich.
> 

Re: [Caml-list] Utilizing more than 4GB of memory in caml?

[skaller]

On Tue, 2007-08-14 at 18:53 +0200, Lionel Elie Mamane wrote:
> On Tue, Aug 14, 2007 at 06:28:38PM +0200, Koprowski, A. wrote:
> 
> >  Thank you so much for your detailed instructions and help! And
> >  indeed you are completely right, it's not a x86, I don't know what
> >  led me to believe it was.
> 
> Oh, now you got me all curious. What architecture is it then? Sparc,
> maybe? 

My bets on the Elephant are to "DEC Alpha"


-- 
John Skaller <skaller at users dot sf dot net>
Felix, successor to C++: http://felix.sf.net

Re: [Caml-list] Utilizing more than 4GB of memory in caml?

[Lionel Elie Mamane]

On Wed, Aug 15, 2007 at 11:07:14AM +1000, skaller wrote:
> On Tue, 2007-08-14 at 18:53 +0200, Lionel Elie Mamane wrote:
>> On Tue, Aug 14, 2007 at 06:28:38PM +0200, Koprowski, A. wrote:

>>>  Thank you so much for your detailed instructions and help! And
>>>  indeed you are completely right, it's not a x86, I don't know what
>>>  led me to believe it was.

>> Oh, now you got me all curious. What architecture is it then? Sparc,
>> maybe?

> My bets on the Elephant are to "DEC Alpha"

Adam confirmed (by emailing me the /proc/cpuinfo) that it is an
amd64/x86-64 machine. So it is x86 after all :)

-- 
Lionel