Re: [Caml-list] Create Array of floats from string

[Jon Kleiser <jon.kleiser@ceres.no>]

In case anybody wants to take a look, I have put my two program versions, the fast one and the slow one, here:

<http://folk.uio.no/jkleiser/ocaml/read_vec.ml>
<http://folk.uio.no/jkleiser/ocaml/scan_vec.ml>

The fast one, which uses ‘String.split_on_char’ and ‘List.iteri’, reads a 1.35 GB file in about 18 secs on my Mac, while the slower one, which uses ‘Scanf.bscanf’, reads the same file in about 43 secs.

If I have made some stupid things that makes the slower one so slow, than I’d be glad to hear how to fix it, just to learn a bit more OCaml.

The file that I use as input, is the wiki.no.vec that you can find here:
<https://s3-us-west-1.amazonaws.com/fasttext-vectors/wiki.no.vec>

If you would like to play with other files in the same format, you find them here:
<https://github.com/facebookresearch/fastText/blob/master/pretrained-vectors.md>

/Jon