Re: [9fans] `mk` (from Plan9 ports) efficiency related issue

[Robert Raschke <rtrlists@googlemail.com>]

[-- Attachment #1: Type: text/plain, Size: 4254 bytes --]

Err, "Wow, a 4000 line mk file!"

On Mon, Jan 17, 2011 at 3:00 PM, Robert Raschke <rtrlists@googlemail.com>wrote:

> Terribly sorry, my email won't help you much, apart from going "Wow, a 4000
> link mk file!" and "Hmm, I wouldn't start from here if you want to go
> there." Your email also doesn't explain why you cannot generate a "normal"
> mk file.
>
> If you want to stick with your approach, it almost looks like you may be
> better off to generate a shell script that explicitly checks and runs
> everything you need. (And yes, essentially make your "generator" be a make
> in it's own right. Another one won't hurt.)
>
> But it's cool to see someone else who uses Erlang and RabbitMQ hanging out
> on this list. :-)
>
> Robby
>
>
> On Mon, Jan 17, 2011 at 2:47 PM, Ciprian Dorin Craciun <
> ciprian.craciun@gmail.com> wrote:
>
>>    Hello all!
>>
>>    Sorry for interrupting again, but I've stumbled on an `mk` issue...
>>
>>    I've written a little Scheme application that generates `mk`
>> scripts for building Erlang applications. (See below an extract of one
>> of my previous emails describing just the generator part; the thread
>> had the subject: <<mk (from plan9ports) modification time resolution
>> issue?>>.)
>>
>>    Now the problem is that the generated script (attached to this
>> email) has about 2671 prerequisites (` target :: prerequisite `), and
>> about 684 actual targets with recipes. (As I've explained below I'm
>> not using any meta-rules, and I'm explicit about each resulting file
>> and it's dependencies.)
>>
>>    The problem is that the time needed to run the script has
>> extremely increased, and the processor is 100% eaten by `mk`.
>>
>>    For example:
>>    * just running the `mk` script with the `-n` option takes about 14
>> seconds.
>>    * using the commands from the `mk -n` takes about 1 minute and 36
>> seconds;
>>    * then running `mk` takes another 14 seconds; (as it has nothing);
>>    * but after cleaning and running `mk` (which I've left running for
>> about 5 minutes and still didn't finished) it seems that between each
>> target (or batch of targets?) it stays about 14 seconds;
>>
>>    But what is strange is that if instead to build the default target
>> that builds everything I start building little by little independent
>> parts, it works without that great delay...
>>
>>    Any ideas what could cause this?
>>
>>    Thanks,
>>    Ciprian.
>>
>>
>> ----------
>> [[ Extract from the previous email. ]]
>> ----------
>>
>>   BTW... People might wonder how come I have 367 targets (with 1221
>> prerequisites) for such a small project? :) The answers is I don't
>> write the `mk` script by hand, but I've written a small Scheme
>> application that just generates the `mk` script based on descriptions
>> like the following. (Thus the resulting `mk` script is quite
>> exhaustive with quite tight dependencies and doesn't use
>> meta-rules...) :)
>>
>>   So just out of curiosity are there any `mk` script generators out there?
>>
>>   Ciprian.
>>
>>
>> ~~~~
>> (vbs:require-erlang)
>>
>> (vbs:define-erlang-application 'rabbit
>>       erl: "\\./(rabbitmq-server--latest/src|generated)/.*\\.erl"
>>       hrl: "\\./(rabbitmq-server--latest/include|generated)/.*\\.hrl"
>>       additional-ebin: "\\./generated/rabbit\\.app")
>>
>> (vbs:define-erlang-application 'rabbit_common
>>       erl:
>> "\\./(rabbitmq-server--latest/src|generated)/(rabbit_writer|rabbit_reader|rabbit_framing_amqp_0_8|rabbit_framing_amqp_0_9_1|rabbit_framing_channel|rabbit_basic|rabbit_binary_generator|rabbit_binary_parser|rabbit_channel|rabbit_exchange_type|rabbit_misc|rabbit_net|rabbit_heartbeat|rabbit_msg_store_index|gen_server2|priority_queue|supervisor2)\\.erl"
>>       hrl: "\\./(rabbitmq-server--latest/include|generated)/.*\\.hrl"
>>       additional-ebin: "\\./generated/rabbit_common\\.app")
>>
>> (vbs:define-erlang-application 'amqp_client
>>       dependencies: 'rabbit_common
>>       erl: "\\./rabbitmq-erlang-client--latest/src/.*\\.erl"
>>       hrl: "\\./rabbitmq-erlang-client--latest/include/.*\\.hrl"
>>       additional-ebin: "\\./generated/amqp_client\\.app")
>> ~~~~
>>
>
>

[-- Attachment #2: Type: text/html, Size: 5211 bytes --]