* [ISSUE] Feature request: parallel package building
@ 2021-02-12 22:21 RossComputerGuy
2021-02-12 22:45 ` ericonr
` (4 more replies)
0 siblings, 5 replies; 6+ messages in thread
From: RossComputerGuy @ 2021-02-12 22:21 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 600 bytes --]
New issue by RossComputerGuy on void-packages repository
https://github.com/void-linux/void-packages/issues/28711
Description:
I've noticed `xbps-src` has no parallel package building. I think it would be beneficial to support a method to build packages in parallel instead of sequentially. This with parallel compiling and distcc could bring compile times down by a lot on large packages when multiple packages are rebuilt. Maybe a `-pJ` flag (package-jobs) would set how many packages to build at once. Since `xbps-src` is written as a shell script, there's most likely a way to figure this out.
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: Feature request: parallel package building
2021-02-12 22:21 [ISSUE] Feature request: parallel package building RossComputerGuy
@ 2021-02-12 22:45 ` ericonr
2021-02-12 22:48 ` RossComputerGuy
` (3 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: ericonr @ 2021-02-12 22:45 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 610 bytes --]
New comment by ericonr on void-packages repository
https://github.com/void-linux/void-packages/issues/28711#issuecomment-778496685
Comment:
Sticking this inside xbps-src doesn't really make sense to me. There's a lot of complexity and decisions to take on how to build packages in parallel: overlays with the same masterdir or multiple masterdirs? How to control/monitor all the jobs? And others.
Imo, writing something that can drive xbps-src is more feasible and more flexible. Could be an extension of xbulk or maybe (and probably better) something based on what already runs in the official builders.
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: Feature request: parallel package building
2021-02-12 22:21 [ISSUE] Feature request: parallel package building RossComputerGuy
2021-02-12 22:45 ` ericonr
@ 2021-02-12 22:48 ` RossComputerGuy
2021-02-12 22:48 ` the-maldridge
` (2 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: RossComputerGuy @ 2021-02-12 22:48 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 233 bytes --]
New comment by RossComputerGuy on void-packages repository
https://github.com/void-linux/void-packages/issues/28711#issuecomment-778498131
Comment:
I think implementing this into xbulk would be the best. Then the flag can be `-j`.
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: Feature request: parallel package building
2021-02-12 22:21 [ISSUE] Feature request: parallel package building RossComputerGuy
2021-02-12 22:45 ` ericonr
2021-02-12 22:48 ` RossComputerGuy
@ 2021-02-12 22:48 ` the-maldridge
2021-02-12 22:48 ` [ISSUE] [CLOSED] " the-maldridge
2021-02-12 22:51 ` RossComputerGuy
4 siblings, 0 replies; 6+ messages in thread
From: the-maldridge @ 2021-02-12 22:48 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 308 bytes --]
New comment by the-maldridge on void-packages repository
https://github.com/void-linux/void-packages/issues/28711#issuecomment-778498248
Comment:
xbulk can do this today, and other projects are focused on doing this on distributed fleets. Closing as out of scope but feel free to continue the discussion.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [ISSUE] [CLOSED] Feature request: parallel package building
2021-02-12 22:21 [ISSUE] Feature request: parallel package building RossComputerGuy
` (2 preceding siblings ...)
2021-02-12 22:48 ` the-maldridge
@ 2021-02-12 22:48 ` the-maldridge
2021-02-12 22:51 ` RossComputerGuy
4 siblings, 0 replies; 6+ messages in thread
From: the-maldridge @ 2021-02-12 22:48 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 603 bytes --]
Closed issue by RossComputerGuy on void-packages repository
https://github.com/void-linux/void-packages/issues/28711
Description:
I've noticed `xbps-src` has no parallel package building. I think it would be beneficial to support a method to build packages in parallel instead of sequentially. This with parallel compiling and distcc could bring compile times down by a lot on large packages when multiple packages are rebuilt. Maybe a `-pJ` flag (package-jobs) would set how many packages to build at once. Since `xbps-src` is written as a shell script, there's most likely a way to figure this out.
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: Feature request: parallel package building
2021-02-12 22:21 [ISSUE] Feature request: parallel package building RossComputerGuy
` (3 preceding siblings ...)
2021-02-12 22:48 ` [ISSUE] [CLOSED] " the-maldridge
@ 2021-02-12 22:51 ` RossComputerGuy
4 siblings, 0 replies; 6+ messages in thread
From: RossComputerGuy @ 2021-02-12 22:51 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 301 bytes --]
New comment by RossComputerGuy on void-packages repository
https://github.com/void-linux/void-packages/issues/28711#issuecomment-778499089
Comment:
I couldn't find other projects that does this with `xbps-src`, I don't know if they just don't exist or DuckDuckGo is having a hard time finding them.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2021-02-12 22:51 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-02-12 22:21 [ISSUE] Feature request: parallel package building RossComputerGuy
2021-02-12 22:45 ` ericonr
2021-02-12 22:48 ` RossComputerGuy
2021-02-12 22:48 ` the-maldridge
2021-02-12 22:48 ` [ISSUE] [CLOSED] " the-maldridge
2021-02-12 22:51 ` RossComputerGuy
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).