Github messages for voidlinux
 help / color / mirror / Atom feed
* [ISSUE] [Question] Hosting my own private mirror with only the packages I need
@ 2021-11-22 19:02 WilliamBehrens
  2021-11-22 20:53 ` HadetTheUndying
                   ` (8 more replies)
  0 siblings, 9 replies; 10+ messages in thread
From: WilliamBehrens @ 2021-11-22 19:02 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 1051 bytes --]

New issue by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205

Description:
I'm wanting to create my own custom mirror for void packages as I want to add a custom base-system and kernel but I don't think it would really be something to commit into the main void-packages repo. Something that I can't seem to find a direct answer too strangely is if it's possible to have multiple packages mirrors at once. So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
@ 2021-11-22 20:53 ` HadetTheUndying
  2021-11-22 21:19 ` WilliamBehrens
                   ` (7 subsequent siblings)
  8 siblings, 0 replies; 10+ messages in thread
From: HadetTheUndying @ 2021-11-22 20:53 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 330 bytes --]

New comment by HadetTheUndying on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975909262

Comment:
You could just clone the repo and build the packages locally? 

There's also documentation about what you're asking here:

https://docs.voidlinux.org/xbps/repositories/custom.html

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
  2021-11-22 20:53 ` HadetTheUndying
@ 2021-11-22 21:19 ` WilliamBehrens
  2021-11-22 21:23 ` HadetTheUndying
                   ` (6 subsequent siblings)
  8 siblings, 0 replies; 10+ messages in thread
From: WilliamBehrens @ 2021-11-22 21:19 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 220 bytes --]

New comment by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975928053

Comment:
Well the thing is I don't want to have to build everything from source

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
  2021-11-22 20:53 ` HadetTheUndying
  2021-11-22 21:19 ` WilliamBehrens
@ 2021-11-22 21:23 ` HadetTheUndying
  2021-11-22 21:29 ` WilliamBehrens
                   ` (5 subsequent siblings)
  8 siblings, 0 replies; 10+ messages in thread
From: HadetTheUndying @ 2021-11-22 21:23 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 516 bytes --]

New comment by HadetTheUndying on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975930824

Comment:
> Well the thing is I don't want to have to build everything from source

I'm not really sure what you want then? If you're hosting custom packages/patch sets or restricted packages on your own server for example they're still going to need to be built and signed. 

Like for example hosting on a VPS you would still have to build the packages for the custom repo. 

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
                   ` (2 preceding siblings ...)
  2021-11-22 21:23 ` HadetTheUndying
@ 2021-11-22 21:29 ` WilliamBehrens
  2021-11-22 23:01 ` Duncaen
                   ` (4 subsequent siblings)
  8 siblings, 0 replies; 10+ messages in thread
From: WilliamBehrens @ 2021-11-22 21:29 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 294 bytes --]

New comment by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975935922

Comment:
I mean I want to be able to pull down a pre-compiled version of a package from the main void mirrors to compile the custom packages on my mirror

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
                   ` (3 preceding siblings ...)
  2021-11-22 21:29 ` WilliamBehrens
@ 2021-11-22 23:01 ` Duncaen
  2021-11-22 23:09 ` Duncaen
                   ` (3 subsequent siblings)
  8 siblings, 0 replies; 10+ messages in thread
From: Duncaen @ 2021-11-22 23:01 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 266 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
                   ` (4 preceding siblings ...)
  2021-11-22 23:01 ` Duncaen
@ 2021-11-22 23:09 ` Duncaen
  2021-11-22 23:11 ` Duncaen
                   ` (2 subsequent siblings)
  8 siblings, 0 replies; 10+ messages in thread
From: Duncaen @ 2021-11-22 23:09 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 1715 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
TLDR: Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

>  So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

There is no such thing as a mirror in xbps, there are repositories and you can as many as you want.
But the first repository containing a package name is choosen to provide that package.
So adding your own repository prior to the official repo will choose the packages you have in your repo from your repo and the other packages from the official repo.

A mirror is a mirror, not half or incomplete, if the repository index advertises a package name then the package will be downloaded from that mirror.

Using a caching http proxy will cache packages you request so subsequent downloads of the package will come from the cache, by configuring that cache you can limit the cache size and how long a package will be retained, no additional administration or anything required, you don't have to maintain a list or cleanup old packages.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
                   ` (5 preceding siblings ...)
  2021-11-22 23:09 ` Duncaen
@ 2021-11-22 23:11 ` Duncaen
  2021-11-23 11:17 ` Duncaen
  2021-11-26 15:40 ` [ISSUE] [CLOSED] " WilliamBehrens
  8 siblings, 0 replies; 10+ messages in thread
From: Duncaen @ 2021-11-22 23:11 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 1920 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
TLDR: Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

>  So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

There is no such thing as a mirror in xbps, there are repositories and you can as many as you want.
But the first repository containing a package name is choosen to provide that package.
So adding your own repository prior to the official repo will choose the packages you have in your repo from your repo and the other packages from the official repo.

A mirror is a mirror, not half or incomplete, if the repository index advertises a package name then the package will be downloaded from that mirror.

Using a caching http proxy will cache packages you request so subsequent downloads of the package will come from the cache, by configuring that cache you can limit the cache size and how long a package will be retained, no additional administration or anything required, you don't have to maintain a list of packages to mirror or cleanup old packages.
It just like a normal repository mirror, things that are not in the cache will be downloaded and passed through to the client and then retained in the cache for subsequent requests.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
                   ` (6 preceding siblings ...)
  2021-11-22 23:11 ` Duncaen
@ 2021-11-23 11:17 ` Duncaen
  2021-11-26 15:40 ` [ISSUE] [CLOSED] " WilliamBehrens
  8 siblings, 0 replies; 10+ messages in thread
From: Duncaen @ 2021-11-23 11:17 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 1926 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
TLDR: Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

>  So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

There is no such thing as a mirror in xbps, there are repositories and you can as many as you want.
But the first repository containing a package name is choosen to provide that package.
So adding your own repository prior to the official repo will choose the packages you have in your repo from your repo and the other packages from the official repo.

A mirror is a mirror, not half or incomplete, if the repository index advertises a package name then the package will be downloaded from that mirror.

Using a caching http proxy will cache packages you request so subsequent downloads of the package will come from the cache, by configuring that cache you can limit the cache size and how long a package will be retained, no additional administration or anything required, you don't have to maintain a list of packages to mirror or cleanup old packages.
It works just like a normal repository mirror, things that are not in the cache will be downloaded and passed through to the client and then retained in the cache for subsequent requests.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [ISSUE] [CLOSED] [Question] Hosting my own private mirror with only the packages I need
  2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
                   ` (7 preceding siblings ...)
  2021-11-23 11:17 ` Duncaen
@ 2021-11-26 15:40 ` WilliamBehrens
  8 siblings, 0 replies; 10+ messages in thread
From: WilliamBehrens @ 2021-11-26 15:40 UTC (permalink / raw)
  To: ml

[-- Attachment #1: Type: text/plain, Size: 1054 bytes --]

Closed issue by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205

Description:
I'm wanting to create my own custom mirror for void packages as I want to add a custom base-system and kernel but I don't think it would really be something to commit into the main void-packages repo. Something that I can't seem to find a direct answer too strangely is if it's possible to have multiple packages mirrors at once. So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2021-11-26 15:40 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-11-22 19:02 [ISSUE] [Question] Hosting my own private mirror with only the packages I need WilliamBehrens
2021-11-22 20:53 ` HadetTheUndying
2021-11-22 21:19 ` WilliamBehrens
2021-11-22 21:23 ` HadetTheUndying
2021-11-22 21:29 ` WilliamBehrens
2021-11-22 23:01 ` Duncaen
2021-11-22 23:09 ` Duncaen
2021-11-22 23:11 ` Duncaen
2021-11-23 11:17 ` Duncaen
2021-11-26 15:40 ` [ISSUE] [CLOSED] " WilliamBehrens

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).