[ISSUE] [Question] Hosting my own private mirror with only the packages I need

[ISSUE] [Question] Hosting my own private mirror with only the packages I need

[WilliamBehrens]

[-- Attachment #1: Type: text/plain, Size: 1051 bytes --]

New issue by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205

Description:
I'm wanting to create my own custom mirror for void packages as I want to add a custom base-system and kernel but I don't think it would really be something to commit into the main void-packages repo. Something that I can't seem to find a direct answer too strangely is if it's possible to have multiple packages mirrors at once. So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

Re: [Question] Hosting my own private mirror with only the packages I need

[HadetTheUndying]

[-- Attachment #1: Type: text/plain, Size: 330 bytes --]

New comment by HadetTheUndying on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975909262

Comment:
You could just clone the repo and build the packages locally? 

There's also documentation about what you're asking here:

https://docs.voidlinux.org/xbps/repositories/custom.html

Re: [Question] Hosting my own private mirror with only the packages I need

[WilliamBehrens]

[-- Attachment #1: Type: text/plain, Size: 220 bytes --]

New comment by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975928053

Comment:
Well the thing is I don't want to have to build everything from source

Re: [Question] Hosting my own private mirror with only the packages I need

[HadetTheUndying]

[-- Attachment #1: Type: text/plain, Size: 516 bytes --]

New comment by HadetTheUndying on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975930824

Comment:
> Well the thing is I don't want to have to build everything from source

I'm not really sure what you want then? If you're hosting custom packages/patch sets or restricted packages on your own server for example they're still going to need to be built and signed. 

Like for example hosting on a VPS you would still have to build the packages for the custom repo. 

Re: [Question] Hosting my own private mirror with only the packages I need

[WilliamBehrens]

[-- Attachment #1: Type: text/plain, Size: 294 bytes --]

New comment by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975935922

Comment:
I mean I want to be able to pull down a pre-compiled version of a package from the main void mirrors to compile the custom packages on my mirror

Re: [Question] Hosting my own private mirror with only the packages I need

[Duncaen]

[-- Attachment #1: Type: text/plain, Size: 266 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

Re: [Question] Hosting my own private mirror with only the packages I need

[Duncaen]

[-- Attachment #1: Type: text/plain, Size: 1715 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
TLDR: Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

>  So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

There is no such thing as a mirror in xbps, there are repositories and you can as many as you want.
But the first repository containing a package name is choosen to provide that package.
So adding your own repository prior to the official repo will choose the packages you have in your repo from your repo and the other packages from the official repo.

A mirror is a mirror, not half or incomplete, if the repository index advertises a package name then the package will be downloaded from that mirror.

Using a caching http proxy will cache packages you request so subsequent downloads of the package will come from the cache, by configuring that cache you can limit the cache size and how long a package will be retained, no additional administration or anything required, you don't have to maintain a list or cleanup old packages.

Re: [Question] Hosting my own private mirror with only the packages I need

[Duncaen]

[-- Attachment #1: Type: text/plain, Size: 1920 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
TLDR: Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

>  So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

There is no such thing as a mirror in xbps, there are repositories and you can as many as you want.
But the first repository containing a package name is choosen to provide that package.
So adding your own repository prior to the official repo will choose the packages you have in your repo from your repo and the other packages from the official repo.

A mirror is a mirror, not half or incomplete, if the repository index advertises a package name then the package will be downloaded from that mirror.

Using a caching http proxy will cache packages you request so subsequent downloads of the package will come from the cache, by configuring that cache you can limit the cache size and how long a package will be retained, no additional administration or anything required, you don't have to maintain a list of packages to mirror or cleanup old packages.
It just like a normal repository mirror, things that are not in the cache will be downloaded and passed through to the client and then retained in the cache for subsequent requests.

Re: [Question] Hosting my own private mirror with only the packages I need

[Duncaen]

[-- Attachment #1: Type: text/plain, Size: 1926 bytes --]

New comment by Duncaen on void-packages repository

https://github.com/void-linux/void-packages/issues/34205#issuecomment-975990476

Comment:
TLDR: Just host a caching http proxy, here is an nginx example: https://gist.github.com/Duncaen/645f119544a65ad0fd32e0e0400e22a3.

>  So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.

There is no such thing as a mirror in xbps, there are repositories and you can as many as you want.
But the first repository containing a package name is choosen to provide that package.
So adding your own repository prior to the official repo will choose the packages you have in your repo from your repo and the other packages from the official repo.

A mirror is a mirror, not half or incomplete, if the repository index advertises a package name then the package will be downloaded from that mirror.

Using a caching http proxy will cache packages you request so subsequent downloads of the package will come from the cache, by configuring that cache you can limit the cache size and how long a package will be retained, no additional administration or anything required, you don't have to maintain a list of packages to mirror or cleanup old packages.
It works just like a normal repository mirror, things that are not in the cache will be downloaded and passed through to the client and then retained in the cache for subsequent requests.

Re: [ISSUE] [CLOSED] [Question] Hosting my own private mirror with only the packages I need

[WilliamBehrens]

[-- Attachment #1: Type: text/plain, Size: 1054 bytes --]

Closed issue by WilliamBehrens on void-packages repository

https://github.com/void-linux/void-packages/issues/34205

Description:
I'm wanting to create my own custom mirror for void packages as I want to add a custom base-system and kernel but I don't think it would really be something to commit into the main void-packages repo. Something that I can't seem to find a direct answer too strangely is if it's possible to have multiple packages mirrors at once. So if I have my own custom repo hosted on my network and still be able to install packages from the main void repo. Another thing that isn't really documented if multiple repos is a thing is if each mirror has to host ALL of the packages in the main void repo or even if they just require the dependancies of the custom packages(like if I have a custom version of glew do I need to host my own version of glu or can glu be pulled from the main mirror to compile glew). I was hoping to be able to remove all the packages I'm not using to reduce the storage requirement of the mirror basically.