* [PR PATCH] new package: alpaca.cpp
@ 2023-03-28 20:14 atk
2023-03-28 20:22 ` [PR REVIEW] " abenson
` (4 more replies)
0 siblings, 5 replies; 6+ messages in thread
From: atk @ 2023-03-28 20:14 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 1084 bytes --]
There is a new pull request by atk against master on the void-packages repository
https://github.com/atk/void-packages alpaca.cpp
https://github.com/void-linux/void-packages/pull/43080
new package: alpaca.cpp
<!-- Uncomment relevant sections and delete options which are not applicable -->
#### Testing the changes
- I tested the changes in this PR: **YES**
#### New package
- This new package conforms to the [package requirements](https://github.com/void-linux/void-packages/blob/master/CONTRIBUTING.md#package-requirements): **YES**
<!-- Note: If the build is likely to take more than 2 hours, please add ci skip tag as described in
https://github.com/void-linux/void-packages/blob/master/CONTRIBUTING.md#continuous-integration
and test at least one native build and, if supported, at least one cross build.
Ignore this section if this PR is not skipping CI.
-->
#### Local build testing
- I built this PR locally for my native architecture, (ARCH-LIBC) x86_64+glibc
A patch file from https://github.com/void-linux/void-packages/pull/43080.patch is attached
[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: github-pr-alpaca.cpp-43080.patch --]
[-- Type: text/x-diff, Size: 1858 bytes --]
From 5df7480d0b1fefba17aef8c32f6b7d7b9d1aadf5 Mon Sep 17 00:00:00 2001
From: Alex Lohr <alex.lohr@logmein.com>
Date: Tue, 28 Mar 2023 22:11:08 +0200
Subject: [PATCH] new package: alpaca.cpp
---
srcpkgs/alpaca.cpp/INSTALL.msg | 10 ++++++++++
srcpkgs/alpaca.cpp/template | 20 ++++++++++++++++++++
2 files changed, 30 insertions(+)
create mode 100644 srcpkgs/alpaca.cpp/INSTALL.msg
create mode 100644 srcpkgs/alpaca.cpp/template
diff --git a/srcpkgs/alpaca.cpp/INSTALL.msg b/srcpkgs/alpaca.cpp/INSTALL.msg
new file mode 100644
index 000000000000..16f108863275
--- /dev/null
+++ b/srcpkgs/alpaca.cpp/INSTALL.msg
@@ -0,0 +1,10 @@
+To use alpaca.cpp, you need to download a ggml model.
+
+A pre-trained model (~4GB) with 7 billion quantifiers can be downloaded at
+https://huggingface.co/Sosaka/Alpaca-native-4bit-ggml/resolve/main/ggml-alpaca-7b-q4.bin
+
+A pre-trained model (~7.6GB) with 13 billion quantifiers is located at
+https://gateway.estuary.tech/gw/ipfs/Qme6wyw9MzqbrUMpFNVq42rC1kSdko7MGT9CL7o1u9Cv9G
+
+To run alpaca.cpp, call
+$ alpaca-chat -m [insert model]
diff --git a/srcpkgs/alpaca.cpp/template b/srcpkgs/alpaca.cpp/template
new file mode 100644
index 000000000000..869bc36f833c
--- /dev/null
+++ b/srcpkgs/alpaca.cpp/template
@@ -0,0 +1,20 @@
+# Template file for 'alpaca.cpp'
+pkgname=alpaca.cpp
+version=9116ae9
+revision=1
+short_desc="Locally run an Instruction-Tuned Chat-Style LLM"
+maintainer="Alex Lohr <alex.lohr@logmein.com>"
+license="MIT"
+homepage="https://github.com/antimatter15/alpaca.cpp"
+changelog="https://github.com/antimatter15/alpaca.cpp/releases"
+distfiles="https://github.com/antimatter15/${pkgname}/archive/refs/tags/${version}.tar.gz"
+checksum=f8faab389abe214ba7c828b592c274e8e017f0e7f69c4265dde38f542e8b0092
+
+do_build() {
+ make chat
+}
+
+do_install() {
+ vbin chat alpaca-chat
+ vlicense LICENSE
+}
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PR REVIEW] new package: alpaca.cpp
2023-03-28 20:14 [PR PATCH] new package: alpaca.cpp atk
@ 2023-03-28 20:22 ` abenson
2023-03-28 20:22 ` the-maldridge
` (3 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: abenson @ 2023-03-28 20:22 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 184 bytes --]
New review comment by abenson on void-packages repository
https://github.com/void-linux/void-packages/pull/43080#discussion_r1151113649
Comment:
This is not a viable version number.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: new package: alpaca.cpp
2023-03-28 20:14 [PR PATCH] new package: alpaca.cpp atk
2023-03-28 20:22 ` [PR REVIEW] " abenson
@ 2023-03-28 20:22 ` the-maldridge
2023-03-28 20:22 ` [PR PATCH] [Closed]: " the-maldridge
` (2 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: the-maldridge @ 2023-03-28 20:22 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 387 bytes --]
New comment by the-maldridge on void-packages repository
https://github.com/void-linux/void-packages/pull/43080#issuecomment-1487544614
Comment:
Rejected after a very brief but unanimous discussion by maintainers. Issues include but are not limited to:
* upstream release quality
* upstream versioning scheme is just git hashes
* dependent on external unversioned artifacts.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PR PATCH] [Closed]: new package: alpaca.cpp
2023-03-28 20:14 [PR PATCH] new package: alpaca.cpp atk
2023-03-28 20:22 ` [PR REVIEW] " abenson
2023-03-28 20:22 ` the-maldridge
@ 2023-03-28 20:22 ` the-maldridge
2023-03-28 20:24 ` lemmi
2023-03-28 20:26 ` lemmi
4 siblings, 0 replies; 6+ messages in thread
From: the-maldridge @ 2023-03-28 20:22 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 938 bytes --]
There's a closed pull request on the void-packages repository
new package: alpaca.cpp
https://github.com/void-linux/void-packages/pull/43080
Description:
<!-- Uncomment relevant sections and delete options which are not applicable -->
#### Testing the changes
- I tested the changes in this PR: **YES**
#### New package
- This new package conforms to the [package requirements](https://github.com/void-linux/void-packages/blob/master/CONTRIBUTING.md#package-requirements): **YES**
<!-- Note: If the build is likely to take more than 2 hours, please add ci skip tag as described in
https://github.com/void-linux/void-packages/blob/master/CONTRIBUTING.md#continuous-integration
and test at least one native build and, if supported, at least one cross build.
Ignore this section if this PR is not skipping CI.
-->
#### Local build testing
- I built this PR locally for my native architecture, (ARCH-LIBC) x86_64+glibc
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: new package: alpaca.cpp
2023-03-28 20:14 [PR PATCH] new package: alpaca.cpp atk
` (2 preceding siblings ...)
2023-03-28 20:22 ` [PR PATCH] [Closed]: " the-maldridge
@ 2023-03-28 20:24 ` lemmi
2023-03-28 20:26 ` lemmi
4 siblings, 0 replies; 6+ messages in thread
From: lemmi @ 2023-03-28 20:24 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 695 bytes --]
New comment by lemmi on void-packages repository
https://github.com/void-linux/void-packages/pull/43080#issuecomment-1487546229
Comment:
At this point I don't think adding `alpaca.cpp` to the repository is a good idea. It was a more or less quick hack added to `llama.cpp` and has fallen behind over a hundred of commits at this point. At the same time there still seems to be some interest to get some `alpaca.cpp` like functionality merged into `llama.cpp` to get rid of the shell scripts.
Let's sit this one out for a little while longer. Luckily, these projects are very easy to build and once there is a clear good solution for these models, we can think about adding a solution then.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: new package: alpaca.cpp
2023-03-28 20:14 [PR PATCH] new package: alpaca.cpp atk
` (3 preceding siblings ...)
2023-03-28 20:24 ` lemmi
@ 2023-03-28 20:26 ` lemmi
4 siblings, 0 replies; 6+ messages in thread
From: lemmi @ 2023-03-28 20:26 UTC (permalink / raw)
To: ml
[-- Attachment #1: Type: text/plain, Size: 706 bytes --]
New comment by lemmi on void-packages repository
https://github.com/void-linux/void-packages/pull/43080#issuecomment-1487546229
Comment:
At this point I don't think adding `alpaca.cpp` to the repository is a good idea. It was a more or less quick hack added to `llama.cpp` and has fallen behind over a hundred of commits at this point. At the same time there still seems to be some interest to get some `alpaca.cpp` like functionality merged into `llama.cpp` to get rid of the shell scripts.
Let's sit this one out for a little while longer. Luckily, these projects are very easy to build and once there is a clear good solution for these models, we can think about adding one of these projects then.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2023-03-28 20:26 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2023-03-28 20:14 [PR PATCH] new package: alpaca.cpp atk
2023-03-28 20:22 ` [PR REVIEW] " abenson
2023-03-28 20:22 ` the-maldridge
2023-03-28 20:22 ` [PR PATCH] [Closed]: " the-maldridge
2023-03-28 20:24 ` lemmi
2023-03-28 20:26 ` lemmi
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).