[PR PATCH] xbps-src/update_check: automatically decompress the content

[PR PATCH] xbps-src/update_check: automatically decompress the content

[unspecd]

[-- Attachment #1: Type: text/plain, Size: 367 bytes --]

There is a new pull request by unspecd against master on the void-packages repository

https://github.com/unspecd/void-packages fix-update-check
https://github.com/void-linux/void-packages/pull/30590

xbps-src/update_check: automatically decompress the content
Fixes: #29429.

A patch file from https://github.com/void-linux/void-packages/pull/30590.patch is attached

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: github-pr-fix-update-check-30590.patch --]
[-- Type: text/x-diff, Size: 1732 bytes --]

From bffef47d7fbaf7b935ef8db2a7dc1eae776292c0 Mon Sep 17 00:00:00 2001
From: Evgeny Ermakov <evgeny.v.ermakov@gmail.com>
Date: Fri, 30 Apr 2021 20:21:22 +1100
Subject: [PATCH] xbps-src/update_check: automatically decompress the content

---
 common/xbps-src/shutils/update_check.sh | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/common/xbps-src/shutils/update_check.sh b/common/xbps-src/shutils/update_check.sh
index 2ef29e78f299..0aa5ab7f1a7a 100644
--- a/common/xbps-src/shutils/update_check.sh
+++ b/common/xbps-src/shutils/update_check.sh
@@ -85,7 +85,7 @@ update_check() {
                 echo "(folder) fetching $urlpfx and scanning with $rx" 1>&2
             fi
             skipdirs=
-            curl -A "xbps-src-update-check/$XBPS_SRC_VERSION" --max-time 10 -Lsk "$urlpfx" |
+            curl --compressed -A "xbps-src-update-check/$XBPS_SRC_VERSION" --max-time 10 -Lsk "$urlpfx" |
                 grep -Po -i "$rx" |
                 # sort -V places 1.1/ before 1/, but 1A/ before 1.1A/
                 sed -e 's:$:A:' -e 's:/A$:A/:' | sort -Vru | sed -e 's:A/$:/A:' -e 's:A$::' |
@@ -171,7 +171,7 @@ update_check() {
         if [ -n "$XBPS_UPDATE_CHECK_VERBOSE" ]; then
             echo "fetching $url and scanning with $rx" 1>&2
         fi
-        curl -H 'Accept: text/html,application/xhtml+xml,application/xml,text/plain,application/rss+xml' -A "xbps-src-update-check/$XBPS_SRC_VERSION" --max-time 10 -Lsk "$url" |
+        curl --compressed -H 'Accept: text/html,application/xhtml+xml,application/xml,text/plain,application/rss+xml' -A "xbps-src-update-check/$XBPS_SRC_VERSION" --max-time 10 -Lsk "$url" |
             grep -Po -i "$rx"
         fetchedurls[$url]=yes
     done |

Re: xbps-src/update_check: automatically decompress the content

[ahesford]

[-- Attachment #1: Type: text/plain, Size: 419 bytes --]

New comment by ahesford on void-packages repository

https://github.com/void-linux/void-packages/pull/30590#issuecomment-841965572

Comment:
This doesn't just decompress responses, it requests compressed responses. I did a couple of quick checks with a parallel version of `xcheckmypkgs` and received some unexpected `NO VERSION` errors. I'm not sure if this was related to the `--compression` change or rate limiting.

Re: xbps-src/update_check: automatically decompress the content

[github-actions]

[-- Attachment #1: Type: text/plain, Size: 305 bytes --]

New comment by github-actions[bot] on void-packages repository

https://github.com/void-linux/void-packages/pull/30590#issuecomment-1129493146

Comment:
Pull Requests become stale 90 days after last activity and are closed 14 days after that.  If this pull request is still relevant bump it or assign it.

Re: [PR PATCH] [Closed]: xbps-src/update_check: automatically decompress the content

[github-actions]

[-- Attachment #1: Type: text/plain, Size: 207 bytes --]

There's a closed pull request on the void-packages repository

xbps-src/update_check: automatically decompress the content
https://github.com/void-linux/void-packages/pull/30590

Description:
Fixes: #29429.