Gnus limit: opening huge group

Gnus limit: opening huge group

[Kevin Shell]

Hello Gnus users.

When I try to open very huge newsgroup with
C-u <Enter>
and request fetching all the news messages
Gnus behaves badly,
the CPU makes very loud noise and Gnus can't open the group.
The Gnus's fetching speed compares with neomutt is relatively slow,
is the probelm with Emacs lisp VS C?
Noemutt can open huge group with header cache,
but Gnus just can't open huge group.

_______________________________________________
info-gnus-english mailing list
info-gnus-english@gnu.org
https://lists.gnu.org/mailman/listinfo/info-gnus-english

Re: Gnus limit: opening huge group

[Eric Abrahamsen]

Kevin Shell <kshell@gmx.com> writes:

> Hello Gnus users.
>
> When I try to open very huge newsgroup with
> C-u <Enter>
> and request fetching all the news messages
> Gnus behaves badly,
> the CPU makes very loud noise and Gnus can't open the group.
> The Gnus's fetching speed compares with neomutt is relatively slow,
> is the probelm with Emacs lisp VS C?
> Noemutt can open huge group with header cache,
> but Gnus just can't open huge group.

Is this an nntp server, or some other backend? You mention newsgroups,
which sounds like nntp, but also neomutt, which sounds like mail. Not
that I'm going to have much of a solution for you, but I do feel like
nntp handles large groups without too much trouble. Even if it takes a
while, it shouldn't spin up your fans. If it's maildir, Gnus does
currently have trouble with large message stores, mostly because it is
building the header cache and that is very slow/is done inefficiently/is
plagued by gremlins.

Someone™ will get around to fixing that eventually, but for the time
being it is slow.

Eric


_______________________________________________
info-gnus-english mailing list
info-gnus-english@gnu.org
https://lists.gnu.org/mailman/listinfo/info-gnus-english

Re: Gnus limit: opening huge group

[Kevin Shell]

On Fri, Nov 20, 2020 at 10:37:47AM -0800, Eric Abrahamsen wrote:
> Kevin Shell <kshell@gmx.com> writes:
>
> > Hello Gnus users.
> >
> > When I try to open very huge newsgroup with
> > C-u <Enter>
> > and request fetching all the news messages
> > Gnus behaves badly,
> > the CPU makes very loud noise and Gnus can't open the group.
> > The Gnus's fetching speed compares with neomutt is relatively slow,
> > is the probelm with Emacs lisp VS C?
> > Noemutt can open huge group with header cache,
> > but Gnus just can't open huge group.
>
> Is this an nntp server, or some other backend?
It's nntp backend.

>You mention newsgroups,
> which sounds like nntp, but also neomutt, which sounds like mail.
neomutt also supports nntp.

>Not that I'm going to have much of a solution for you, but I do feel like
> nntp handles large groups without too much trouble. Even if it takes a
> while, it shouldn't spin up your fans.
Gnus takes very long time to open,
often eventually can't open huge group.
Reguarding huge group,
Emacs lisp VS C does have some performance impact.


>If it's maildir, Gnus does
> currently have trouble with large message stores, mostly because it is
> building the header cache and that is very slow/is done inefficiently/is
> plagued by gremlins.

It's not maildir this time.
It's seems you remembered
I have asked a question about Maildir/Maildir++. :-)

>
> Someone™ will get around to fixing that eventually, but for the time
> being it is slow.
That's great!
Thank you for all the hard work improving Gnus.

--
kevin

An optimist is a guy that has never had much experience.
		-- Don Marquis

_______________________________________________
info-gnus-english mailing list
info-gnus-english@gnu.org
https://lists.gnu.org/mailman/listinfo/info-gnus-english

Re: Gnus limit: opening huge group

[Eric Abrahamsen]

Kevin Shell <kshell@gmx.com> writes:

> On Fri, Nov 20, 2020 at 10:37:47AM -0800, Eric Abrahamsen wrote:
>> Kevin Shell <kshell@gmx.com> writes:
>>
>> > Hello Gnus users.
>> >
>> > When I try to open very huge newsgroup with
>> > C-u <Enter>
>> > and request fetching all the news messages
>> > Gnus behaves badly,
>> > the CPU makes very loud noise and Gnus can't open the group.
>> > The Gnus's fetching speed compares with neomutt is relatively slow,
>> > is the probelm with Emacs lisp VS C?
>> > Noemutt can open huge group with header cache,
>> > but Gnus just can't open huge group.
>>
>> Is this an nntp server, or some other backend?
> It's nntp backend.
>
>>You mention newsgroups,
>> which sounds like nntp, but also neomutt, which sounds like mail.
> neomutt also supports nntp.

Oh, I didn't know that.

>>Not that I'm going to have much of a solution for you, but I do feel like
>> nntp handles large groups without too much trouble. Even if it takes a
>> while, it shouldn't spin up your fans.
> Gnus takes very long time to open,
> often eventually can't open huge group.
> Reguarding huge group,
> Emacs lisp VS C does have some performance impact.

Hmm, that's too bad. I don't think there are any nntp speedups on the
horizon, that's already been worked on pretty well. How many articles
are you trying to load?


_______________________________________________
info-gnus-english mailing list
info-gnus-english@gnu.org
https://lists.gnu.org/mailman/listinfo/info-gnus-english

Re: Gnus limit: opening huge group

[Eric Abrahamsen]

Kevin Shell <kshell@gmx.com> writes:

> On Fri, Nov 20, 2020 at 10:37:47AM -0800, Eric Abrahamsen wrote:
>> Kevin Shell <kshell@gmx.com> writes:
>>
>> > Hello Gnus users.
>> >
>> > When I try to open very huge newsgroup with
>> > C-u <Enter>
>> > and request fetching all the news messages
>> > Gnus behaves badly,
>> > the CPU makes very loud noise and Gnus can't open the group.
>> > The Gnus's fetching speed compares with neomutt is relatively slow,
>> > is the probelm with Emacs lisp VS C?
>> > Noemutt can open huge group with header cache,
>> > but Gnus just can't open huge group.
>>
>> Is this an nntp server, or some other backend?
> It's nntp backend.
>
>>You mention newsgroups,
>> which sounds like nntp, but also neomutt, which sounds like mail.
> neomutt also supports nntp.

Oh, I didn't know that.

>>Not that I'm going to have much of a solution for you, but I do feel like
>> nntp handles large groups without too much trouble. Even if it takes a
>> while, it shouldn't spin up your fans.
> Gnus takes very long time to open,
> often eventually can't open huge group.
> Reguarding huge group,
> Emacs lisp VS C does have some performance impact.

Hmm, that's too bad. I don't think there are any nntp speedups on the
horizon, that's already been worked on pretty well. How many articles
are you trying to load?


_______________________________________________
info-gnus-english mailing list
info-gnus-english@gnu.org
https://lists.gnu.org/mailman/listinfo/info-gnus-english

Re: Gnus limit: opening huge group

[Kevin Shell]

On Sat, Nov 21, 2020 at 02:24:45PM -0800, Eric Abrahamsen wrote:
>
> Hmm, that's too bad. I don't think there are any nntp speedups on the
> horizon, that's already been worked on pretty well. How many articles
> are you trying to load?
>
I brutally torture Gnus
to the limit to load all the articles the group has. :-)

--
kevin

_______________________________________________
info-gnus-english mailing list
info-gnus-english@gnu.org
https://lists.gnu.org/mailman/listinfo/info-gnus-english

Re: Gnus limit: opening huge group

[Eric Abrahamsen]

Kevin Shell <kshell@gmx.com> writes:

> On Sat, Nov 21, 2020 at 02:24:45PM -0800, Eric Abrahamsen wrote:
>>
>> Hmm, that's too bad. I don't think there are any nntp speedups on the
>> horizon, that's already been worked on pretty well. How many articles
>> are you trying to load?
>>
> I brutally torture Gnus
> to the limit to load all the articles the group has. :-)

Well it's good someone's doing that For Science :)


_______________________________________________
info-gnus-english mailing list
info-gnus-english@gnu.org
https://lists.gnu.org/mailman/listinfo/info-gnus-english