Re: shr.el: folding Japanese text

[Lars Magne Ingebrigtsen <larsi@gnus.org>]

Katsumi Yamaoka <yamaoka@jpl.org> writes:

> Could you see articles in the gwene.jp.itmedia.news.bursts
> newsgroup?  You may see some aren't folded and some are folded
> uglily.  There's no concept of the word wrapping in Japanese.
> Normally there's no space between words.  A word may be folded
> in the middle of it.  Is it funny?  But it's our custom. ;-)
> I guess that Korean text and Chinese text are similar.
>
> The following is a quick hack that satisfies me so-so.  For the
> moment I don't know how we can switch it for Latin text and
> others, though.

Yeah, this should be fixed to work on all languages.  But I'm not sure
what would be the right approach here.  Should we add language-guessing
stuff to switch the folding routine?  Or are there other (simpler) ways
to get satisfactory results in this area?

Right now I'm not seeing any obvious easy solutions here, but surely
somebody has dealt with problems like this before.  :-)  Any ideas?

Just when typing this, it occurs to me that there may be help from the
unicode standard, perhaps?  I mean, it shr-insert inserts a text with
characters from the Japanese, Chinese, Korean and *mumble* planes, then
we can break it on "character" boundaries, instead where spaces appear.
So if Emacs has a way to say (character-from-non-space-language-p char),
then our problems would be solved.  :-)

-- 
(domestic pets only, the antidote for overdose, milk.)
  larsi@gnus.org * Lars Magne Ingebrigtsen