zsh (CVS) and unicode

zsh (CVS) and unicode

[Ruslan N. Balkin]

Hi

First of all, I'm new to this list and first thing i want to do is to thank
developers for perfect shell and for first UTF-8 steps were already done at
the moment. After switching to UTF-8, I understood how bad is that i can't
use my zsh 4.2.5 with utf-8 locale.

I tried cvs version to see whether i can help with testing and/or development
of utf-8 support, but i'm not that familiar with development for linux, nor
with C, nor with zsh sources, the only thing i know by searching zsh maillists,
is that utf-8 support is not fully ready within zle module.

I haven't find any guidelines to compiling CVS version other than few lines in
FAQ, so i uncommented in ./Src/system.h:#define ZLE_UNICODE_SUPPORT      1
and since then, i was able to write cyrillic letters with zsh.

Even better, they seem to work, so for example i can use
mplayer <cyrillic_here>. But current CVS of zsh, after i enable
ZLE_UNICODE_SUPPORT, crashes on tab-completion of these names. I can post a
backtrace from gdb on your request, but to my eyes it isn't very useful.
(yes my binary was compiled with debug flags on and unstripped, but backtrace
is reportet to be several screens long, and bt full terminates on frame 1).
Maybe these errors are even usable for you -
BUG: substring ends in the middle of a metachar in ztrsub()
BUG: 0 <= wb <= zlecs <= we is not true!
Segmentation fault (core dumped)

If I did something wrong, please excuse me, but i haven't found much information
about zsh and utf-8, and mail list search is not very usable. If i can help
somehow, please let me know if you need my backtraces or help in testing
something. 
P.S. The crash is reproducible here always, when i enable ZLE_UNICODE_SUPPORT.
P.P.S. Thanks for your work, the greatest shell ever existed.
P.P.P.S. I'm running gentoo, 2.3.4glibc, ru_RU.UTF-8 locale, gcc version is 3.3.5
and running on 32 bit AMD processor.

-- 
Ruslan

Re: zsh (CVS) and unicode

[Andrey Borzenkov]

[-- Attachment #1: Type: text/plain, Size: 818 bytes --]

On Friday 08 July 2005 03:04, Ruslan N. Balkin wrote:
> But current CVS of zsh, after i enable
> ZLE_UNICODE_SUPPORT, crashes on tab-completion of these names. 

yes :(
[...]
> If I did something wrong, please excuse me,

No.

the problem is, you can't incrementally add UNICODE support to completion. You 
must rewrite the *whole* completion code. Unfortunately the author is no more 
reacheable and apparently no one has time and guts to punge into it.

I really begin to suspect that rewriting completion from scratch (retaining 
functionality but adding it in small pieces) would be easier :(

> but i haven't found much 
> information about zsh and utf-8, and mail list search is not very usable.
> If i can help somehow, please let me know 

yes! fix completion code!! please :)

-andrey

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]