From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.org/gmane.linux.lib.musl.general/3462 Path: news.gmane.org!not-for-mail From: Rich Felker Newsgroups: gmane.linux.lib.musl.general Subject: Re: Iconv and old codepages Date: Wed, 26 Jun 2013 14:47:15 -0400 Message-ID: <20130626184715.GR29800@brightrain.aerifal.cx> References: <20130627021539.76b69eea@sibserver.ru> Reply-To: musl@lists.openwall.com NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: ger.gmane.org 1372272449 13262 80.91.229.3 (26 Jun 2013 18:47:29 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Wed, 26 Jun 2013 18:47:29 +0000 (UTC) To: musl@lists.openwall.com Original-X-From: musl-return-3466-gllmg-musl=m.gmane.org@lists.openwall.com Wed Jun 26 20:47:32 2013 Return-path: Envelope-to: gllmg-musl@plane.gmane.org Original-Received: from mother.openwall.net ([195.42.179.200]) by plane.gmane.org with smtp (Exim 4.69) (envelope-from ) id 1Urukc-0006BV-4K for gllmg-musl@plane.gmane.org; Wed, 26 Jun 2013 20:47:30 +0200 Original-Received: (qmail 3092 invoked by uid 550); 26 Jun 2013 18:47:29 -0000 Mailing-List: contact musl-help@lists.openwall.com; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: Original-Received: (qmail 3084 invoked from network); 26 Jun 2013 18:47:28 -0000 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Xref: news.gmane.org gmane.linux.lib.musl.general:3462 Archived-At: On Wed, Jun 26, 2013 at 02:39:59PM -0400, LM wrote: > On Wed, Jun 26, 2013 at 2:15 PM, orc wrote: > > > I also noticed alternative libs thread and corresponding wiki page. > > Does someone know lightweight iconv replacement as a temporary measure > > (other than libiconv for example)? > > > > Thought I had the Apache Portable Runtime project listed on the > alternatives page. Will update that. > APR has a version of iconv. > > BSD systems have their own implementations of iconv. Haven't found a > standalone version. There may be some code in obase (listed on wiki). > There's mention of a BSD licensed libiconv ( > https://wiki.freebsd.org/G%C3%A1borSoC2009 ) as part of Citrus (which was > also supposed to have a gettext alternative). The web page on Citrus is at > http://citrus.bsdclub.org/ but I haven't found the source code for the > project. ICU ( http://site.icu-project.org/) provides uconv instead of > iconv. On Windows, they typically use GNU libiconv since iconv isn't part > of the C runtime library. > > If anyone thinks these (or possibly some other alternatives) are useful, I > can add the links for them to the wiki. Please let me know if they any of > them don't appear too bloated and would be worth adding. You're welcome to add them, but it would be good to note that musl has iconv, and it's definitely possible to consider deficiencies in musl's iconv that are affecting real-world usage as bugs to be fixed. The current priorities of musl's iconv are size, simplicity, and charset coverage, in that order, and the usage cases I've prioritized are conversion from legacy to Unicode-based rather than going in the other direction. So as of now, the main reasons someone might want a third-party iconv when using musl are: - Support for obscure charsets or the few not-yet-supported East Asian charsets (mainly Korean and Taiwanese). - High performance bulk conversions. - Avoiding extremely-slow or missing reverse conversions (legacy destinations). In musl, these are very slow and a few (the East Asian legacy ones) are not even supported in reverse yet. Rich