From mboxrd@z Thu Jan  1 00:00:00 1970
X-Msuck: nntp://news.gmane.org/gmane.linux.lib.musl.general/10448
Path: news.gmane.org!.POSTED!not-for-mail
From: u-uy74@aetey.se
Newsgroups: gmane.linux.lib.musl.general
Subject: Re: incompatibility between libtheora/mmx and musl ?
Date: Wed, 14 Sep 2016 17:11:46 +0200
Message-ID: <20160914151145.GR16436@example.net>
References: <20160913180649.GN16436@example.net>
 <20160913204304.GY15995@brightrain.aerifal.cx>
 <20160914103253.GO16436@example.net>
 <20160914112400.GS1280@port70.net>
 <20160914140450.GQ16436@example.net>
 <20160914142842.GZ15995@brightrain.aerifal.cx>
 <20160914144145.GT1280@port70.net>
Reply-To: musl@lists.openwall.com
NNTP-Posting-Host: blaine.gmane.org
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Trace: blaine.gmane.org 1473865945 29939 195.159.176.226 (14 Sep 2016 15:12:25 GMT)
X-Complaints-To: usenet@blaine.gmane.org
NNTP-Posting-Date: Wed, 14 Sep 2016 15:12:25 +0000 (UTC)
To: musl@lists.openwall.com
Original-X-From: musl-return-10461-gllmg-musl=m.gmane.org@lists.openwall.com Wed Sep 14 17:12:17 2016
Return-path: <musl-return-10461-gllmg-musl=m.gmane.org@lists.openwall.com>
Envelope-to: gllmg-musl@m.gmane.org
Original-Received: from mother.openwall.net ([195.42.179.200])
	by blaine.gmane.org with smtp (Exim 4.84_2)
	(envelope-from <musl-return-10461-gllmg-musl=m.gmane.org@lists.openwall.com>)
	id 1bkBr7-0006A1-Tz
	for gllmg-musl@m.gmane.org; Wed, 14 Sep 2016 17:12:10 +0200
Original-Received: (qmail 20210 invoked by uid 550); 14 Sep 2016 15:12:09 -0000
Mailing-List: contact musl-help@lists.openwall.com; run by ezmlm
Precedence: bulk
List-Post: <mailto:musl@lists.openwall.com>
List-Help: <mailto:musl-help@lists.openwall.com>
List-Unsubscribe: <mailto:musl-unsubscribe@lists.openwall.com>
List-Subscribe: <mailto:musl-subscribe@lists.openwall.com>
List-ID: <musl.lists.openwall.com>
Original-Received: (qmail 20189 invoked from network); 14 Sep 2016 15:12:08 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fripost.org; h=
	in-reply-to:content-disposition:content-type:content-type
	:mime-version:references:message-id:subject:subject:from:from
	:date:date; s=20140703; t=1473865917; x=1475680318; bh=DvYQmCEPH
	PaeWE8StW409YzfRKqDaJGIKP7P1QpOoJw=; b=GASAFM1cDbk9R+idfyq4toNlJ
	N0mT3PFnsWf9alWWscAT35TGVVXAzx5UUq3uIyuSHbOHyaHDk6ce7TRbGDSfNIng
	NqLX2qI2RSROuraRWGJT8sYMxtHAuMWULrAeNNP318lD3O7A5/G8s/BY8fgY/k1P
	fzmDY/oYECGri8wIvc=
X-Virus-Scanned: Debian amavisd-new at fripost.org
Content-Disposition: inline
In-Reply-To: <20160914144145.GT1280@port70.net>
Xref: news.gmane.org gmane.linux.lib.musl.general:10448
Archived-At: <http://permalink.gmane.org/gmane.linux.lib.musl.general/10448>

On Wed, Sep 14, 2016 at 04:41:45PM +0200, Szabolcs Nagy wrote:
> this might be an issue:
> musl uses float instructions in malloc,
> if mmx needs different fpu state and
> they don't change it back for a malloc
> call that can corrupt the heap.
> 
> to test this, try to use the 'non-float bin index'
> code in musl from here:
> http://port70.net/~nsz/musl/malloc.c

Bingo!

The resulting encoder works like a charm.

I forward this info to Xiph and expect the fix will be on the way.

Thanks a lot Szabolcs (and everyone)!

Rune