mailing list of musl libc
 help / color / mirror / code / Atom feed
* musl: about malloc 'expand heap' issue
@ 2018-10-30 11:11 zhangwentao (M)
  2018-10-30 15:00 ` Rich Felker
  0 siblings, 1 reply; 5+ messages in thread
From: zhangwentao (M) @ 2018-10-30 11:11 UTC (permalink / raw)
  To: musl; +Cc: Huangqiang (H), Jianing (OS-LAB), leijitang, wanghaozhan

[-- Attachment #1: Type: text/plain, Size: 1525 bytes --]


Hi all,
  I am using musl in my project and I found an issue about the malloc function in musl:

Issue Description:
*             When in muti-threads environment, malloc/free are called in high concurrency<http://dict.cn/high%20concurrency>.

Malloc:
  Will find 'struct bin' from bitmap(without lock), and allocate memory from the bin (with lock).

Free:
 Will merge the chunk together if the free memory is 'connected' to the existing chunk.

? It will remove the old chunk first then combine the chunk to a larger one.

? After merge operation done, insert the chunk to the bin list.

? Each of the chunk operation is locked while merging, but the whole steps aren't within a lock.

So here is the issue:

1.      There is only one chunk in largest bin list, and Free is on process, just remove the largest bins chunk from bin, the bitmap(mal.binmap) on that bit will be zero.

2.      A malloc comes, the bitmap is zero, and goes to expand heap. (Actually there is enough memories in process)

3.      Free operation goes on, and put the merged big chunk to bins.

But in operation 2, the process has expand heap.

If we have a loop on step 1-3, the process will expand heap frequently.
So it will cost more Virtual Memory  (of course, physical memory would be freed by calling '__madvise' if the chunk is big enough)

In my environment , we do not have that much virtual memory. I think stop expand heap would a better choice.

Do you have plan to fix it ??

THANKS
Best Regard


[-- Attachment #2: Type: text/html, Size: 19755 bytes --]

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2019-04-12 22:51 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-10-30 11:11 musl: about malloc 'expand heap' issue zhangwentao (M)
2018-10-30 15:00 ` Rich Felker
2018-10-31  1:19   ` 答复: [musl] " zhangwentao (M)
2018-10-31  3:44     ` Rich Felker
2019-04-12 22:51       ` Rich Felker

Code repositories for project(s) associated with this public inbox

	https://git.vuxu.org/mirror/musl/

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).