From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 12889 invoked by alias); 13 Oct 2015 13:07:49 -0000 Mailing-List: contact zsh-workers-help@zsh.org; run by ezmlm Precedence: bulk X-No-Archive: yes List-Id: Zsh Workers List List-Post: List-Help: X-Seq: 36851 Received: (qmail 10264 invoked from network); 13 Oct 2015 13:07:47 -0000 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on f.primenet.com.au X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, T_DKIM_INVALID autolearn=ham autolearn_force=no version=3.4.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=newh7miYvgjTsKf/9WHVf9M6P+fPLxIS7y3IbBU3ROk=; b=xxvXkgcsju2wdK3zQr6OMcTqObcQgX9eb2M9dYcnG2V0s4+pXhuvftWdqXZNdpHHqz Y6UGFOXhnjLVK+YNCJXgpzCpAGuUDhmDZoKeqa9r8LLX4MhrR2HwwRUpkej7+O0ef0jn BeqdM6W303IKxIwviS826pubsCtxTvJnxdrwnaWP++V1cWvpxRFTooEjBJle7jyBthgy yBtQMOoCDX4Mr4sLKc73m8pwNTVDIrQZFYyJuLk/foQ8NVWn0+FDJ00qCSjtC6n3etQr KOKstTuzl3/C9JToJfs3V1HqZkFjv+jDzxg3hicp4IQRcmO01gTc+zpE8t6oGlOTCVRE O+BA== X-Received: by 10.112.131.8 with SMTP id oi8mr12112584lbb.99.1444741665691; Tue, 13 Oct 2015 06:07:45 -0700 (PDT) MIME-Version: 1.0 In-Reply-To: References: <151010105849.ZM10144@torch.brasslantern.com> <151010170623.ZM16166@torch.brasslantern.com> <151010232045.ZM12931@torch.brasslantern.com> <151011091757.ZM27755@torch.brasslantern.com> <151011103121.ZM8814@torch.brasslantern.com> <151011142204.ZM9103@torch.brasslantern.com> From: Sebastian Gniazdowski Date: Tue, 13 Oct 2015 15:07:25 +0200 Message-ID: Subject: Re: Slowdown around 5.0.5-dev-0 To: zsh-workers@zsh.org Content-Type: multipart/mixed; boundary=e89a8f235015c6c1560521fc217c --e89a8f235015c6c1560521fc217c Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 12 October 2015 at 10:21, Sebastian Gniazdowski wrote: > With both patches zprof running time is around 1806. RES is 152M and > goes down nicely to 37564 when I quit the script. Didn't observe > after-while slow down. The tool is almost fully usable for 89k > elements (there's still a bit lag), however searching is slow, I > attached zprof results for searching. It is done via two following > invocations: > > list=3D( "${(@M)list:#(#i)*$~search_pattern*}" ) > col_list=3D( > "${(@)list//(#mi)($~colsearch_pattern)/$red${MATCH}$reset}" ) > > Maybe they trigger some specific behavior on heap? Did one more memory and performance test for version with both patches and without them. Earlier I just started the script and moved 9 lines, then checked memory. Now I ran search with $search_pattern and $colsearch_pattern set to "s", single leter, then checked memory. RES is 433M and 432M, so it's fine. The patched (HEAD) version is 14 times faster. I also checked 5.0.2 =E2=80=93 RES is 400M, and it's ~8 times slowe= r than the patched version. Best regards, Sebastian Gniazdowski --e89a8f235015c6c1560521fc217c Content-Type: text/plain; charset=US-ASCII; name="result_search2.txt" Content-Disposition: attachment; filename="result_search2.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_ifpdurk22 Ym90aCBwYXRjaGVzIChIRUFEKToKbnVtICBjYWxscyAgICAgICAgICAgICAgICB0aW1lICAgICAg ICAgICAgICAgICAgICAgICBzZWxmICAgICAgICAgICAgbmFtZQotLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLQogMSkgICAgMSAgICAgICAxMDExMiw2NSAxMDExMiw2NSAgIDk5LDg1JSAgIDUxMjQs NDcgIDUxMjQsNDcgICA1MCw2MCUgIG4tbGlzdAogMikgICA5MiAgICAgICAgNDU5Nyw5NiAgICA0 OSw5OCAgIDQ1LDQwJSAgIDQ1OTcsOTYgICAgNDksOTggICA0NSw0MCUgIF9ubGlzdF9wcmludF93 aXRoX2Fuc2kKIDMpICAgIDQgICAgICAgIDQ5MTAsOTcgIDEyMjcsNzQgICA0OCw0OSUgICAgMzEz LDAxICAgIDc4LDI1ICAgIDMsMDklICBuLWxpc3QtZHJhdwogNCkgICAgNCAgICAgICAgICA2OSwy NCAgICAxNywzMSAgICAwLDY4JSAgICAgNTMsMjYgICAgMTMsMzEgICAgMCw1MyUgIG4tbGlzdC1p bnB1dAogNSkgICAgNCAgICAgICAgICAyOCw1MSAgICAgNywxMyAgICAwLDI4JSAgICAgMjgsNTEg ICAgIDcsMTMgICAgMCwyOCUgIF9ubGlzdF9jdXJzb3JfdmlzaWJpbGl0eQogNikgICAgMSAgICAg ICAgICAxNCw3OSAgICAxNCw3OSAgICAwLDE1JSAgICAgIDcsMTEgICAgIDcsMTEgICAgMCwwNyUg IF9ubGlzdF9leGl0CiA3KSAgICA0ICAgICAgICAgICAyLDc4ICAgICAwLDcwICAgIDAsMDMlICAg ICAgMiw3MiAgICAgMCw2OCAgICAwLDAzJSAgX25saXN0X3NldHVwX3VzZXJfdmFycwogOCkgICAg NCAgICAgICAgICAgMCwxOCAgICAgMCwwNSAgICAwLDAwJSAgICAgIDAsMTggICAgIDAsMDUgICAg MCwwMCUgIF9ubGlzdF9zdGF0dXNfbXNnCiggbi1wYW5lbGl6ZSA8IH4vbHNvZmxzb2Y7ICkgIDEw LDg4cyB1c2VyIDAsNTJzIHN5c3RlbSA5MyUgY3B1IDEyLDE1MyB0b3RhbAoKUkVTOiA0MzNNCgpu byBwYXRjaGVzOgpudW0gIGNhbGxzICAgICAgICAgICAgICAgIHRpbWUgICAgICAgICAgICAgICAg ICAgICAgIHNlbGYgICAgICAgICAgICBuYW1lCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCiAx KSAgIDkyICAgICAgIDc3NTQyLDg5ICAgODQyLDg2ICAgNTQsNDIlICA3NzU0Miw4OSAgIDg0Miw4 NiAgIDU0LDQyJSAgX25saXN0X3ByaW50X3dpdGhfYW5zaQogMikgICAgMSAgICAgICAxNDI0NjAs NTQgMTQyNDYwLDU0ICAgOTksOTglICA2MTgxNiw0MiA2MTgxNiw0MiAgIDQzLDM4JSAgbi1saXN0 CiAzKSAgICA0ICAgICAgIDgwMTMwLDM0IDIwMDMyLDU5ICAgNTYsMjQlICAgMjU4Nyw0NiAgIDY0 Niw4NiAgICAxLDgyJSAgbi1saXN0LWRyYXcKIDQpICAgIDQgICAgICAgICA0NTYsMDIgICAxMTQs MDEgICAgMCwzMiUgICAgMzYyLDE0ICAgIDkwLDU0ICAgIDAsMjUlICBuLWxpc3QtaW5wdXQKIDUp ICAgIDQgICAgICAgICAxMTcsMzcgICAgMjksMzQgICAgMCwwOCUgICAgMTE3LDM3ICAgIDI5LDM0 ICAgIDAsMDglICBfbmxpc3RfY3Vyc29yX3Zpc2liaWxpdHkKIDYpICAgIDQgICAgICAgICAgMjgs MDggICAgIDcsMDIgICAgMCwwMiUgICAgIDI4LDA4ICAgICA3LDAyICAgIDAsMDIlICBfbmxpc3Rf c3RhdHVzX21zZwogNykgICAgNCAgICAgICAgICAxOSw1MCAgICAgNCw4OCAgICAwLDAxJSAgICAg MTgsNzEgICAgIDQsNjggICAgMCwwMSUgIF9ubGlzdF9zZXR1cF91c2VyX3ZhcnMKIDgpICAgIDEg ICAgICAgICAgMjYsODAgICAgMjYsODAgICAgMCwwMiUgICAgIDExLDAzICAgIDExLDAzICAgIDAs MDElICBfbmxpc3RfZXhpdAooIG4tcGFuZWxpemUgPCB+L2xzb2Zsc29mOyApICAxNDMsNzNzIHVz ZXIgMCw1NHMgc3lzdGVtIDk5JSBjcHUgMjoyNSwxNSB0b3RhbAoKUkVTOiA0MzJNCgo1LjAuMiAt IHRoZSB0ZXN0IGlzIGJpYXNlZCBiZWNhdXNlIEkgYnJvd3NlZCBsaXN0IGZvciB+MTAgc2Vjb25k cyBiZWZvcmUgdGhlCnNjcmlwdCBjYXRjaGVkICJzZWNvbmQgYnJlYXRoIiBhbmQgc3RhcnRlZCB0 byB3b3JrIGZhc3QuIEJ1dCB0aGUgdXNlciB0aW1lIGhlcmUKaXMgcXVpdGUgYWNjdXJhdGUuCm51 bSAgY2FsbHMgICAgICAgICAgICAgICAgdGltZSAgICAgICAgICAgICAgICAgICAgICAgc2VsZiAg ICAgICAgICAgIG5hbWUKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KIDEpICA4MjggICAgICAg NDM5NjIsMDkgICAgNTMsMDkgICA0OCwwOSUgIDQzOTYyLDA5ICAgIDUzLDA5ICAgNDgsMDklICBf bmxpc3RfcHJpbnRfd2l0aF9hbnNpCiAyKSAgICAxICAgICAgIDkxNDA2LDMzIDkxNDA2LDMzICAg OTksOTklICA0MDMyNywzOSA0MDMyNywzOSAgIDQ0LDEyJSAgbi1saXN0CiAzKSAgIDM2ICAgICAg IDUwMjk1LDc3ICAxMzk3LDEwICAgNTUsMDIlICAgNjMzMyw2OCAgIDE3NSw5NCAgICA2LDkzJSAg bi1saXN0LWRyYXcKIDQpICAgMzYgICAgICAgICA2MDIsODAgICAgMTYsNzQgICAgMCw2NiUgICAg NTM4LDYzICAgIDE0LDk2ICAgIDAsNTklICBuLWxpc3QtaW5wdXQKIDUpICAgMzYgICAgICAgICAx MDgsNTMgICAgIDMsMDEgICAgMCwxMiUgICAgIDg0LDMxICAgICAyLDM0ICAgIDAsMDklICBfbmxp c3Rfc2V0dXBfdXNlcl92YXJzCiA2KSAgIDM2ICAgICAgICAgIDYzLDUzICAgICAxLDc2ICAgIDAs MDclICAgICA2Myw1MyAgICAgMSw3NiAgICAwLDA3JSAgX25saXN0X3N0YXR1c19tc2cKIDcpICAg IDQgICAgICAgICAgNjIsMjQgICAgMTUsNTYgICAgMCwwNyUgICAgIDYyLDI0ICAgIDE1LDU2ICAg IDAsMDclICBfbmxpc3RfY3Vyc29yX3Zpc2liaWxpdHkKIDgpICAgMzQgICAgICAgICAgMjQsMjIg ICAgIDAsNzEgICAgMCwwMyUgICAgIDI0LDIyICAgICAwLDcxICAgIDAsMDMlICBfbmxpc3RfY29t cHV0ZV91c2VyX3ZhcnNfZGlmZmVyZW5jZQooIG4tcGFuZWxpemUgPCB+L2xzb2Zsc29mOyApICA4 NCw2MHMgdXNlciAwLDQycyBzeXN0ZW0gOTAlIGNwdSAxOjMzLDc4IHRvdGFsCgpSRVM6IDQwME0K --e89a8f235015c6c1560521fc217c--