Re: Slowdown around 5.0.5-dev-0

[Sebastian Gniazdowski <sgniazdowski@gmail.com>]

[-- Attachment #1: Type: text/plain, Size: 1986 bytes --]

I attach my results for the same builds as yours. Tried to calibrate
the running time and I ended up running really long tests (quite
exhausting to move mouse every few minutes as my screensaver is broken
and always turns on after few minutes). Will try to calibrate again
later, and I also am running the same tests on a ubuntu netbook. Few
conclusions:

> Running [zsh-5.0.7]:                     string_test      48631,87
> Running [zsh-5.0.8]:                     string_test      86302,14

This says there something happened after 5.0.7 and reveals itself on
OS X, could try to track it with bisect.

> Running [zsh-5.1]:                       string_test      86698,42
> Running [zsh-head-8e9a68a]:              string_test      38887,54
> Running [zsh-36926]:                     string_test      86497,62

This says 36926 doesn't include string boost up (at cost of memory
use) that current head has.

> Running [zsh-5.1]:                       search_test      51321,70
> Running [zsh-head-8e9a68a]:              search_test      10071,26
> Running [zsh-36926]:                     search_test      10260,60

This says that pattern maching boost up is retained.

> Running [zsh-5.1]:                       function_test    49070,83
> Running [zsh-head-8e9a68a]:              function_test    56299,14
> Running [zsh-36926]:                     function_test    54456,34

This informs about slowdown caused by newheaps patch, and points that
36926 can make it smaller.


I also did memory tests:

> # Tests for zsh-head-8e9a68a
> # string_test 42, 182, 318, 457, 590, 720, last: 10
> string_test 317.8

This informs about the 36834 problem with memory.

> # Tests for zsh-36926
> # string_test 2.1, 6.6, 8.6, 10, 10, 11, 9.5, 11, 11, 11, 11, 11, last: 9.6
> string_test 9.3

This shows it's solved.

> # search_test 110, 215, last: 265
> search_test 110.0

This is the high memory usage when matching patterns in large arrays
you mentioned.

Best regards,
Sebastian Gniazdowski

[-- Attachment #2: perf-test-36926.txt --]
[-- Type: text/plain, Size: 2480 bytes --]

2.3 Intel Core i5, 8 GB RAM, OS X 10.9.2

Pass 1:

Running [zsh-5.0.7]:                     string_test      48631,87
Running [zsh-5.0.8]:                     string_test      86302,14
Running [zsh-5.1]:                       string_test      87970,33
Running [zsh-36926]:                     string_test      86682,35

Running [zsh-5.0.7]:                     array_test       87699,03
Running [zsh-5.0.8]:                     array_test       91540,41
Running [zsh-5.1]:                       array_test       82907,69
Running [zsh-36926]:                     array_test       82203,27

Running [zsh-5.0.7]:                     function_test    44150,02
Running [zsh-5.0.8]:                     function_test    47915,24
Running [zsh-5.1]:                       function_test    48448,95
Running [zsh-36926]:                     function_test    57126,86

Running [zsh-5.0.7]:                     search_test      55862,93
Running [zsh-5.0.8]:                     search_test      51480,07
Running [zsh-5.1]:                       search_test      51027,38
Running [zsh-36926]:                     search_test      10274,11

Pass 2:

Running [zsh-5.0.7]:                     string_test      48799,25
Running [zsh-5.0.8]:                     string_test      86682,21
Running [zsh-5.1]:                       string_test      86698,42
Running [zsh-head-8e9a68a]:              string_test      38887,54
Running [zsh-36926]:                     string_test      86497,62

Running [zsh-5.0.7]:                     array_test       86754,03
Running [zsh-5.0.8]:                     array_test       82451,51
Running [zsh-5.1]:                       array_test       82880,56
Running [zsh-head-8e9a68a]:              array_test       82276,80
Running [zsh-36926]:                     array_test       83075,01

Running [zsh-5.0.7]:                     function_test    45516,67
Running [zsh-5.0.8]:                     function_test    49122,46
Running [zsh-5.1]:                       function_test    49070,83
Running [zsh-head-8e9a68a]:              function_test    56299,14
Running [zsh-36926]:                     function_test    54456,34

Running [zsh-5.0.7]:                     search_test      57267,29
Running [zsh-5.0.8]:                     search_test      50841,91
Running [zsh-5.1]:                       search_test      51321,70
Running [zsh-head-8e9a68a]:              search_test      10071,26
Running [zsh-36926]:                     search_test      10260,60


[-- Attachment #3: mem-test-36926.txt --]
[-- Type: text/plain, Size: 1779 bytes --]

2.3 Intel Core i5, 8 GB RAM, OS X 10.9.2

# Tests for zsh-5.0.7
# string_test 5.8, 10, 12, 11, 11, 12, last: 11
string_test 10.0
# array_test 1.3, 2.3, 3.2, 3.9, 4.3, 5.2, 6.2, 7.3, 7.7, 8.1, 8.3, 8.6, last: 8.7
array_test 5.3
# function_test 2.7, 2.8, 2.8, 2.8, 2.8, 2.8, last: 2.8
function_test 2.8
# search_test 65, 117, 149, 175, 198, 219, 238, last: 257
search_test 153.8


# Tests for zsh-5.0.8
# string_test 2.1, 6.7, 8.6, 10, 10, 11, 9.5, 10, 11, 11, 11, 11, last: 9.6
string_test 9.2
# array_test 1.2, 2.1, 3.3, 3.7, 4.4, 5.4, 6.4, 7.1, 7.8, 8.1, 8.4, 8.6, last: 8.9
array_test 5.3
# function_test 2.5, 2.6, 2.5, 2.6, 2.5, 2.5, last: 2.5
function_test 2.5
# search_test 60, 126, 159, 187, 212, 235, last: 256
search_test 148.8


# Tests for zsh-5.1
# string_test 2.4, 7.1, 8.8, 10, 10, 11, 9.7, 10, 11, 11, 12, 11, last: 10
string_test 9.4
# array_test 1.1, 2.4, 2.9, 3.5, 4.3, 5.3, 6.3, 7.1, 7.8, 8.1, 8.4, 8.7, last: 8.8
array_test 5.2
# function_test 2.5, 2.6, 2.6, 2.6, 2.6, 2.6, 2.6, last: 2.6
function_test 2.6
# search_test 60, 125, 158, 186, 211, 234, 256, last: 257
search_test 162.3


# Tests for zsh-head-8e9a68a
# string_test 42, 182, 318, 457, 590, 720, last: 10
string_test 317.8
# array_test 1, 2.5, 3, 4, 4.5, 5.2, 6.3, 7.3, 7.8, 8.2, 8.4, 8.7, last: 8.8
array_test 5.3
# function_test 2.6, 2.7, 2.6, 2.9, 2.8, 2.9, 2.7, 2.8, last: 2.5
function_test 2.7
# search_test 106, 213, last: 264
search_test 106.0


# Tests for zsh-36926
# string_test 2.1, 6.6, 8.6, 10, 10, 11, 9.5, 11, 11, 11, 11, 11, last: 9.6
string_test 9.3
# array_test 1.2, 2.6, 3.1, 3.7, 4.4, 5.5, 6.5, 7.3, 8, 8.3, 8.5, 8.9, last: 9.1
array_test 5.4
# function_test 2.9, 2.7, 2.7, 2.8, 2.9, 2.9, 2.9, 2.7, last: 2.6
function_test 2.8
# search_test 110, 215, last: 265
search_test 110.0