New Infrastructure: Mostly Complete

New Infrastructure: Mostly Complete

[Jason]

Hi folks,

Our home has moved to some shiny new multi-core hardware in a
highspeed datacenter. Expect less downtime on git.zx2c4.com, as well
as proper git:// access to the repositories.

zx2c4 at thinkpad ~ $ git clone git://git.zx2c4.com/cgit
Cloning into 'cgit'...
remote: Counting objects: 4412, done.
remote: Compressing objects: 100% (1552/1552), done.
remote: Total 4412 (delta 3180), reused 3923 (delta 2852)
Receiving objects: 100% (4412/4412), 771.26 KiB | 661 KiB/s, done.
Resolving deltas: 100% (3180/3180), done.

The URL is the same as always: http://git.zx2c4.com/cgit and
http://git.zx2c4.com/cgit/about .

 Let me know if you encounter any growing pains.


Enjoy!

Jason

New Infrastructure: Mostly Complete

[mailings]

http://git.zx2c4.com/cgit/

Forbidden

You don't have permission to access /cgit/ on this server.

Additionally, a 403 Forbidden error was encountered while trying to use
an ErrorDocument to handle the request.



On 24/04/13 00:59, Jason A. Donenfeld wrote:
> Hi folks,
> 
> Our home has moved to some shiny new multi-core hardware in a
> highspeed datacenter. Expect less downtime on git.zx2c4.com, as well
> as proper git:// access to the repositories.
> 
> zx2c4 at thinkpad ~ $ git clone git://git.zx2c4.com/cgit
> Cloning into 'cgit'...
> remote: Counting objects: 4412, done.
> remote: Compressing objects: 100% (1552/1552), done.
> remote: Total 4412 (delta 3180), reused 3923 (delta 2852)
> Receiving objects: 100% (4412/4412), 771.26 KiB | 661 KiB/s, done.
> Resolving deltas: 100% (3180/3180), done.
> 
> The URL is the same as always: http://git.zx2c4.com/cgit and
> http://git.zx2c4.com/cgit/about .
> 
>  Let me know if you encounter any growing pains.
> 
> 
> Enjoy!
> 
> Jason
> 
> _______________________________________________
> cgit mailing list
> cgit at hjemli.net
> http://hjemli.net/mailman/listinfo/cgit
> 

-- 
Ferry Huberts

New Infrastructure: Mostly Complete

[normalperson]

"Jason A. Donenfeld" <Jason at zx2c4.com> wrote:
> The URL is the same as always: http://git.zx2c4.com/cgit and
> http://git.zx2c4.com/cgit/about .

Btw, I'm curious, what does zx2c4 mean?
It's hard for me to remember, and may be hard for others, too.

New Infrastructure: Mostly Complete

[lekensteyn]

On Wednesday 24 April 2013 07:10:47 Eric Wong wrote:
> Btw, I'm curious, what does zx2c4 mean?
> It's hard for me to remember, and may be hard for others, too.

I have no idea how he came up of that name, but observe that "zxc" are three 
keys next to each other. "2" and "4" are ordered numbers, it may read as "zx 
to c4" (explosive).

That's all speculation though, for a definitive answer Jason should answer :)

Peter

New Infrastructure: Mostly Complete

[mailings]

On 24/04/13 08:25, Ferry Huberts wrote:
> http://git.zx2c4.com/cgit/


seems to work now.

> 
> Forbidden
> 
> You don't have permission to access /cgit/ on this server.
> 
> Additionally, a 403 Forbidden error was encountered while trying to use
> an ErrorDocument to handle the request.
> 
> 
> 
> On 24/04/13 00:59, Jason A. Donenfeld wrote:
>> Hi folks,
>>
>> Our home has moved to some shiny new multi-core hardware in a
>> highspeed datacenter. Expect less downtime on git.zx2c4.com, as well
>> as proper git:// access to the repositories.
>>
>> zx2c4 at thinkpad ~ $ git clone git://git.zx2c4.com/cgit
>> Cloning into 'cgit'...
>> remote: Counting objects: 4412, done.
>> remote: Compressing objects: 100% (1552/1552), done.
>> remote: Total 4412 (delta 3180), reused 3923 (delta 2852)
>> Receiving objects: 100% (4412/4412), 771.26 KiB | 661 KiB/s, done.
>> Resolving deltas: 100% (3180/3180), done.
>>
>> The URL is the same as always: http://git.zx2c4.com/cgit and
>> http://git.zx2c4.com/cgit/about .
>>
>>  Let me know if you encounter any growing pains.
>>
>>
>> Enjoy!
>>
>> Jason
>>
>> _______________________________________________
>> cgit mailing list
>> cgit at hjemli.net
>> http://hjemli.net/mailman/listinfo/cgit
>>
> 

-- 
Ferry Huberts

New Infrastructure: Mostly Complete

[lekensteyn]

Hi,

On Wednesday 24 April 2013 00:59:17 Jason A. Donenfeld wrote:
> Our home has moved to some shiny new multi-core hardware in a
> highspeed datacenter. Expect less downtime on git.zx2c4.com, as well
> as proper git:// access to the repositories.
> 
> zx2c4 at thinkpad ~ $ git clone git://git.zx2c4.com/cgit
> Cloning into 'cgit'...
> remote: Counting objects: 4412, done.
> remote: Compressing objects: 100% (1552/1552), done.
> remote: Total 4412 (delta 3180), reused 3923 (delta 2852)
> Receiving objects: 100% (4412/4412), 771.26 KiB | 661 KiB/s, done.
> Resolving deltas: 100% (3180/3180), done.
> 
> The URL is the same as always: http://git.zx2c4.com/cgit and
> http://git.zx2c4.com/cgit/about .
> 
>  Let me know if you encounter any growing pains.

HTTP throws Bad Gateway and the git protocol is very slow. Counting objects 
shows up after five seconds and does not fly as with the kernel git repo or my 
personal one. The compressing objects stage advances with 4 kbit/s according 
to vnstat.

Some information that may help you:

$ host git.zx2c4.com
git.zx2c4.com is an alias for krantz.zx2c4.com.
krantz.zx2c4.com has address 192.95.5.69
krantz.zx2c4.com has IPv6 address 2607:5300:60:6b0::c05f:54

$ git clone git://git.zx2c4.com/cgit
Cloning into 'cgit'...
remote: Counting objects: 4419, done.
remote: Compressing objects: 100% (1559/1559), done.
remote: Total 4419 (delta 3181), reused 3922 (delta 2851)
Receiving objects: 100% (4419/4419), 784.10 KiB | 73 KiB/s, done.
Resolving deltas: 100% (3181/3181), done.

$ time git clone git://192.95.5.69/cgit 
Cloning into 'cgit'...
remote: Counting objects: 4419, done.
remote: Compressing objects: 100% (1559/1559), done.
remote: Total 4419 (delta 3181), reused 3922 (delta 2851)
Receiving objects: 100% (4419/4419), 784.10 KiB | 91 KiB/s, done.
Resolving deltas: 100% (3181/3181), done.

real    1m40.357s
user    0m0.124s
sys     0m0.156s

$ time git clone git://[2607:5300:60:6b0::c05f:545]/cgit                                                                                                                                                           
Cloning into 'cgit'...                                                                                                                                                                                                           
remote: Counting objects: 4419, done.
remote: Compressing objects: 100% (1559/1559), done.
remote: Total 4419 (delta 3181), reused 3922 (delta 2851)
Receiving objects: 100% (4419/4419), 784.10 KiB | 67 KiB/s, done.                                                                                                                                                                
Resolving deltas: 100% (3181/3181), done.                                                                                                                                                                                        
                                                                                                                                                                                                                                 
real    1m20.684s                                                                                                                                                                                                                
user    0m0.120s                                                                                                                                                                                                                 
sys     0m0.164s 

This is from the Netherlands.

Thanks,
Peter

New Infrastructure: Mostly Complete

[Jason]

Hi Peter,

I'm unable to reproduce this over here -- either the slow compressing stage
nor the HTTP gateway timeout errors.

zx2c4 at thinkpad ~ $ time git clone http://git.zx2c4.com/cgit
Cloning into 'cgit'...

real    0m19.327s
user    0m0.998s
sys     0m0.579s

zx2c4 at thinkpad ~ $ time git clone git://git.zx2c4.com/cgit
Cloning into 'cgit'...
remote: Counting objects: 4419, done.
remote: Compressing objects: 100% (1559/1559), done.
remote: Total 4419 (delta 3181), reused 3922 (delta 2851)
Receiving objects: 100% (4419/4419), 784.10 KiB | 387 KiB/s, done.
Resolving deltas: 100% (3181/3181), done.

real    0m1.749s
user    0m0.184s
sys     0m0.079s

Is the issue still occurring for you? If so, would you sign into #cgit on
freenode and we can help triage this together?

Thanks,
Jason

New Infrastructure: Mostly Complete

[Jason]

Some benchmarks on cgit's web frontend (not clone url):

zx2c4 at metheny ~ $ ab -n 1000 -c 50 http://git.zx2c4.com/cgit
This is ApacheBench, Version 2.3 <$Revision: 1430300 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking git.zx2c4.com (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Completed 1000 requests
Finished 1000 requests


Server Software:        ZX2C4
Server Hostname:        git.zx2c4.com
Server Port:            80

Document Path:          /cgit
Document Length:        10848 bytes

Concurrency Level:      50
Time taken for tests:   8.722 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      11075000 bytes
HTML transferred:       10848000 bytes
Requests per second:    114.65 [#/sec] (mean)
Time per request:       436.099 [ms] (mean)
Time per request:       8.722 [ms] (mean, across all concurrent requests)
Transfer rate:          1240.02 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    4  44.9      2    1005
Processing:   271  424  34.1    425     624
Waiting:      271  423  34.2    423     622
Total:        272  428  56.8    427    1451

Percentage of the requests served within a certain time (ms)
  50%    427
  66%    436
  75%    443
  80%    448
  90%    458
  95%    468
  98%    487
  99%    575
 100%   1451 (longest request)

zx2c4 at metheny ~ $ ab -n 1000 -c 50 http://git.zx2c4.com/linux/log/
This is ApacheBench, Version 2.3 <$Revision: 1430300 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking git.zx2c4.com (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Completed 1000 requests
Finished 1000 requests


Server Software:        ZX2C4
Server Hostname:        git.zx2c4.com
Server Port:            80

Document Path:          /linux/log/
Document Length:        15250 bytes

Concurrency Level:      50
Time taken for tests:   34.149 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      15477000 bytes
HTML transferred:       15250000 bytes
Requests per second:    29.28 [#/sec] (mean)
Time per request:       1707.473 [ms] (mean)
Time per request:       34.149 [ms] (mean, across all concurrent requests)
Transfer rate:          442.59 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    2   2.0      2      34
Processing:   520 1674 178.2   1690    2069
Waiting:      510 1667 178.0   1683    2064
Total:        523 1676 178.1   1691    2071

Percentage of the requests served within a certain time (ms)
  50%   1691
  66%   1715
  75%   1728
  80%   1741
  90%   1774
  95%   1814
  98%   1921
  99%   1974
 100%   2071 (longest request)

New Infrastructure: Mostly Complete

[lekensteyn]

Hi Jason,

On Thursday 25 April 2013 19:08:18 Jason A. Donenfeld wrote:
> I'm unable to reproduce this over here -- either the slow compressing stage
> nor the HTTP gateway timeout errors.
I cannot reproduce it anymore, it seems to be fixed. You may want to check your 
logs to see what was going on. The cgit website is working again, cloning over 
git is fast:

$ git clone git://git.zx2c4.com/cgit
Cloning into 'cgit'...
remote: Counting objects: 4419, done.
remote: Compressing objects: 100% (1559/1559), done.
remote: Total 4419 (delta 3181), reused 3922 (delta 2851)
Receiving objects: 100% (4419/4419), 784.10 KiB | 580 KiB/s, done.
Resolving deltas: 100% (3181/3181), done.

HTTP takes more time, perhaps because it is using the "dumb" protocol? Not a 
big deal though since git:// works nicely. Thanks for the update!

> zx2c4 at thinkpad ~ $ time git clone http://git.zx2c4.com/cgit
> Cloning into 'cgit'...
> 
> real    0m19.327s
> user    0m0.998s
> sys     0m0.579s
> 
> zx2c4 at thinkpad ~ $ time git clone git://git.zx2c4.com/cgit
> Cloning into 'cgit'...
> remote: Counting objects: 4419, done.
> remote: Compressing objects: 100% (1559/1559), done.
> remote: Total 4419 (delta 3181), reused 3922 (delta 2851)
> Receiving objects: 100% (4419/4419), 784.10 KiB | 387 KiB/s, done.
> Resolving deltas: 100% (3181/3181), done.
> 
> real    0m1.749s
> user    0m0.184s
> sys     0m0.079s

Regards,
Peter