[Buildbot-commits] [SPAM] [Buildbot] #829: Buildbot 0.8.0rc2 waterfall is unusably slow

[Buildbot]

#829: Buildbot 0.8.0rc2 waterfall is unusably slow
---------------------+------------------------------------------------------
Reporter:  bdbaddog  |       Owner:           
    Type:  defect    |      Status:  new      
Priority:  major     |   Milestone:  undecided
 Version:  0.8.0     |    Keywords:           
---------------------+------------------------------------------------------
 Using Peforce, with > 100k changes total.
 10 builders.
 8 win32 on a single slave.
 2 linux on a single slave.

 When buildbot peg's the cpu, strace shows it's reading the sqlite
 database.

 It may be that the database needs another/more indexes?

 Strace shows this:
 read(10, "\r\0\0\0\16\0<\0\3\271\3q\3,\2\347\2\242\2]\2\30\1\323"...,
 1024) = 1024
 _llseek(10, 245733376, [245733376], SEEK_SET) = 0
 read(10, "\r\0\0\0\r\0V\0\3\272\3w\0030\2\345\2\233\2V\2\21\1\310"...,
 1024) = 1024
 _llseek(10, 245734400, [245734400], SEEK_SET) = 0
 read(10, "\r\0\0\0\r\0,\0\3\270\3h\3\36\2\323\2\206\2:\1\360\1\246"...,
 1024) = 1024
 _llseek(10, 245735424, [245735424], SEEK_SET) = 0
 read(10, "\r\0\0\0\16\0001\0\3\266\3l\3\"\2\333\2\210\2L\2\16\1\317"...,
 1024) = 1024
 _llseek(10, 245736448, [245736448], SEEK_SET) = 0
 read(10, "\r\0\0\0\16\0U\0\3\272\3t\3.\2\346\2\240\2c\2\'\1\344\1"...,
 1024) = 1024
 _llseek(10, 245737472, [245737472], SEEK_SET) = 0
 read(10, "\r\0\0\0\16\0>\0\3\276\3\177\3@\3\4\2\305\2\203\2B\1\373"...,
 1024) = 1024
 _llseek(10, 245738496, [245738496], SEEK_SET) = 0
 read(10, "\r\0\0\0\r\0<\0\3\263\3b\3\30\2\314\2\202\0028\1\351\1"...,
 1024) = 1024
 _llseek(10, 245739520, [245739520], SEEK_SET) = 0
 read(10, "\r\0\0\0\r\0a\0\3\264\3h\3+\2\343\2\234\2T\2\f\1\305\1"...,
 1024) = 1024
 _llseek(10, 245740544, [245740544], SEEK_SET) = 0
 ....


 Where filehandel 10 is
  10 -> /opt/local/buildbot/state.sqlite

 Please let me know what additional information I can provide.

-- 
Ticket URL: <http://buildbot.net/trac/ticket/829>
Buildbot <http://buildbot.net/>
Buildbot: build/test automation