[Buildbot] #3272: Buildbot start-up time starts to tip-over once there logs for ~3000 builds in a builder (especially if a build has lots of steps)

[Buildbot trac]

#3272: Buildbot start-up time starts to tip-over once there logs for ~3000 builds
in a builder (especially if a build has lots of steps)
------------------------+------------------------
Reporter:  vlovich      |       Owner:
    Type:  defect       |      Status:  new
Priority:  major        |   Milestone:  undecided
 Version:  0.8.10       |  Resolution:
Keywords:  performance  |
------------------------+------------------------

Comment (by vlovich):

 Another idea: perhaps you can just get a build number & just increment
 manually & do an isdir().  That might make it O(M) too.  Don't know how
 big a concern gaps in the logfiles are.

 You'd have to add a dependency on the scandir module though since there's
 no other efficient mechanism in python to iterate incrementally through a
 directory.

--
Ticket URL: <http://trac.buildbot.net/ticket/3272#comment:2>
Buildbot <http://buildbot.net/>
Buildbot: build/test automation