Vighy, doesn't Firebug give you a proper latency graph for what delays what? At least Opera Dragonfly does, if you're willing to install Opera 12 to test.