Reduce UI affects on reported latency

Scrolling a lot can cause the latency to increase for some packets. I suspect this is an implementation artifact and not actually an increase in the network latency. Maybe we can run the latency gathering code in a web worker or something to reduce the effect?