CastRay Latency

I noticed a delay when using the castray op, any idea why there is such a latency ? feels a bit sluggish when using it as a mouse hit test.

edit, maybe the mouse readback has a general latency and it becomes more obvious in this case. although it looks like up to 5 frames, which is a lot.