Media agent Loopback latency

I am working on some performance issues with my backups.

Looking at the media agents during the backups, looking a the media/proxy agents I am seeing what I think is high latency on the loopback adaptor.   in the screen shot below you can see in in Windows resource monitor the latency for vsbkp, cvd and other processes are around 30ms.   The loopback adaptor is internal to the server, never touching a ethernet switch or wire, so I would think it should be much lower right?

I am wondering what type of latency other folks are seeing on their media agent and or proxy agents during backups?

Thank you ahead of time!