https://i.ibb.co/HTXzKBgr/18719371786.png (you can see download latency 15ms is fine but upload latency is pretty high at 96ms) as someone at Plusnet upload was spot on perfectly at 9ms see below:
https://i.ibb.co/sLCPSPq/fv8z0dv-md.jpg
(Those image links don't work for me)
There's isn't really any such thing as "upload latency" or "download latency"; in any case, both are round-trip times.
What I believe you're saying is, you're seeing latency peaks during uploads and downloads. That's to be expected: you're saturating the link in one direction or the other. Queues of packets are building up, and so any latency test probles (e.g. pings) are having to sit behind all those other packets in the queue and wait their turn to be transmitted. The colloquial term for this behaviour is "buffer bloat".
It's easier to fill the packet queues in the upload direction, since your upload speed is 1/10th of your download speed; the queues empty 10 times more slowly. That's why you notice it more.
Generally, it's not a problem, it is normal behaviour. However, if you want to "improve" this, what you can do is to limit the upload speed on your router to say 95% of your upstream bandwidth, so there's always a small amount free, and configure fair queueing so that small flows can queue-jump the large flows.
You need a good router to do that. On my Mikrotik I use:
| Text |
1
23
4 | /queue type
add kind=sfq name=sfq-default sfq-perturb=10/queue simple
add dst=pppoe-out2 max-limit=50M/330M name=nuc1 queue=sfq-default/default target=10.12.0.0/16,XXXX:XXXX:XXXX:XX00::/56 |
(where those IPs are the LAN-side IPs on my network). My actual measured upload speed is 52M, so 50M is just below this. sfq = stochastic fairness queuing. The gory details are
here.
The result is I get (very slightly) better performance on interactive SSH sessions, if there is a heavy upload going on. The trade-off is that the heavy uploads take slightly longer to complete.
Is this worth it for normal users? Very likely not. But I hope it helps you understand what you're observing. It's not a problem with your equipment or your ISP.