What you're all describing are the effects of bufferbloat. There are too many, unnecessarily large buffers in far too many network devices between you and the destination. TCP by its very definition, given sufficient CPU power, will fill up any buffer given enough time. Once the buffer is full then your packet, whatever size, whatever priority will have to wait its turn in the queue as data drains away down the slow pipe.
The trick is to manage the queue/s and not quite fill the pipe, thus latency (which is the measure you are using to measure how 'sticky' your network connection is) can be controlled. Once latency is managed, interactive/time critical packets can be interwoven amongst the longer term 'but hog all the bandwidth' data flows. The huge 'elephant' flows as they are known can be managed by dropping packets to tell the other end to slow down.
This allows space for the 'ants' (DNS, ICMP, VOIP, TCP/SYN/ACK - small usually single packet but desperately important) and 'mice' (Short, small transfers) to do their work and give the interactive (ie low latency) experience you actually required.
Google for cerowrt, Dave Taht, Jim Gettys, bufferbloat, 'tcp ants mice elephants', fq_codel.
https://gettys.wordpress.com/bufferbloat-faq/
The cerowrt bufferbloat project fed a lot of information back into the mainline Linux kernel, and latest versions of openwrt with 'SQM Scripts' (for fq_codel queue management) do extremely well in managing latency and perceived performance of bloated edge of internet routers.
If that doesn't scare you then the talk
http://cyber.law.harvard.edu/events/luncheon/2014/06... certainly should!
Friends don't let friends run factory firmware.
Ignore the red bits and anything pre 12:00 but at 1830ish I started a 2GB 'one drive' upload along with a 1GB Ubuntu image download (that's the 6min duration slightly higher latency spike) Interactive performance during this time has been pretty much unaffected. This is on a 40/10 Sky IPv4 link with a HG612 modem with TP-Link Archer C7 AC1750 running Openwrt CC latest trunk (as of 12:00 today ish) and SQM scripts - SQM limits are set to 38000 down & 9500 up respectively.
Oh and then one of the machines upstairs started doing some sort of automatic download...all pretty much unnoticeable.
My Broadband Ping
Edited by deleted (Tue 14-Apr-15 20:05:28)