Could well be cross talk and it does not need large numbers, just someone in a cable bundle with a pair close enough to affect you.

Why only downstream - crosstalk is not uniform in its behaviour, or another option is some noise source impacting has cost you some speed.

Thanks Mr Saffron, is it worth raising the issue of speeds with BT, or will they just say 'its's in the range expected'?