They will not be the source - that will be other devices, cross talk, radio, fridge, motors .... the wires just pick up that and there is no easy or cheap solution. It happens on all lines - just that some are worse than others.
You were right. I opened up the connection box and cleaned up the connections. Line stats are now:
19999 up
74000 down
Noise margin 7.4 dB
I assume I'm capped at 74 mbps