Generally a sign of High Resistance fault, caused by dodgy joint, or water ingress.
Eventually they often start to affect the broadband all the time rather than when you just answer the phone.
They can be difficult to fault find but improved tests should allow the right engineer to spot them