Router stats, attenuation, noise margin and connection speed are a good place to start with looking into this.
If your 9 miles to the exchange is correct, then almost a world record to get a working ADSL signal. If those in the town are on the same exchange as you and the same provider too, and they have lower latency the suggestion is that issue may be line based.
A ping of 55 to 60ms if consistently that level should not cause problems in online FPS type gaming, you just have to learn to lead the action slightly. If you are playing with voice or other activity on the line that may be the issue.