Static IP - Everything routed via London

I recently got Hyperoptic installed, I live in Manchester. Yet it seems everything is routed by London.

When I was on a CNat it seemed things were breaking out from Manchester.

Is there any reason for this, and can it change? Seems crazy to route all down to London for it to have to come back up for local connections.

I'm in Manchester too (hello!) and also have a static IP.

$traceroute www.manchester.ac.uk
traceroute to mhn.mc.man.ac.uk (130.88.98.244), 64 hops max, 52 byte packets
1 firewall.manchester.<snipped-my-domain>.co.uk (192.168.34.254) 2.752 ms 0.963 ms 1.230 ms
2 141.0.<snip>.bcube.co.uk (141.0.<snip>) 4.639 ms 5.623 ms 4.277 ms
3 172.16.23.106 (172.16.23.106) 2.531 ms 2.274 ms 2.188 ms
4 172.16.30.164 (172.16.30.164) 3.833 ms 16.692 ms 15.493 ms
5 172.16.17.81 (172.16.17.81) 1.829 ms 1.698 ms 1.683 ms
6 * * *
7 ae22.manckh-sbr1.ja.net (146.97.35.189) 8.174 ms 7.046 ms 8.773 ms
8 ae23.mancrh-rbr1.ja.net (146.97.38.42) 6.942 ms 6.867 ms 6.851 ms
9 ae31.mancwh-rbr1.ja.net (146.97.78.34) 7.286 ms 7.446 ms 7.310 ms
10 universityofmanchester.ja.net (146.97.169.6) 7.235 ms 7.413 ms 7.250 ms
11 130.88.249.185 (130.88.249.185) 7.641 ms 7.715 ms 7.577 ms
12 gw-jh.cnw.its.manchester.ac.uk (130.88.249.178) 7.843 ms 8.080 ms 7.949 ms


Looks to be Manchester all the way for that; prior to CGNat the pings were a lot lower - where now the ping for the final hop is 7.8msec, it used to be perhaps 1.5-2msec instead.

There's a fair bit which should still use IX Manchester - there are quite a few big companies peering there (BBC, Apple).

Do you ever get a result off hop 6? That's the peer between you and ja.net

The 172.16 addresses are nothing to do with NAT - just internal addresses used for the internal network hops before breaking out to the real world. No problems and no affect in doing that on end user connections.

I now seem to!
Here are a few traceroutes. When they started just returning a solid sea of asterisks I truncated them:

traceroute news.bbc.co.uk
traceroute: Warning: news.bbc.co.uk has multiple addresses; using 212.58.244.56
traceroute to newswww.bbc.net.uk (212.58.244.56), 64 hops max, 52 byte packets
1 firewall (192.168.34.254) 2.170 ms 1.621 ms 2.651 ms
2 141.0.151.snip.bcube.co.uk (141.0.151.snip) 34.970 ms 5.312 ms 4.401 ms
3 172.16.23.106 (172.16.23.106) 2.579 ms 2.223 ms 4.251 ms
4 172.16.27.124 (172.16.27.124) 5.731 ms 12.921 ms 2.291 ms
5 172.16.30.164 (172.16.30.164) 2.410 ms 2.352 ms 1.950 ms
6 172.16.17.81 (172.16.17.81) 1.559 ms 4.645 ms 1.550 ms

traceroute www.manchester.ac.uk
traceroute to mhn.mc.man.ac.uk (130.88.98.244), 64 hops max, 52 byte packets
1 firewall (192.168.34.254) 2.301 ms 1.014 ms 1.138 ms
2 141.0.151.snip.bcube.co.uk (141.0.151.snip) 5.374 ms 4.984 ms 4.282 ms
3 172.16.23.106 (172.16.23.106) 2.470 ms 2.756 ms 2.583 ms
4 172.16.27.124 (172.16.27.124) 4.563 ms 13.420 ms 1.907 ms
5 172.16.30.164 (172.16.30.164) 9.085 ms 1.892 ms 2.071 ms
6 172.16.17.81 (172.16.17.81) 2.148 ms 2.509 ms 1.920 ms
7 * * *
8 ae22.manckh-sbr2.ja.net (146.97.35.189) 9.687 ms 9.141 ms 9.261 ms
9 ae23.mancrh-rbr1.ja.net (146.97.38.42) 9.486 ms 9.800 ms 9.706 ms
10 ae31.mancwh-rbr1.ja.net (146.97.78.34) 10.052 ms 10.028 ms 9.604 ms
11 universityofmanchester.ja.net (146.97.169.6) 9.385 ms 9.354 ms 9.619 ms
12 130.88.249.185 (130.88.249.185) 9.790 ms 10.927 ms 11.156 ms
13 gw-jh.cnw.its.manchester.ac.uk (130.88.249.178) 11.765 ms 12.539 ms 12.410 ms
14 * * *
15 * * *

traceroute s3-eu-west-1.amazonaws.com
traceroute to s3-eu-west-1.amazonaws.com (52.218.16.140), 64 hops max, 52 byte packets
1 firewall (192.168.34.254) 1.537 ms 1.030 ms 0.914 ms
2 141.0.151.snip.bcube.co.uk (141.0.151.snip) 6.357 ms 5.151 ms 4.317 ms
3 172.16.23.106 (172.16.23.106) 3.169 ms 2.410 ms 2.251 ms
4 172.16.27.124 (172.16.27.124) 2.396 ms 2.140 ms 3.785 ms
5 172.16.30.164 (172.16.30.164) 3.424 ms 2.017 ms 1.917 ms
6 172.16.17.81 (172.16.17.81) 1.876 ms 1.704 ms 1.556 ms
7 ae2-775.cr1-man1.ip4.gtt.net (77.67.123.169) 76.941 ms 10.201 ms 9.264 ms
8 xe-4-1-0.cr5-lon2.ip4.gtt.net (89.149.186.113) 9.442 ms 11.528 ms 10.001 ms
9 ip4.gtt.net (46.33.83.194) 12.216 ms 12.474 ms 11.471 ms
10 * * *
11 * * *
12 176.32.106.242 (176.32.106.242) 18.990 ms * *
13 * * *

Note that sometimes you can route directly from Manchester to Dublin (hops 7 and 8)

traceroute www.heanet.ie
traceroute to iconia.heanet.ie (193.1.219.81), 64 hops max, 52 byte packets
1 firewall (192.168.34.254) 1.399 ms 0.979 ms 2.746 ms
2 141.0.151.snip.bcube.co.uk (141.0.151.snip) 5.120 ms 5.014 ms 4.413 ms
3 172.16.23.106 (172.16.23.106) 2.899 ms 2.668 ms 3.234 ms
4 172.16.27.124 (172.16.27.124) 2.987 ms 10.852 ms 2.154 ms
5 172.16.30.164 (172.16.30.164) 2.353 ms 5.494 ms 2.539 ms
6 172.16.17.81 (172.16.17.81) 1.626 ms 2.667 ms 1.547 ms
7 ae2-775.cr1-man1.ip4.gtt.net (77.67.123.169) 11.172 ms 11.764 ms 12.931 ms
8 xe-9-3-0.cr0-dub4.ip4.gtt.net (141.136.110.225) 18.647 ms 17.345 ms 16.947 ms
9 heanet-gw.ip4.gtt.net (77.67.64.238) 14.913 ms 14.898 ms 15.015 ms
10 et9-3-0-0.core1-pw.nn.hea.net (87.44.50.73) 14.657 ms 14.941 ms 15.172 ms
11 bundle-ether700.cr2-pw.nn.hea.net (87.44.50.0) 17.817 ms 17.772 ms 15.601 ms
12 te5-1-blanch-sr2.services.hea.net (193.1.237.2) 23.049 ms 23.283 ms 25.285 ms

Edited by deleted (Wed 31-Jan-18 23:55:07)

IXManchester is absolutely tiny tbh and fibre backhaul between london and manchester is ridiculously cheap, though does seem psychologically like a waste.

https://www.peeringdb.com/ix/583

Amazon at 100G; Apple ad Akamai both at 40G; Talktalk 30G; BBC at 20G; Cloudflare, Janet, Vodafone and Virgin Media at 10G.. it's shoving around 60Gbit/sec around (https://www.linx.net/ix-manchester/tech-info-help/traffic-stats)

... okay, smaller than Linx, or AMS-IX for sure, but I disagree that it's absolutely tiny.

Ok, definitely got bigger than I thought. IXScotland is ~300mbit/sec, so a single hyperoptic user could potentially triple the throughput!

It's 2% the size of LINX. I think that's pretty tiny as far as IXs go.

Have you actually checked the size of IXScotland lately...? It would take a good few Hyperoptic users to triple the peak. BBC for example have 10Gb of capacity there...

https://portal.linx.net/

You sure?

I never responded again here, but when I contacted Hyperoptic they allocated me a static IP which routed out via Manchester instead.