BT Network failure?

I have suddenly started to get some connections timing out, Pings fail and Tracerts time out at the same point and
Downforeveryone suggests the sites are up. One of the sites is Wiki: en.wikipedia.com

7 10 ms 9 ms 9 ms acc1-10GigE-0-2-0-4.l-far.21cn-ipp.bt.net [109.159.249.97]
8 10 ms 10 ms 9 ms core4-te0-9-0-18.faraday.ukcore.bt.net [109.159.249.11]
9 11 ms 10 ms 10 ms peer2-et-9-1-0.telehouse.ukcore.bt.net [213.121.193.167]
10 * * * Request timed out.

7 10 ms 9 ms 9 ms acc1-10GigE-0-0-0-4.l-far.21cn-ipp.bt.net [109.159.249.66]
8 12 ms 11 ms 10 ms core4-te0-0-0-18.faraday.ukcore.bt.net [109.159.249.45]
9 11 ms 10 ms 10 ms peer1-xe1-0-0.faraday.ukcore.bt.net [213.121.193.165]
10 * * * Request timed out.

Whereas with a site I can access:

7 10 ms 9 ms 9 ms acc1-te0-0-0-12.l-far.21cn-ipp.bt.net [109.159.249.84]
8 11 ms 13 ms 9 ms core3-te0-0-0-19.faraday.ukcore.bt.net [109.159.249.43]
9 10 ms 9 ms 9 ms 213.137.183.36
10 * 67 ms 67 ms t2c3-xe-11-0-2-0.uk-lon1.eu.bt.net [166.49.208.18]

Anyone else having issues?

Yes, me

When I posted there was nothing on the BT status line, however it is there now. One site I cannot access is the BT on-line status update page.

Issues here too - Exchange LCLAN.
everything very slow or times out, but the BT speedtest returns normal results?

Yep.. problems in Bedford also.

Yes there is a 98% failure it seems

Confusing for some the speed test in the BT app still gives a good result.

At least its not just me...

Spoke with BT first thing who said there's no issues in my area (East Scotland) although as usual they said it could be because i'm connecting by Wi-Fi instead of wired....

Major difficulties since about 8am

Large scale electrical storms NEngland/Central Scotland

Yup. Speedtest working fine, but some sites are extremely slow. A pal in Glenrothes (central) has no BB at all. Not sure if related.

Lots of thunder and lightning here today.

Reported on BT Care

BT Care Twitter

Some BT Broadband customers have reported problems accessing websites this morning. Sorry, we're aware of a problem ; working to fix asap. BTCare (@BTCare)

Edited by deleted (Wed 20-Jul-16 09:31:56)

A had all sorts of problems for a couple of hours or so including very intermittent performance from this site and BBC. Facebook was unreachable but is back now (Twitter worked though).

It points to something unpleasant having gone on deep in the core network which I hope has been resolved. as usual with these things experience can vary from one part of the country to another (I'm in the South East).

Looking at speed test results all looks normal again

But issues are still there for some sites depending on where the BT network feeds them

Same problem here with BT FTTP in North Hampshire. Our call centre in Glasgow is also down. It is starting to come back now.

I am still having the problems with the same websites - Wiki, BBC, BT (parts of) along with some much smaller and niche. And the "good" ones are still performing - Google, TBB and others.

From what I can see, it is either on a connection to Faraday House or another major node directly connected to it.


edit to add:

Just done a run through various sites again and some that were good are now having problems and a coupe of problem ones are now available. Potentially some re-routing taking place on the network.

Edited by MHC (Wed 20-Jul-16 09:48:07)

I'm in Bath, had problems since about 8am,still abit iffy connecting to some sites now.

Similar problems accessing various sites.
Been experiencing it since around 8:00 this morning.

Glad it's not just me - some sites appear to be working now, but still having issues.

Whatever the problem is, it is not fixed. Wiki is currently unavailable and some odd delays before a fast page load on other sites.

Facebook was unreachable

Some good came of it then.

It looks remarkably similar to the big outage they had was it last year? Where they seemed to be in denial about there being a problem for the first day and then once they admitted there was a country-wide issue it took another day to resolve?

Almost nothing accessible here.
BT working on internet outage fix as broadband service is derailed across the UK

Edited by s_h (Wed 20-Jul-16 10:10:36)

Power cut at HEX this morning. LINX reporting it, power was restored in 2 stages and LINX is now reporting OK. No idea how wide spread the power cut is/was in HEX but anyone with kit in Telecity HEX possibly affected. This could be the cause of what we are seeing.
BT itself seems ok, its only connectivity between BT and external networks that seem to have issues. EG traceroute to BBC.co.uk dies at UKcore then 5 mins later, its ok again.
Trace from Zen to BT fine one minute, but unreachable again just now.

Farnham and Midhurst affected with a lottery of what sites you can connect to. Getting definitive information on the fault is difficult but did stumble across this site which was quite handy: http://downdetector.co.uk/problems/bt-british-telecom

Still problems here.

It seems to mostly affect sites outside of the UK. Though some UK sites seem slow to connect.

Also effecting Plusnet users.

In reply to a post by Zarjaz:

Facebook was unreachable

Some good came of it then.

LOL

Paul

Great speed test results
http://www.thinkbroadband.com/speedtest/results.html...

But without website access.......

Hitting the headlines now:

http://www.bbc.co.uk/news/technology-36844712

I question the use of the word �some�, implying a few when in fact it is almost everyone.

In reply to a post by trolleybus:

Hitting the headlines now:

http://www.bbc.co.uk/news/technology-36844712

I question the use of the word �some�, implying a few when in fact it is almost everyone.

Agreed, we even keep loosing connection to our own servers.

BT says: London - 0203,0207,0208 (estimated clear date 20/07/2016) so some time today then

Paul

In reply to a post by trolleybus:

I question the use of the word �some�, implying a few when in fact it is almost everyone.

BT always do that, the words "most" and "all" don't seem to be in their lexicon.

And to be fair, a number of BT customers won't be seeing these issues. Eg those who haven't turned their modems on yet

How is it for you now?

It is all looking ok for me now.

Paul

Seems to be better for me now - sites that weren't available to me a couple of hours ago now appear to be working.

In reply to a post by redbutcher:

Seems to be better for me now - sites that weren't available to me a couple of hours ago now appear to be working.

Yeah, it was very annoying to not be able to check our emails on our own server, loads of timeouts, but everything as far as we can see is now working for us.

Paul

Well, 100% of the systems I've used this morning, at home (Eclipse), at our church (Plusnet), and at a friends 15 miles away (Eclipse), have all been working fine. No outages or other problems.

Edited by cheshire_man (Wed 20-Jul-16 12:53:14)

Seems to be resolved - all sites that failed earlier are back and loading at full speed.

Is the problem resolved or is traffic being re-routed? At one point I heard it was "cable damage" which could mean either theft or a JCB took a liking to it!

In reply to a post by MHC:

Is the problem resolved or is traffic being re-routed? At one point I heard it was "cable damage" which could mean either theft or a JCB took a liking to it!

I read it was power failure.

Paul

Most BT locations have excellent back-up power through banks of batteries some of which will be supplemented by generators. I would be surprised if it was unless the failure was in the final internal distribution side.

Edit to add:

Just received an email which contains:

"We�re sorry that some BT and Plusnet customers experienced problems accessing some internet services this morning. Around 10 per cent of customers� internet usage was affected following power issues at one of our internet connection partners� sites in London," a spokesman said.

So yes, power, however not a BT fault ... although BT will get the blame!

Edited by MHC (Wed 20-Jul-16 13:37:48)

In reply to a post by MHC:

Most BT locations have excellent back-up power through banks of batteries some of which will be supplemented by generators. I would be surprised if it was unless the failure was in the final internal distribution side.

Edit to add:

Just received an email which contains:

"We�re sorry that some BT and Plusnet customers experienced problems accessing some internet services this morning. Around 10 per cent of customers� internet usage was affected following power issues at one of our internet connection partners� sites in London," a spokesman said.

So yes, power, however not a BT fault ... although BT will get the blame!

Yep, I read the issue was due to a Power outage at Telecity.

Paul

In reply to a post by PaulKirby:

Yep, I read the issue was due to a Power outage at Telecity.

You read that in this thread

In reference to www.theregister.co.uk/2016/07/20/telecity_power_outage_bt_offline/:

BT internet outage was our fault, says Equinix
Faulty UPS takes out 10 per cent of BT customers

Seems incredible to me that a brief power outage at a single location can cause so much disruption for so long.

Is there really that little resilience in the national network?

In reply to a post by BatBoy:

In reply to a post by PaulKirby:

Yep, I read the issue was due to a Power outage at Telecity.

You read that in this thread

I may of also seen it in this thread, but I also read it on a few news sites.

Paul

In reply to a post by RoosterUK:

Seems incredible to me that a brief power outage at a single location can cause so much disruption for so long.

Is there really that little resilience in the national network?

Its possible, say an area lost its power and the UPS there kicked in, now this UPS sends back a message saying "hey I have lost power, save everything and then shut down", now if badly setup BT's network might of received that message and started to shut stuff down, hence the outage.

I am not saying this was what happened, but it is possible.

Paul

In reply to a post by RoosterUK:

Seems incredible to me that a brief power outage at a single location can cause so much disruption for so long.

Is there really that little resilience in the national network?

I think it wasn't all that bad - 90% of traffic still was routed ok, with 10% being affected. This shows the network was actually doing pretty well despite the outage. Obviously, you cannot expect 100% when a data centre as big and significant as telecity goes offline, which means both power and backup power fails - something extremely rare.

I could still access most sites, but the traffic was being routed via europe (tracert to here showed hops in amsterdam)

Is it just me or has BT died again???

Paul

It dieded

It's not just my imagination then

In reply to a post by BatBoy:

It dieded

I cannot access anything, and TBB is very ... ... very slow and mostly times out.

My 57K6 Modem was faster than this.

Paul

In reply to a post by EddyTheDog:

It's not just my imagination then

Nope.

Paul

I can also confirm for the past hour (went down around 7:45am) I've either had extremely slow (less than 0.1Mbps) or no internet via BT Broadband on my home line and absolutely no internet at all on Zen via my business line. Both connected to same exchange but different VDSL cabinets.

Having to access internet via tethering to my mobile phone.

Very slow here in Droitwich Spa

In reply to a post by UKconfederate:

I can also confirm for the past hour (went down around 7:45am) I've either had extremely slow (less than 0.1Mbps) or no internet via BT Broadband on my home line and absolutely no internet at all on Zen via my business line. Both connected to same exchange but different VDSL cabinets.

Having to access internet via tethering to my mobile phone.

Well Twitter is now working so we can moan at BTCare LOL

Paul

In reply to a post by michaelh:

Very slow here in Droitwich Spa

Well its very slow in London, hardly no sites works including access to our server
Twitter seems to be mostly working, TBB is very slow ATM, but it working

Paul

LOL even their time is wrong...

Thu 21/07/2016 at 09:32 Ongoing Loss of Broadband and Telephone services.

So does that mean they new it was going to happen LOL.

Paul

From what I can see its packet loss so sites with less heavy graphic use may well continue to work, and email while slow should be OK.

One provider is saying on twitter a power issue in Telehouse North today

From http://www.voipfonestatus.co.uk/incidents/qh874zmmzx3y

BT have confirmed there is a major outage in Telehouse North, London affecting our interconnect. Staff are on-site to resolve the issue as quickly as possible. We will keep you updated as soon as we have more information.
Posted 21 minutes ago. Jul 21, 2016 - 09:00 BST

traceroute to thinkbroadband.com (80.249.99.130), 64 hops max, 72 byte packets
1 bthomehub (192.168.1.254) 4.194 ms 1.652 ms 1.383 ms
2 * * *
3 * * *
4 31.55.185.184 (31.55.185.184) 17.061 ms 16.224 ms 16.199 ms
5 core2-hu0-10-0-0.colindale.ukcore.bt.net (195.99.127.134) 16.583 ms 17.464 ms 16.912 ms
6 core3-hu0-14-0-7.faraday.ukcore.bt.net (195.99.127.64) 17.071 ms 17.867 ms 17.266 ms
7 213.137.183.36 (213.137.183.36) 17.068 ms 21.572 ms 16.959 ms
8 t2c3-xe-1-0-0-0.nl-ams2.eu.bt.net (166.49.208.216) 23.717 ms 24.529 ms 24.031 ms
9 * t2c4-xe-3-0-0-1.nl-ams2.eu.bt.net (166.49.237.11) 54.762 ms 53.709 ms
10 * 212.41.145.178 (212.41.145.178) 56.400 ms 53.694 ms
11 if-ae-11-2.tcore2.av2-amsterdam.as6453.net (80.231.152.25) 60.924 ms * *

Taking the same weird routing to TBB

In reply to a post by MrSaffron:

From what I can see its packet loss so sites with less heavy graphic use may well continue to work, and email while slow should be OK.

One provider is saying on twitter a power issue in Telehouse North today

Well I was thinking it was more of a routing issue.

BTCare just Tweeted:

In reference to twitter.com/BTCare/status/756056416469778432:

We�re sorry that some BT customers can't connect to some internet services today.We're working to reduce impact, engineers are on site now

I cannot even ping our server.

It also seems that Zen are re-routing their customers that was having the issue.

Zen status:

We have been made aware of issues on BT Network.

All customers connecting though London may experience drops in connectivity but then reconnect to Zen's network via other gateways.

If you are experiencing issues reconnecting, please power down your equipment for a few minutes.

BT are investigating the issue and updates will be provided when we have them.

Zen regret any inconvenience this may cause.

Paul

C:\>tracert thinkbroadband.com

Tracing route to thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms SkyRouter.Home [10.10.10.10]
2 * * * Request timed out.
3 14 ms 13 ms 13 ms be101.sky.com [2.110.9.44]
4 16 ms 15 ms 14 ms linx-gw2.thdo.ncuk.net [195.66.236.240]
5 14 ms 15 ms 15 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
6 13 ms 13 ms 13 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

C:\>

In reply to a post by BuckleZ:

Taking the same weird routing to TBB

Well the routing seems fine for me now:

tracert thinkbroadband.com

Tracing route to thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms BTHUB4 [192.168.2.253]
2 17 ms 17 ms 17 ms x.x.x.x
3 63 ms 51 ms 32 ms x.x.x.x
4 17 ms 17 ms 17 ms 217.32.147.202
5 18 ms 17 ms 17 ms 213.120.178.65
6 18 ms 18 ms 18 ms 217.41.168.107
7 18 ms 18 ms 17 ms acc1-te0-0-0-21.l-far.21cn-ipp.bt.net [109.159.249.94]
8 18 ms 18 ms 18 ms core4-te0-9-0-19.faraday.ukcore.bt.net [109.159.249.15]
9 58 ms 64 ms 60 ms peer6-BE8.telehouse.ukcore.bt.net [213.121.193.183]
10 59 ms 59 ms 58 ms linx-gw1.thn.ncuk.net [195.66.224.240]
11 58 ms 57 ms 58 ms te2-1-9.star10g.bdr-rt3.thdo.ncuk.net [80.249.97.17]
12 61 ms 61 ms 59 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
13 58 ms 58 ms 58 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.


tracert thinkbroadband.com

Tracing route to thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms BTHUB4 [192.168.2.253]
2 16 ms 16 ms 17 ms x.x.x.x
3 17 ms 17 ms 17 ms x.x.x.x
4 18 ms 17 ms 17 ms 217.32.147.202
5 17 ms 17 ms 18 ms 213.120.178.65
6 19 ms 18 ms 18 ms 217.41.168.107
7 18 ms 18 ms 18 ms acc1-te0-0-0-21.l-far.21cn-ipp.bt.net [109.159.249.94]
8 19 ms 18 ms 18 ms core4-te0-9-0-19.faraday.ukcore.bt.net [109.159.249.15]
9 59 ms 59 ms 59 ms host213-121-193-183.ukcore.bt.net [213.121.193.183]
10 59 ms 58 ms 58 ms linx-gw1.thn.ncuk.net [195.66.224.240]
11 58 ms * * te2-1-9.star10g.bdr-rt3.thdo.ncuk.net [80.249.97.17]
12 237 ms 61 ms 60 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
13 59 ms 58 ms 58 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

tracert thinkbroadband.com

Tracing route to thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms BTHUB4 [192.168.2.253]
2 17 ms 17 ms 17 ms x.x.x.x
3 17 ms 16 ms 17 ms x.x.x.x
4 18 ms 17 ms 18 ms 217.32.147.202
5 18 ms 18 ms 20 ms 213.120.178.65
6 37 ms 50 ms 51 ms 217.41.168.107
7 17 ms 18 ms 18 ms acc1-te0-0-0-21.l-far.21cn-ipp.bt.net [109.159.249.94]
8 19 ms 17 ms 18 ms core4-te0-9-0-19.faraday.ukcore.bt.net [109.159.249.15]
9 60 ms 61 ms 59 ms peer6-BE8.telehouse.ukcore.bt.net [213.121.193.183]
10 59 ms 59 ms 59 ms linx-gw1.thn.ncuk.net [195.66.224.240]
11 58 ms 58 ms 59 ms te2-1-9.star10g.bdr-rt3.thdo.ncuk.net [80.249.97.17]
12 64 ms 61 ms 61 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
13 59 ms * 58 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

Its all fine until it reaches the 9th hop.

Paul

In reply to a post by BatBoy:

C:\>tracert thinkbroadband.com

Tracing route to thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms SkyRouter.Home [10.10.10.10]
2 * * * Request timed out.
3 14 ms 13 ms 13 ms be101.sky.com [2.110.9.44]
4 16 ms 15 ms 14 ms linx-gw2.thdo.ncuk.net [195.66.236.240]
5 14 ms 15 ms 15 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
6 13 ms 13 ms 13 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

C:\>

/slap BatBoy with a wet fish
How the hell you get that many low hops.

Paul

Yeah seems to be fine again now too:

1 bthomehub (192.168.1.254) 1.756 ms 1.450 ms 1.363 ms
2 * * *
3 31.55.185.177 (31.55.185.177) 19.163 ms 17.848 ms 16.356 ms
4 31.55.185.184 (31.55.185.184) 16.650 ms 16.944 ms 16.800 ms
5 core2-hu0-10-0-0.colindale.ukcore.bt.net (195.99.127.134) 17.307 ms 17.012 ms 17.067 ms
6 core3-hu0-14-0-7.faraday.ukcore.bt.net (195.99.127.64) 17.143 ms 17.420 ms 17.477 ms
7 peer6-be7.telehouse.ukcore.bt.net (213.121.193.179) 19.008 ms 18.709 ms 18.280 ms
8 linx-gw1.thn.ncuk.net (195.66.224.240) 18.092 ms 18.090 ms 18.624 ms
9 te2-1-9.star10g.bdr-rt3.thdo.ncuk.net (80.249.97.17) 56.574 ms 58.065 ms 58.560 ms
10 po4-31.core-rs2.thdo.ncuk.net (80.249.97.85) 19.828 ms 17.929 ms 20.748 ms
11 www.thinkbroadband.com (80.249.99.130) 18.715 ms 18.578 ms 18.701 ms

In reply to a post by PaulKirby:

In reply to a post by BatBoy:

C:\>tracert thinkbroadband.com

Tracing route to thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms SkyRouter.Home [10.10.10.10]
2 * * * Request timed out.
3 14 ms 13 ms 13 ms be101.sky.com [2.110.9.44]
4 16 ms 15 ms 14 ms linx-gw2.thdo.ncuk.net [195.66.236.240]
5 14 ms 15 ms 15 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
6 13 ms 13 ms 13 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

C:\>

/slap BatBoy with a wet fish
How the hell you get that many low hops.

Paul

Sky obviously have a better infrastructure than BT, they don't faff about and bounce around their own network before going into the wild.

Tracing route to thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 10 ms 10 ms 6 ms 192.168.100.1
2 * * * Request timed out.
3 20 ms 18 ms 20 ms be331.pr3.hobir.isp.sky.com [84.38.37.36]
4 19 ms 19 ms 19 ms linx-gw2.thdo.ncuk.net [195.66.236.240]
5 21 ms 42 ms 21 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
6 19 ms 18 ms 18 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

Suspect something changed at 10:30 from what I can see on user data

Actually there might be more hops just the way the traffic is handled they are not visible to you in a tracert

In reply to a post by PaulKirby:

/slap BatBoy with a wet fish
How the hell you get that many low hops.

My Plusnet line is no different to Batboy's. I'm pretty sure it is still one of their old-style central connections.

>tracert www.thinkbroadband.com

Tracing route to www.thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms 192.168.0.1
2 11 ms 12 ms 11 ms lo0.16.Central16.pcl-bng01.plus.net [195.166.130.210]
3 11 ms 11 ms 11 ms irb.15.pcl-cr01.plus.net [84.93.249.161]
4 13 ms 12 ms 12 ms ae2.pcl-cr02.plus.net [195.166.129.7]
5 11 ms 12 ms 12 ms ae1.ptw-cr02.plus.net [195.166.129.2]
6 12 ms 11 ms 12 ms lonap-gw1.thdo.ncuk.net [5.57.80.142]
7 14 ms 14 ms 13 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
8 12 ms 12 ms 12 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

In reply to a post by BuckleZ:

Yeah seems to be fine again now too:

Yeah, the latency seems better now also:

tracert www.thinkbroadband.com

Tracing route to www.thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 1 ms <1 ms <1 ms BTHUB4 [192.168.2.253]
2 18 ms 16 ms 17 ms x.x.x.x
3 16 ms 17 ms 17 ms x.x.x.x
4 18 ms 18 ms 18 ms 217.32.147.202
5 18 ms 18 ms 18 ms 213.120.178.65
6 18 ms 18 ms 18 ms 217.41.168.107
7 18 ms 17 ms 17 ms acc1-te0-0-0-21.l-far.21cn-ipp.bt.net [109.159.249.94]
8 18 ms 19 ms 18 ms core3-te0-19-0-18.faraday.ukcore.bt.net [109.159.249.35]
9 19 ms 18 ms 18 ms peer1-xe1-0-2.faraday.ukcore.bt.net [213.121.193.189]
10 18 ms 18 ms 26 ms linx-gw1.thn.ncuk.net [195.66.224.240]
11 18 ms 18 ms 18 ms te2-1-9.star10g.bdr-rt3.thdo.ncuk.net [80.249.97.17]
12 19 ms 19 ms 20 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
13 21 ms 17 ms 18 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

Paul

In reply to a post by WWWombat:

In reply to a post by PaulKirby:

/slap BatBoy with a wet fish
How the hell you get that many low hops.

My Plusnet line is no different to Batboy's. I'm pretty sure it is still one of their old-style central connections.

my bt home connection in north london, gives ('though it was broken this morning)

Tracing route to www.thinkbroadband.com [80.249.99.130]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms bthub.home [192.168.1.254]
2 * * * Request timed out.
3 * 6 ms 6 ms 31.55.185.197
4 6 ms 6 ms 6 ms 31.55.185.236
5 6 ms 6 ms 6 ms core2-hu0-8-0-1.colindale.ukcore.bt.net [195.99.127.152]
6 7 ms 7 ms 6 ms 195.99.127.87
7 6 ms 6 ms 6 ms linx-gw1.thn.ncuk.net [195.66.224.240]
8 9 ms 7 ms 8 ms te2-1-9.star10g.bdr-rt3.thdo.ncuk.net [80.249.97.17]
9 8 ms 8 ms 15 ms po4-31.core-rs2.thdo.ncuk.net [80.249.97.85]
10 7 ms 7 ms 7 ms www.thinkbroadband.com [80.249.99.130]

Trace complete.

edit: ~ 600m fttc

Edited by ggremlin (Thu 21-Jul-16 20:28:53)

In reply to a post by ggremlin:

edit: ~ 600m fttc

I think the extra 5ms I get is more due to the extra 350km it takes to get to London.

There would appear to be another BT core network outage;

In reference to status.zensupport.co.uk/active/5/4713:

Exchange Bearer Outage(Latest)
Outage

Start: Mon, 25/07/2016 16:40

End:

Update: Mon, 25/07/2016 22:00

Clear:

Our suppliers Engineers are on route to continue investigation on site.

We are awaiting further update as to the cause of the outage, to be able
to provide an ETA on the fix.

Posted: Mon, 25/07/2016 19:26 by Phil Gill
Mon, 25/07/2016 18:34

Update
Outage

Our suppliers engineers are still investigating the cause of the outage.

Further updates will be provided as they become available.

Zen regret any inconvenience this may cause.
Posted by: John Sturrock
Mon, 25/07/2016 16:41

New
Outage

We are currently experiencing a Major Service Outage affecting customers connecting through the following exchanges.

Further updates will be posted as they become available.

ABERKENFIG
ABINGER
ALFRISTON
AMERSHAM
ARKWRIGHT
ARNSIDE
ASTLEY BRIDGE
BANGOR-ON-DEE
BANNOCKBURN
BARNET
BELMONT VILLAGE
BETCHWORTH

in all, over 200 exchanges are affected. I know it's a BT problem because there's also this;

In reference to status.zen.co.uk/broadband/fault-outage-details.aspx?reference=2075...:

Fault Reference: ZO20754449
Start: 25/07/2016 15:50 Next update / Cleared: 25/07/2016 21:26 (estimated)
Raised: 25/07/2016 15:50 Cleared Reason: N/A
Detected: 25/07/2016 15:50 Exchange Name: BISHOPSGATE,CANONBURY,KINGS CROSS,CENTRAL,WOLVERHAMPTON,BISHOPS STORTFORD,ARKWRIGHT,PETERBOROUGH CENTRAL,STIRLING,BOLTON,KENDAL,BARNET,CROUCH END,MILE END,MUSWELL HILL,POPLAR,POTTERS BAR,BYFLEET,GIPSY HILL,WALTON ON THAMES,ROYAL,CHISWICK,PERIVALE,FAILSWOR
Incident Headline: Service affecting outage - Loss of Service
Incident Details: Our supplier's engineers are working on the fault.
Area Codes: 01132 01158 01179 01189 01204 01212 01227 01235 01279 01306 01323 01403 01483 01489 01494 0151 01527 01539 01613 01616 01619 01628 01656 01707 01732 01733 01786 01902 01912 01932 01978 02032 02072 02073 02074 02075 02078 02082 02083 02088 02089 02380
Progress
Received Issue Update
25/07/2016 19:27 1 Our supplier's engineers are working on the fault.
25/07/2016 18:17 0 Our suppliers are investigating.

The Chiswick connections I look after are down.