This has just been posted to the Zen status pages.

I have routing back - though it's a bit of a mess at the moment.

http://status.zensupport.co.uk/index.php?serviceid=2...

"Transit & Peering

The following new Transit & Peering incident has been identified. Further information is detailed below.
New York Link issues(New)
Outage - Emergency maintenance

Start: Mon, 25/04/2011 19:16

End:

Update: Mon, 25/04/2011 21:00

Clear:

Our engineers have discovered an issue with our New York link. This has been raised to our third party supplier who are investigating.

Some customers may notice a change to the way their traffic is routed, however no impact to service is expected.

Zen regret any inconvenience this may cause.

Posted: Mon, 25/04/2011 19:17 by Mark McKinlay"

Edited by IamQ (Mon 25-Apr-11 19:24:17)

Yup, I'm managing to get to my destination again at least so huzzah!

Ditto.

Oh ye of little faith.

Had it been most other ISPs the problem would have remained until tomorrow probably.

Credit where credit is due I think.

Just remember it does take time to track down the root cause of a problem.

Edited by techguy (Mon 25-Apr-11 21:32:50)

In reply to a post by techguy:

Oh ye of little faith.

Had it been most other ISPs the problem would have remained until tomorrow probably.

Credit where credit is due I think.

Just remember it does take time to track down the root cause of a problem.

Maybe - but then if I had lost half our eBGP sessions to the USA I'd of known within the BGP time out interval and iBGP or another eBGP peer would of fixed everything and pushed it another way without intervention. I'd of also got and sent alerts to my NMC team and my on-call team, it would of also auto updated the status portal & tickers.

Also true I have seen some ISP's drop all there BGP on a Saturday morning and its not back and running till the Monday - but frankley those people shouldn't be ISP's and any customer/user who goes with someone *that* shonky has only them selves to blame...

Credit where it's due - but this is business as usual stuff that should of automatically been picked up and flagged to the 'outages' page and or any other user based platform (RSS, Twitter etc) I don't take much and I've had conversations with people in Zen land about this sort of thing before.

Remember this would of broken *lots* of people over the entire network (including leased, core and access customers.)

Still no update on the fault either, but traffic to the AS's I posted the other day is now flowing the via London and being handed off that way.

Is Zen still having issues - its unusable this evening, like wading through treacle.

Am supposed to be working but having to resort to a 3G connection.

Err not sure TBH. Not noticed any problems at home this evening and none of my remote sessions have died.

Not done much downloading only light browsing.

Sorry can't be much more help.

USA traffic is still going via London anyway - that might have an impact depending where you are, though I'd not expect it to be much.

Ah no - turned out to be a router firmware issue!!

Latest firmware (.48) version for the netgear dgnd3300v2 router gradually slowed it to a crawl before killing any and all netgear connections.

I wondered why when I restarted all would be fine again for a litle while... doh!

Roll on tmw - fttc day!

In reply to a post by peaks:

Ah no - turned out to be a router firmware issue!!

Latest firmware (.48) version for the netgear dgnd3300v2 router gradually slowed it to a crawl before killing any and all netgear connections.

I wondered why when I restarted all would be fine again for a litle while... doh!

Roll on tmw - fttc day!

Ahh that's ok then. Are you by chance using the router as a DNS relay ? That was known to slow them all down and crash a few.