Service Status

Service StatusPlanned Maintenance
26/11/20
10:30

test#2 – 26/11/20

test#2 – 26/11/20
26/11/20
10:23

Test – 26/11/20

Test – 26/11/20

23/10/20
16:16

test

test

18/08/20
17:32

Plugin update test

Plugin update test

18/08/20
13:30

Test on Post Update #2

Test on Post Update #2

18/08/20
13:06

Test#7

Test#7

18/08/20
10:12

Test#6

Test#6

18/08/20
10:07

Test#4

Test#4

18/08/20
09:49

Test#3

Test#3

18/08/20
09:39

Test#2

test#2

18/08/20
09:31

Test#1

Does this display on site without a page cache refresh?

11/08/20
14:32

Waga – Test Header Image

Waga – Test Header Image

20/03/20
14:04

Watchfront’s Covid-19 Protocol – Update 20/03/20

Further to our previous post about the current situation with the Covid-19 virus we are giving another update in relations to any data centre works that may need done during this time.

Yesterdays post can be found here:

https://waganator.watchfront.net.uk/watchfronts-covid-19-protocol/

As this is a fluid situation where the situation is changing daily we will be updating you when there are changes to what is possible Access to the data centres, in both Maidenhead and Amsterdam, is allowed but advised to be only for essential maintenance. There are no firm restrictions on access at this time.

We will be working as normal for anything in Maidenhead where we will visit in person. Currently Amsterdam is reachable but maybe not advised unless in absolute emergency.

We can however employ remote hands where such things as disks changes can be done with out a visit from us. Both of the data centre owners are stating like us that their stance is based on the latest advice from the government and is subject to review and change.

If you have any queries about this please email support@waganator.watchfront.net.uk

24/06/19
22:46

Power Outage at Pulsant 2

Hello,
We have experienced a power outage in our Maidenhead Pulsant 2 data centre. Power has returned and we are working to get all services back online.
Updates to follow.

08/03/19
11:40

Brief Connectivity Outage

We apologise to customers for the brief outage caused by one of our suppliers between London and Maidenhead.
Everything is back to normal now.

07/03/19
03:33

Connectivity Outage

At approximately 23:30 on 06/03/19 we lost connectivity between London and Maidenhead, affecting many services. The link is comprised of 2 connections from different suppliers. Unfortunately both of these connections were unavailable for a period, for reasons that are not currently fully understood.

We are working with both link suppliers and will post a fuller update when further information is available.

All services are now restored – if you should see anything unexpected please contact support on 020 7517 4999 or support@waganator.watchfront.net.uk

Aplogies for the inconvenience caused.

06/03/19
08:46

Interruption to internet lines

Apologies to all our customer who have lines with us and experienced packet loss. There was an issue with one of our connections in London which has now been fixed.

04/03/19
14:10

Interruption to Service

Apologies to all Leased Line and DSL customers who suffered a brief outage around 13:45 today.

 

This was caused by an interruption between London and Maidenhead by our suppliers having a network glitch.

 

 

03/10/18
12:05

Interruption to Service

Apologies to our customers who suffered a brief outage this morning.

Unfortunately, whilst Kev as conducting some housekeeping work in Blue Square 1 he accidentality rebooted the Peregrine switch. As this was a totally accidental occurrence we do not anticipate there to be a repeat.

We apologise for any inconvenience this may have caused.

02/09/18
23:14

Switch problem in Maidenhead

Update 07/09/18: The faulty unit was replaced yesterday and has been functioning normally sine.

One half of switch cluster ‘willem’ in Maidenhead is currently unresponsive. Any customers with single-homed CoLo connected to the faulty unit will currently be suffering loss of connectivity.
We will investigate and repair as soon as possible and will publish an update in the morning.
In the meantime, apologies for the inconvenience.

29/05/18
11:04

Interruption to Service

Hello,

 

We suffered a DDoS attack on our network in the early hours of Monday the 28th of May.

 

One of our upstream providers noticed this and null routed the attack.

 

All services were back to normal in under two hours.

 

We apologise for any inconvenience this may have caused.

10/04/18
11:54

:2018-04-10 Glitch on TalkTalk services this morning

Update: All affected lines have now resumed normal service.

Customers who have a TalkTalk connected service may have experienced a glitch in service for a minute or so at around 11:00 this morning, services are slowly returning to normal to all affected lines.

The cause of the glitch is unknown at this time but is being investigated, as soon as we have more information from TalkTalk we will post an update.

We apologise for any inconvenience caused.

25/01/18
11:21

:2018-01-25 Glitch on TalkTalk services this morning

Customers who have a TalkTalk connected service may have experienced a glitch in service for a minute or so at around 11:00 this morning, normal service is now running.

The cause of the glitch is unknown at this time, as soon as we have more information from TalkTalk we will post an update.

We apologise for any inconvenience caused.

27/11/17
08:53

Issue with TalkTalk lines

This morning TalkTalk are having a big outage which is in turn is making any EoFTTC or Leased Line from them unavailable.

 

We apologise for this problem and are assured TalkTalk are working to fix the issue as soon as possible,

 

We will update you here once we know more.

 

Update 09:13 27/11/2017

 

All lines have come back now and the problem is gone.

 

Apologies once more for this issue.

17/11/17
12:19

:2017-11-17 Problems with BT DSL connections

We apologise to our customers with BT lines who have been affected by the outage this afternoon. Our wholesale supplier for BT connected lines is investigating the cause of the issue.

Apologies to those customers affected.

29/08/17
08:44

:2017-08-29

We are observing packet loss affecting cartain data paths in our AMS datacentre, which is being investigated.

11/08/17
09:13

:2017-08-11 Glitch on TalkTalk services this morning

Customers who have a TalkTalk connected service may have experienced a glitch in service for a minute or so at around 09:00 this morning, normal service is now running.

The cause of the glitch is unknown at this time, as soon as we have more information from TalkTalk we will post an update.

We apologise for any inconvenience caused.

20/07/17
13:03

:2017-07-20 Problems with BT DSL connections

We apologise to our customers with BT lines who have been affected by the outage this afternoon. Our wholesale supplier for BT connected lines carried out investigative testing following the issues last week and unfortunately made an error with the configuration on one of their switches. The configuration change has been rolled back and the service to customers restored.

Apologies to those customers affected.

 

14/07/17
10:43

:2017-07-14 Problems with BT DSL connections

Update 12:17 – All lines have now reconnected and been stable for approximately one hour.

Our wholesale supplier for BT connected lines is experiencing severe problems this morning. Once they have rectified the situation we expect affected lines to reconnect automatically. We will monitor to ensure this is so.

Apologies to those customers affected.

13/07/17
20:47

Problems with BT DSL connections

Update 21:50 – All lines have now reconnected and been stable for approximately one hour.

Our wholesale supplier for BT connected lines is experiencing severe problems this evening. Once they have rectified the situation we expect affected lines to reconnect automatically. We will monitor to ensure this is so.

Apologies to those customers affected.

26/05/17
16:04

Network Outages

We are experiencing interruptions to our connectivity with one of our upstream providers, Pulsant, this afternoon.

As we use diverse suppliers for transit we switched the Pulsant transit off until they had fixed their issue.

We apologise for any inconvenience caused.

 

04/05/17
14:25

Network Outages

Update: Pulsant have notified us that they will be performing emergency maintenance between 21:00 and 23:00 this evening related to the earlier outage.

This maintenance should be considered as an ‘at risk’ time, rather than a definite outage.

 

Earlier message:

We unfortunately experienced network outages outwith our network earlier today.

Our infrastructure was working normally but the issues were with one transit provider.

The issue was with Pulsant; more information can be found at http://status.pulsant.com/

We apologise for the three blips these issues caused.

10/04/17
16:25

Brief Network Outage

We would like to offer our apologies for the brief network outage that happened in the last hour.

We were monitoring traffic using debug on one of the main switches and unfortunately ran out of memory.

As soon as we realised what was happening we reversed the debug monitoring and normal service was resumed.

05/04/17
14:20

Blip in Pulsant Transit

We experienced a blip with Pulsant transit coming out of Pulsant 1 & 2 in Maidenhead early this afternoon.

As we use diverse suppliers for transit we switched the Pulsant transit off until they had fixed their issue.

They currently have a workaround in place and everything seems to be normal again.

We have switched our Pulsant transit back on.

02/03/17
13:27

Past Maintenance

We would like to apologise for not informing everyone of the maintenance window between 5pm and 7pm on Tuesday 28 February 2017.

We were moving a physical between racks which hosted some of our servers including knockando our mail server.

13/10/16
11:03

We have been notified by our Leased line/EoFTTC provider that TalkTalk have Planned Engineering Works scheduled to carry out an upgrade to some of their core links. They do not anticipate any impact to customers Leased line/EoFTTC services but it is advised that during the maintenance window it is an ‘at risk’ period.

The maintenance will take place during the following time window:

Duration:

Start: 19/10/2016 00:05 BST

End: 19/10/2016 06:00 BST

17/10/16
12:01

We have been notified by our BT wholesale provider that they will be carrying out planned maintenance to upgrade the software on their core switches. Our BT customers are advised to expect a disruption to their broadband service whilst the maintenance is carried out.

The details of this maintenance are as follows:

Start Date: Thursday 20/10/16

Start Time: 01:00

End time: 04:00

We apologise for any inconvenience this may cause.

06/01/17
14:14

We are planning to upgrade the firmware of our switch cluster Beatrix in Pulsant 2 on Tuesday 10th of January 2017 after 6pm.

This will involve the switches rebooting.

The time window for this work is 30 minutes.

We do not expect the work to take longer than 10 minutes but we are building in a buffer in case of unforeseen events.

All services will be affected during this time.

12/01/17
10:30

2017-01-17 18:17 – This maintenance has been completed successfully

We will be doing further firmware upgrades to our core switches on Tuesday 17th of January 2017 after 6pm.

This will involve switches the following switches:

Korenwolf
Peregrine
Jasper
Zwaluw

The time window for this work is 1 hour 30 minutes.

We do not expect the work to take longer than 30 minutes but we are building in a buffer in case of unforeseen events.

DSL and Leased Line services will be affected.

Connectivity to Pulsant 1, Amsterdam and rack 1 in Pulsant 2 will also be affected.

14/03/17
15:55

UPDATE– 02/04/2017 This work will be going ahead at 12pm today.

We have had to move this work back a week due to technical reasons.

We now plan to do a major change to our switching infrastructure in Pulsant 2 on Sunday the 2nd of April 2017.

The work will start at midday and is expected to last a maximum of 3 hours.

This will mean there will be outages to all services as the full network will be down during this time.

We do not expect the work to take 3 hours but we are building in a buffer for any unforeseen circumstances.

02/04/17
16:24

Our Planned Maintenance today was completed successfully.

16/05/17
11:24

Supplier Planned Maintenance

We have been notified that one of our inter-connectivity suppliers will be conducting some essential core network maintenance, on Tuesday 16th May 2017 between the hours of 20:00 and 06:00.

There may be a slight blip during this period for Talk Talk DSL connections until they reconnect automatically through a different interconnect.

This maintenance task is required so that Talk Talk Business can perform essential vendor recommended maintenance on their DSL infrastructure at Telehouse North.

24/05/17
15:26

On Thursday 25th of May 2017 we are planning to move our interconnect for BT DSL and FTTC lines at 18:30.

This is a low risk change although there may be a slight outage of 5 minutes in a worse case scenario.

08/08/17
14:11

Update 15:16 13/08/2017

 

The transfer is now complete and all access to mail boxes has returned to normal.

 

We can only apologise for the length of time this took.

 


Update 11.15 13/08/2017

 

Unfortunately this process is taking longer than expected.

 

We are monitoring the situation and expected the transfer to the new host to be complete in a couple of hours.

 

Thank you for your patience during this time.

 


We will be moving one of our mail servers to a new host on Saturday 12th of August 2017.

 

We are starting work on this on at 8pm and have scheduled a maintenance window of 12 hours for this to be completed.

 

There will be a delay in receiving mails through out this window.

 

There will be no delay in sending mails.

 

There will be updates sent before and after the work is done.

 

–Update

For clarity whilst the works are ongoing people will not be able to access their mailboxes.

18/08/17
14:07

Update 00:20 20/08/2017

 

This work has been completed successfully.


 

We will be moving one of our shared services servers to a new host this weekend.

 

Some customer websites will not be available during this time.

 

This work will begin at 8pm on the 19th of August 2017 and is expected to last 12 hours.

 

We will post updates as the work progresses.

24/04/18
09:18

We will be moving our email services to new servers on Sunday 29th of April 2018.

 

We expect that this work will take no more than 3 hours to complete.

 

During this time all connections to send and receive emails will be unreachable however no emails will be lost.

 

This work will bring upgrades to our services which we will highlight in a news article once the work is complete.

27/06/18
14:58

Update 22:32:

The updates have been applied successfully.

 


Hello,

 

We will be conducting essential firmware updates to our LNS and Tunnel Head End routers on the evening of 2nd July 2018.

 

The hours of this maintenance are between 10pm and midnight.

 

There will be slight interruption to all DSLs and tunnels during this period.

 

We apologise for any inconvenience this may cause.

08/03/19
15:09

Due to the recent issues with our connections to London we are doing some maintenance tonight after 6.30pm.

 

This is to make sure that we have redundancy between London and Maidenhead.

 

There may be a small outage at this time of around 5 minutes.

13/03/19
15:26

This maintenance has been completed successfully, with all resilient links now functioning correctly. 14/03/19 21:10 KRH.

We will be conducting more maintenance on our interconnects between London and Maidenhead at 9pm on Thursday 14th of March 2019.

 

We are confident that this maintenance will work immediately but there may be a small outage of up to 15 minutes during this time.

 

This would effect leased line customers and any connection between Maidenhead and Amsterdam.

29/03/19
15:11

We will be conducting some maintenance tonight at 18:30 on our edge router grappa in Pulsant 2.

This should take no more than 5 minutes.

We do not expect there to be any outages due to this but it is to be considered an at risk period.

 

 

09/11/19
11:59

We will be making configuration changes to our main LNS, sweep, this weekend. This will result in all ADSL and FTTC connections briefly dropping but immediately reconnecting.

03/04/20
11:55

Update 15:00 2020-04-05

This maintenance has been completed successfully. We will continue to monitor the network.

We will be conducting some changes to our switching between Maidenhead and London this weekend.

This will improve our resilience to an outage between the two Data Centers.

There will be a couple of minor glitches to connectivity as this is being done which is why it is the work is being conducted out with business hours.

There should be no major outages whilst this is being conducted.

If you have any queries please email support@waganator.watchfront.net.uk.

We will post again once the work is complete.

11/08/20
14:29

Waga – Test for header image.

18/08/20
13:29

Hello,

We have been instructed by our Amsterdam data centre provider that they will be conducting preventative maintenance on the power breakers that feed our racks overnight on Tuesday the 22/09/2020.

This is to start 9pm UK time and can last until 5am the next morning.

During this time there will be a power outage to the rack.

We will be contacting customers directly about this.

We apologise for the interruption.

18/08/20
16:15

Hello,

We have been instructed by our Amsterdam data centre provider that they will be conducting preventative maintenance on the power breakers that feed our racks overnight on Tuesday the 22/09/2020.

This is to start 9pm UK time and can last until 5am the next morning.

During this time there will be a power outage to the rack.

We will be contacting customers directly about this.

We apologise for the interruption.

18/08/20
16:20

Test

26/10/14
18:26

Apologies to customers with virtual machines running on our host ‘impersonator’, which suffered partial RAM failure and rebooted this afternoon. It is currently up and running OK, albeit with less RAM than normal. Maintenance will be scheduled to restore the full quota of RAM.

09/06/11
12:03

Following yesterday’s successful router changes, later this evening (not before 20:00) we will be testing router fail-over configurations. This should not affect service, but must be considered an ‘at risk’ period.

01/09/11
15:35

Kev, 01/09/2011: This maintenance has now been completed

This evening after 18:00 will be updating firmware on our Be ADSL LNS routers. This will result in some lines being logged out, but immediately reconnecting. We will publish a notice when this has been completed.

05/08/12
10:35

Kev, 06/08/2011: This maintenance has now been completed

On Saturday 06/08 we will be updating firmware on our Be ADSL LNS routers. This will result in some lines being logged out, but immediately reconnecting. This may happen a few times as various updates are applied. We will publish a notice when this has been completed.

14/07/11
07:42

Kev, 14/07/2011: This maintenance has now been completed

We will be doing some disk maintenance to our primary mail server this morning. No mail will be lost, but mail collection will be unavailable for a few minutes during this time.

24/06/12
11:18

Kev, 24/06/2012: This maintenance has now been completed

We are planning to conduct a maintenance upgrade on our Beatrix switches. The provisional planned date for this is Sunday 24th June 2012, to minimise disruption to customers’ who have services provided by these switches.

Customers affected will be contacted prior to the planned date but may experience an outage for a few minutes while the essential maintenance is conducted. We apologise for any disruption to services in advance.

30/11/11
14:09

Kev, 30/11/2011: This maintenance has now been completed

Apologies that the work took longer than expected, due to forced disk-checks on reboot.

We will be performing routine updates on our mail and web servers this evening starting at 18:00. Service will be interrupted for a few minutes whilst this is carried out.

23/09/16
12:12

KRH 25/09/16: This work has been completed successfully.

We are planning to reboot our switches in Amsterdam on Sunday 25th of September.

 

This is for routine maintenance.

 

This work will be carried out in the morning.

 

 

 

04/01/13
09:48

Our transit provider in Amsterdam will be carrying out planned maintenance from 23:00 on 15th  January 2013 to 01:00 on 16th January 2013.

Transit will automatically switch over via the UK but there may be minor glitches in routing during this time.

We apologise if any inconvenience is caused.

28/09/16
12:26

PM 28/09/16 14:10 – This work has been completed successfully.

 

We are planning two router reboots today 28/09/16.

 

These will be done gracefully so we do not expect any outages but as there is an inherent risk doing anything to the core network we will have all staff members on hand when the work is carried.

 

 

 

28/09/16
14:15

PM 28/09/16 17:00 – This work has been completed successfully.

 

Further to our successful reboots earlier we are going to proceed with the firmware upgrades to our core routers.

 

This will be taking place this afternoon (28/09/16 PM) and as before we do not expect any disruption to services but as we are working on the core routers there is an inherent risk.

 

We have all staff on hand during this time.

30/01/17
11:24

We have been notified that one of our interconnectivity suppliers will be conducting some essential core network maintenance, on Monday 6th February 2017 between the hours of 00:00 and 07:00.

Details:

Start time: 00:00 CET 06.02.17
End time: 07:00 CET 06.02.17

Expected Outage/Downtime: We do not anticipate any outage due to our back up resilience, however, customers are advised that during the maintenance window it is an ‘increased at risk’ period.

 

12/10/16
09:32

We have been notified that TalkTalk have planned engineering works scheduled for Friday 14th October 2016 to perform a software upgrade on some of their core devices. The maintenance will affect our TalkTalk ADSL customer lines only.

The details are as follows:

Duration:

Start: 14/10/2016 00:05 BST

End: 14/10/2016 06:00 BST

We apologise for any inconvenience this may cause.

08/03/16
14:57

Update – This maintenance has been partially completed and a further maintenance window will be scheduled by our BT wholesale provider. Details to follow.

We have been notified by our BT wholesale provider that they will be carrying out planned maintenance to upgrade their core network capacity. Our BT customers are advised to expect a disruption to their broadband service whilst the maintenance is carried out.

The details of this maintenance are as follows:

Start Date: Sunday 13/03/16

Start Time: 02:00

Outage duration: work is expected to start from around 2am and will last approximately 4 hours

We apologise for any inconvenience this may cause.