Antenna Foundation - Werkzaamheden / Work in Progress

Antenna Networking in Progress

Reporting technical disturbances, maintenance and problems

Issues/Incidents

Closed incidents

1 march 2013

update

28th Januari 2013

One of the mailservers will be down soon for software upgrade.

update

mail bounced and was not delivered as mailaccounts weren't recognized.

18th December 2012

One of the mailservers is down for software upgrade

Update

23rd October

Websites moved to new webserver

Incident

Rules updated

9th October 2012
11:35 hours: New rules of Mod_security have been installed
In case you get unexpected errors on your website, please mail the url and time to support@antenna.nl
6th July 2012
8:35 hours: Mail7.antenna.nl is sending massive spam.
9.45 hours solved. The password of the responsible mail account has been changed, the smtp server has been stopped, about 250,000 messages removed from the queue among which about 15 legitimate messages. The server is now receiving and sending messages again. The server has been blaclisted by at least two lists, we have sent requests for whitelisting again.

Incident

19 june 2012
5.00 hours: One of the servers www18.antenna.nl is down.
9.22 hours: solved

Incident

Friday 4th May 2012
10.00 hours: Due to a very popular website of the Danish Spotfestival in Denmark this and some websites on this shared webserver may be slow to appear or sometimes be down.
update 11:45: We have set up a dedicated server for this website, the DNS has still to be changed however.

Wednesday 22nd February 2012
16.00 hours: E-mail Messages lost. One of the Antenna mailservers had a corrupt antivirus database during several hours, due to which all mails were quarantained. This was solved by importing a correct database and restarting the antivirus server. Messages have been lost however.

update 16.30 hours: we are working on a programme to inform the receivers e-mails from which senders did not arrive.

update 17.05 hours: we finnished a programme which fetches all messages from quarantaine, clears them from the virus line and resends the messages, so all messages will arrive if all's well.
Wednesday 8th February 2012
14.00 hours: One of the Antenna webservers has a high load. It is under investigation now.will be taken down for maintenance at around

update 15.00 hours: one of the hosted websites had apparently a loop in their code which caused the high load of the server, after a reboot all other websites are back online again. We keep on monitoring.

Monday 23rd January 2012
One of the Antenna mailservers will be taken down for maintenance at around 19.30 for about half an hour. Sorry for the inconvenience.
Sunday 23rd October 2011
One of the Antenna servers was down several hours due to a system error at the hosting centre. It was up and running again in the evening.
Monday 10th October 2011
One of the Antenna webmail servers got on a blacklist, due to a Trojan which got hold of the password of one of it's users. With that password thousands of spam messages were sent before we blocked it. The server has got blacklisted on some servers on the internet. This may have as effect that some of the messages sent through this server will be bounced due to a blacklist. We requested removal from the blacklist after changing the users password and asking the user involved to remove the Trojan with adequate software or have a computer company do this.
Thursday 8 September 2011
Today the Antenna (web) mail servers will receive new software due to an upgrade. All the mail servers will be down during some time today. Especially the webmail takes longer.
Update 15.00 There is a problem with the new webmail for some domains (e.g. webmail.antenna.nl), a technician is working on it.
Update 15.06 The webmail problem for some domains is solved now.
Update 9 September 09.30 All mailservers have the latest software now. One webmail still has an IMAP error which is shown when logging in.
Update 9 September 10.20 The webmail on the all servers is working now again as before
Update 9 September 11.00 Some old passwords have timed out and need to be reset, please call us or send us an e-mail.

Tuesday 6 September (2011) 15.20 Due to a glass fiber accident when digging near one of the hosting centers, there are hickups in connections to some of our servers. Technicians are busy rerouting the traffic, there is however partly package loss and slow connection over the alternative route. update 23.20 the glass fiber cable has been restored and all is back to normal again.

Friday 26 August (2011) 10.55: One of the webservers is temporarily offline for a hardware check by the technician after some errors.
Update 15.30 One of the drives has to be replaced, it will take more time before websites will be online again.
Update 20.40 A technician has been hired who will try to restore the system from the remaining disks and if necessary get things back from the backups.
Update 27 August 08.55 This night the drive has been replaced and the data copied back, however after a reboot the server does not yet respond. The technicians have been asked to investigate.
Update 27 August 16.15 The boot sector was on the failed disk and had to be restored by the technician. It was accomplished at this time and the server is up and running again.
Monday July 18 (2011) 10.35: An error with the upgrade of php caused some websites to show blank pages. The issue has been solved by the technician: removing an accidentally installed programme.
Incident closed.
Thursday April 7 (2011) 9.45-10.15: The semi-automatic update of server programmes caused php to be upgraded from 5.2.17 to 5.3.6 on Wednesday. Several websites showed errors as the php used was not compatible with php 5.3 . We took the webserver down and downgraded successfully to 5.2.17 again.
Servers offline during several hours

Friday March 18th 2011 18.00 - Saturday 19th up-to 12.21 hours: A large number of webservers and mailservers are being transferred to another location by the hosting centre. E-mail will be delivered later and will not bounce. The websites involved will be offline during those hours, webmasters have been informed.
Update 06.00 hours
Two servers are online again.
Update 07.00 hours
All servers but one mailserver and one of the webservers are online again.
Update 08.44 hours
All servers but one of the webservers are online again.
Update 12.21 hours
All servers are online again.

Monday June 28 (2010) 13.50-15.35: One of the mailservers, mail10.antenna.nl had a file error and needed different settings and several reboots, originally expected to be up and running again before 14.30 hours by the technicians, but it takes longer then expected.
Incident closed.
Monday June 21 (2010) 23:00-08:00: The webserver hosting the sites using COBRA CMS wil be moved to another location. The move wil take place between 23.00 and 8.00 hours the next morning. The COBRA sites will be down during this interval.
Incident closed.
Tuesday June 8 (2010) 15:30: Websites making use of COBRA CMS might experience hinder in uploading files or creating files with the file application due to enforced restrictions to counter hack attempts. A seperate password is mailed to the known webmasters and also available via support@antenna.nl to bypas the temporary restrictions.
Incident closed. New version of SPAW editor is placed.
Vrijdag 21 Mei (2010) Problemen versturen naar Hotmail adressen via smtp5.inter.nl.net De smtp server van Internlnet staat op de blacklist bij hotmail. Wil je toch een mail sturen naar een hotmail adres, doe dat dan via de webmail.
Dinsdag 25 Mei. Problemen naar hotmail adressen is opgelost.
Tuesday 18th May (2010) 15.30: High load on one webserver. One very popular site will be moved to a dedicated server to solve this problem.
Update 19th May. The site dns is not hosted with Antenna, so it takes until tonight until the visitors will arrive at the dedicated server.
Update 20th May. Problem solved. Popular site running now on another server.
Tuesday 2nd March (2010) 11.32: Centos Page shown in stead of websites on one webserver.
Update 2nd March (2010): 13.35 hours. Problem solved. The cause was a blacklist which started malfunctioning.