UPDATE 16:50 14/04 Our team is working to clear a massive backlog of incoming and outgoing email on the remaining server. We hope to have this cleared in the next hour and we can then restore incoming and outgoing connections for the remaining customers.
UPDATE 13:20 14/04 About 80% of accounts are now operational. You might notice a small delay in outgoing emails because it will take some time to clear the backlog that has built up. We hope to have an update shortly regarding the remaining 20% of accounts that are still having issues.
UPDATE 12:00 14/04 Full service has been restored to about 50% of the affected accounts. We are continuing to work on restoring service to the remaining accounts and we hope to have another update around 1pm Irish time.
UPDATE 07:00 14/04 Unfortunately, the large volumes of traffic that our servers have been experiencing have caused a Network Switch to fail. We are currently preparing a secondary Switch which should solve this problem. We will update this space once we have relevant details.
UPDATE We have implemented a temporary firewall to try and block the malicious activity. Server loads are still extremely high which are continuing to cause time-out errors.
A number of our email servers are currently under DDOS attack (Denial-of-service attack). This is affecting our Business Email service and users may find they can send or receive email or access Webmail.
We are trying to identify and block the illegitimate traffic, but it may take a couple of hours to get the attack under control.
We do apologise for the inconvenience caused and we will update this thread as soon as additional information is available.
UPDATE
A temporary fix has been installed by the data centre and services should be returning to normal. However, you may observe a delay in both incoming and outgoing emails which should clear once the mail queue on the server clears.
UPDATE
A team from the data centre have identified the issue and are working to restore services.
UPDATE
Upon investigating further our Network administration team has identified that the email functionality is also currently affected. You may not be able to access webmail or send and receive emails via email clients as well. The issue is being checked on the highest priority.
We sincerely apologise for any inconvenience caused to you.
ISSUE REPORTED
We are facing intermittent issues with our Business and Enterprise email service, due to which you might encounter an error “Error 521 Web server is down" while accessing your account via the Webmail interface.
Our System Administration team is actively working to restore services. We regret the inconvenience caused to you.
An update will be provided to this thread as soon as additional information is available.
Symptoms
We are currently facing an issue in which domains that use an SSL certificate from Let's Encrypt are showing the server's hostname as the common name, instead of the actual domain name that is on the certificate. This is causing browser errors and email client errors.
Description
This is related to the recent expiration of the DST Root CA X3 Cert from Let's Encrypt. We believe this to be causing issues with the SNI configuration.
Our control panel software provider (cPanel) is aware of the issue and are working to resolve it. At the moment we don't have an ETA on how long this will take, but we will keep this page updated.
***UPDATE***
A software update has been rolled out to fix this issue. However, some customers may still get errors like 'Can't verify the identity of the server' when sending and receiving email. If you are experiencing this error, it means the SSL certificate for your website hasn't been updated yet. You can either access your email using a browser at https://cart.ie/webmail or change the server settings in your email client to connect via an unencrypted connection. We recommend using the webmail method, but if you wish to change your email client settings, please do the following:
- Open your email client and go to the Settings option
- Select the account you wish to edit and look for the 'Server Settings' option (you may find you have a separate option for both incoming and outgoing mail servers)
- In the 'Security/SSL' settings option change the connection type to 'None'
- Save and exit
Please also let us know by support ticket, that you are getting this error and we will update your SSL cert. Please note though, there are backlogs of SSL certs waiting to be issued and it's currently taking 3 to 4 hours for new SSL certificates to be issued.
We do apologise for any inconvenience caused.
We are aware of an issue with high server loads on telecity.cart.ie and are investigating it.
Users may see a 503/Service Unavailable error message and the page will not load for them.
We do apologise for the inconvenience caused and will update this announcement as soon as we have more information.
UPDATE 09:56
This issue has now been resolved. A corrupt update was causing the server to crash. We will continue to monitor the server and if users continue to receive 503/Service unavailable errors, please open a support ticket.
Once again, we apologise for any inconvenience caused.
This server is currently experiencing very high traffic loads which are causing page errors when trying to view websites hosted on it.
Our engineers are working on the issue and we will provide an update when we have it.
We do apologise for any inconvenience caused.
Clients on this server are currently unable to send email to Microsoft email services (like Hotmail, Outlook and Office 365). This is due to a block on the server IP by Microsoft.
We are working with Microsoft to find the cause of this block and we hope the block will be removed shortly.
In the meantime, to send email to any of the Microsoft email services, please use an alternative email address, or change your outgoing server to the one provided by your ISP.
We apologise for any inconvenience caused.
We are currently experiencing some issues with our main telephone number (066) 9166 091. Please use our alternative number (066) 9 130 130 if you need to contact us. We apologise for any inconvenience caused.
The IEDR website will be taken offline on Saturday 19th May, 2018 for maintenance & upgrades.
We will be unable to Register/Renew/Transfer any .ie domain names during this outage and customers will be unable to make any changes to their domains in the control panel.
The outage is planned to last from 8am to 2pm.
We apologise for any inconvenience this may cause.
We have been notified by the IEDR that their offices are closed until Monday March 5th, due to Storm Emma. During this time no new registrations will be approved and there will be delay in responding to queries concerning .IE domains.
We apologise for any inconvenience this may cause.
A corrupt control panel update is causing issues for http (web) traffic on this server. At the moment websites are unavailable while we restore multiple backups, this will take a number of hours to complete and your website may be unavailable during this time.
Email is not affected and we hope to have service fully restored by 12 Midday Irish time.
We apologise for the downtime and inconvenience caused.
***Update 10am***
Approximately 40% of accounts have now been restored.
***Update 12:20pm***
About 20 accounts remain to be restored and they should be restored within the next hour.
Once again we apologise for the downtime this has caused.
***Update 3:30pm***
The majority of accounts have now been restored, but we are still having issues with a small number of accounts. These accounts will need to be restored one by one which will slow the process down. We don't have an ETA on how long this will take as it depends on the size of each account, but we will continue to update this page.
***Update 6:30pm***
All websites on this server have now been restored. If you are still experiencing issues, please open a support ticket and we will investigate.
Thank you for your patience and we do apologise for the downtime.
Following a hardware failure on Sunday morning, some of our accounts are working of emergency backup disks. We have been informed that the custom DNS settings for some domains has defaulted back to our default DNS. We have technicians working on identifying the affected accounts and restoring the data. If you have a domain that is displaying the Always Amber holding page instead of your homepage, please open a support ticket with the list of domains affected.
Hosting accounts and domains not using our nameservers are NOT affected by this error.
We do apologise for the inconvenience this has caused.
++++++++++++++++++++++++++
We have now restored most of affected DNS records. Engineers will replace the failed equipment later this morning, which will resolve the issue for the remaining domains.
In the meantime, please open a support ticket with your domain details if your domain is displaying the Always Amber holding page instead of your homepage.
++++++++++++++++++++++++++
Update - Monday 13:00
The affected hardware has now been replaced and all DNS records should be restored
++++++++++++++++++++++++++
Update - Tuesday 14:30
We have discovered that a small number of accounts are still having issues with DNS records been reset to our default DNS. If you have a domain that is displaying the Always Amber holding page instead of your homepage, please open a support ticket with the list of domains affected.
Once again, we apologise for the inconvenience caused.
The IEDR website will be taken offline on Saturday 12th December, 2015 for maintenance & upgrades.
We will be unable to Register/Renew/Transfer any .ie domain names during this outage and customers will be unable to make any changes to their domains in the control panel.
We apologise for any inconvenience this may cause.
Update: 13.30 This maintenance has been completed and all systems should be working normally.
