tag:hostedcloud.statuspage.io,2005:/historyCloudNordic Status - Incident History2024-03-28T09:42:58+01:00CloudNordictag:hostedcloud.statuspage.io,2005:Incident/181821032023-08-21T16:19:01+02:002023-08-21T16:19:01+02:00Ransomware attack<p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>16:19</var> CEST</small><br><strong>Monitoring</strong> - Please see https://cloudnordic.com for final update.</p><p><small>Aug <var data-var='date'>20</var>, <var data-var='time'>00:37</var> CEST</small><br><strong>Update</strong> - Restore operations during Saturday have not been succesfull, new update will be published early Sunday.</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>12:29</var> CEST</small><br><strong>Update</strong> - New setup is ongoing and proceeding as planned according to our disaster recovery plan.<br />Current estimation is that the new setup will be done late Friday evening, and that services will begin to get back up during Saturday. Due to the amount of systems needed to get back up, it will still take many hours, for each service to become fully functional again, and while some services might start to work early Saturday, we expect it to take all Saturday until all services are running.</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>09:49</var> CEST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>09:45</var> CEST</small><br><strong>Identified</strong> - Clusters and storage have been infected by a ransomware attack, affecting all primary storage.<br />Ransomware infection, happened due to infected hardware from another datacenter being moved to our primary datacenter, and attached to our core network, thus bypassing normal firewalls and security systems.<br />In order to ensure everything working and not getting re-infected, this requires a complete re-install of all hardware, which is unfortunately a very big and lengthy process.<br />We cannot yet estimate precisely how long this will take, currently we have new hardware, and a large team of sysadmins is working on setting up routers, networks, hosts, storage based on our documentation.<br />We cannot yet give a proper estimation, but currently expect this could take several days to complete.<br />We will update this page according to the process.</p>tag:hostedcloud.statuspage.io,2005:Incident/173346812023-05-23T09:52:08+02:002023-05-23T09:52:08+02:00[Hosted Exchange] OWA and Outlook issue<p><small>May <var data-var='date'>23</var>, <var data-var='time'>09:52</var> CEST</small><br><strong>Resolved</strong> - The issue has been identified to be one of the major mail databases.<br /><br />It was resolved around 9:30 Copenhagen time.<br /><br />We apologize for any inconvenience this incident may have cause and are working hard to resolve the issue as fast as possible.</p><p><small>May <var data-var='date'>23</var>, <var data-var='time'>01:22</var> CEST</small><br><strong>Identified</strong> - We are aware of the current issue with the Hosted Exchange service, and are working resolving the issue.<br /><br />We apologize for any inconvenience this incident may have cause and are working hard to resolve the issue as fast as possible.<br /><br />CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/103869692022-06-23T14:42:17+02:002023-05-23T01:16:00+02:00[Datacenter in Copenhagen] Cooling issue under investigation<p><small>Jun <var data-var='date'>23</var>, <var data-var='time'>14:42</var> CEST</small><br><strong>Resolved</strong> - Temperaturen er på vej ned igen - og personalet i datacenteret holder et vågent øje med, at problemet ikke genopstår. Vores driftspersonale holder naturligvis også et ekstra vågent øje med sagen de næste timer.<br /><br />Start : 2022-06-23 13:55 CEST<br />Slut : 2022-06-23 14:40 CEST<br />Lokation : Glostrup, Storkøbenhavn<br /><br />Dette var blot en servicemeddelelse og i praksis ikke noget, som skulle være bemærket, idet fejlen blev udbedret indenfor rimelig tid.<br /><br />De bedste hilsner fra CloudNordic Helpdesk and Support Team <br /><br />---<br /><br />The emergency service is currently being carried out on the cooling units in one of our Copenhagen datacenters, and the temperatures are already returning to normal.<br /><br />Planned Start : 2022-06-23 13:55 CEST<br />Planned Stop : 2022-06-23 14:40 CEST<br />Locations : Glostrup, Greater Copenhagen<br /><br />This was a service announcement and should practically not have been noticeable in operational aspects.<br /><br />All the best from the CloudNordic Helpdesk and Support Team</p><p><small>Jun <var data-var='date'>23</var>, <var data-var='time'>13:55</var> CEST</small><br><strong>Identified</strong> - Der er i øjeblikket akut service på kølesystemet i et af vores datacenter i Storkøbenhavn.<br /><br />Der kan være punktvis stigning af temperaturen på den varme side hvilket kan være en mulig årsag hvis I oplever nedsat ydeevne i perioden.<br /><br />Dette er blot en servicemeddelelse og i praksis ikke noget I vil bemærke, såfremt fejlen udbedres indenfor rimelig tid.<br /><br />Start : 2022-06-23 13:55 CEST<br />Slut : 2022-06-23 17:00 CEST (forventet)<br />Lokation : Glostrup, Storkøbenhavn<br /><br />Vi beklager på forhånd, såfremt disse stigende temperaturer giver anledning til driftsudfald, hvilket dog ikke skulle forekomme.<br /><br />De bedste hilsner fra CloudNordic Helpdesk and Support Team <br /><br />---<br /><br />Emergency service is currently being carried out on the cooling units in one of our Copenhagen datacenters. <br /><br />In some areas the temperature might rise on the hot side, which in some rare cases can result in temporarily slower performance.<br /><br />This is a service announcement and should practically not be noticeable.<br /><br />Planned Start : 2022-06-23 13:55 CEST<br />Planned Stop : 2022-06-23 17:00 CEST (expected)<br />Locations : Glostrup, Greater Copenhagen<br /><br />We apologize on before hand, if these temperature issues may cause any disruption in services.<br /><br />All the best from the CloudNordic Helpdesk and Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/96664422022-03-30T14:23:53+02:002023-05-23T01:16:00+02:00[Hosted Exchange] OWA and Outlook client timeout issue<p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>14:23</var> CEST</small><br><strong>Resolved</strong> - Outlook, IMAP and OWA clients are now connecting for all databases once again.<br /><br />Solution: Hosted Exchange<br /><br />Start: 30-03-2022 @ 13:55 CET<br />End: 30-03-2022 @14:05 CET<br /><br />We apologize for any inconvenience this incident may have caused.<br /><br />CloudNordic Helpdesk & Support Team</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>14:01</var> CEST</small><br><strong>Monitoring</strong> - Outlook, IMAP and OWA clients are having issues connecting for certain databases. <br /><br />We are currently working on resolving in the Hosted Exchange solution.<br /><br />We have found the root cause that has been causing a few periodic timeouts, which is due to timeout on certain databases but not all, as they are set as disconnected in Exchange<br /><br />The issue should hopefully be resolved within the hour, as we need to disconnect and reconnect the databases.<br /><br />Solution: Hosted Exchange<br /><br />Start: 30-03-2022 @ 13:55 CET<br />End: 30-03-2022 @15:00 CET (estimated)<br /><br />We apologize for any inconvenience this incident may have cause and are working hard to resolve the issue as fast as possible.<br /><br />CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/93043272022-02-19T18:07:15+01:002023-05-23T01:16:00+02:00[Planned service 19-02-2022] Security updates and reboot of servers and technical equipment<p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>18:07</var> CET</small><br><strong>Resolved</strong> - Our planned service window of today, Saturday, February 19th, 2022, is hereby concluded. <br /><br />During the service window, we security updated and rebooted servers for Shared and Dedicated Hosting, besides upgrading the technical network equipment upon which the services are hosted.<br /><br />Start: 19-02-2022 @ 13:00 CET<br />End: 19-02-2022 @ 18:00 CET (eg. most services were online at 17:00 CET)<br /><br />Services that were affected; IceWarp, Postfix POP3/IMAP e-mail, OpenXchange, Webhotel, VPS services, Webshops, DNS admin system, ISPconfig and Cloud Backup solutions<br /><br />Services that were not affected; DNS, Odin Control Panel, Hosted Exchange and Roundcube/Dovecot Pro solutions, dedicated physical customer servers<br /><br />We apologize for the interruption, which occured during the service window.<br /><br />Sincerely Yours from the Cloudnordic Helpdesk and Support Team<br /><br />---<br /><br />Vores planlagte service vindue i dag lørdag den 19. februar 2022 er hermed overstået.<br /><br />Vi foretog opdatering og genstart af vores shared og dedikerede server hosting services udover, at vi opdaterede og genstarte forskellige SAN og netværks enheder services (inkl. vores eget website), hvorunder der også kunne forekomme nedetid.<br /><br />Start: 19-02-2022 @ 13:00 CET<br />Slut: 19-02-2022 @ 18:00 CET (eg. de fleste services var i luften 17.00 CET)<br /><br />Berørte services; IceWarp, Postfix POP3/IMAP e-mail, OpenXchange, Webhotel, VPS services, Webshops, DNS admin system, ISPconfig og Cloud Backup løsninger.<br /><br />Services som ikke blev berørt; DNS, Odin kontrolpanel, Hosted Exchange and Roundcube/Dovecot Pro solutions, dedikerede fysiske kunde server løsninger.<br /><br />Vi beklager den nedetid som nævnte servicevindue måtte have medføret.<br /><br />De bedste hilsner fra Cloudnordic Helpdesk og Support Teamet</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>12:13</var> CET</small><br><strong>Monitoring</strong> - We plan to security update and reboot servers for Shared and Dedicated Hosting on Saturday, February 19th, 2022, besides upgrading the technical network equipment upon which the services are hosted.<br /><br />During the patch period you can expect some downtime, during the patch itself and whilst our system engineers reboot the technical equipment.<br /><br />Services will be shortly unavailable during the service window, while services are updated and rebooted.<br /><br />Start: 19-02-2022 @ 13:00 CET<br />End: 19-02-2022 @ 18:00 CET (expected)<br /><br />Services affected; IceWarp, Postfix POP3/IMAP e-mail, OpenXchange, Webhotel, VPS services, Webshops, DNS admin system, ISPconfig and Cloud Backup solutions<br /><br />Services not affected; DNS, Odin Control Panel, Hosted Exchange and Roundcube/Dovecot Pro solutions, dedicated physical customer servers<br /><br />We apologize for the short interruption which will occur during this service window.<br /><br />Sincerely Yours from the CloudNordic Helpdesk and Support Team<br /><br />---<br /><br />Vi forventer at foretage opdatering og genstart af vores shared og dedikerede server hosting services lørdag den 19. februar 2022.<br /><br />Vi vil indenfor nævnte service vindue opdatere og genstarte forskellige services (inkl. vores eget website), hvorfor der kan forekomme udfald på services under disse opgavers udførsel.<br /><br />Start: 19-02-2022 @ 13:00 CET<br />Slut: 19-02-2022 @ 18:00 CET (forventet)<br /><br />Berørte services; IceWarp, Postfix POP3/IMAP e-mail, OpenXchange, Webhotel, VPS services, Webshops, DNS admin system, ISPconfig og Cloud Backup løsninger.<br /><br />Services som ikke forventes berørt; DNS, Odin kontrolpanel, Hosted Exchange and Roundcube/Dovecot Pro solutions, dedikerede fysiske kunde server løsninger.<br /><br />Vi beklager den nedetid som nævnte servicevindue måtte medføre.<br /><br />De bedste hilsner fra CloudNordic Helpdesk og Support Teamet</p>tag:hostedcloud.statuspage.io,2005:Incident/90487302022-01-10T21:10:29+01:002023-05-23T01:16:00+02:00[Planned service 10th January 2022] Server upgrade Dovecot + Roundcube+Dovecot Pro<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>21:10</var> CET</small><br><strong>Resolved</strong> - The ressources have been added to the Roundcube+Dovecot Pro server setup and the server has been restarted and functions correctly.<br /><br />Start: 10-01-2022 @ 21:00 CET<br />End: 10-01-2022 @ 21:03 CET<br /><br />---<br /><br />This service window ended (and was closed) via a full functionality test, which ended 10-01-2022 @ 21:05 CET.<br /><br />Best Regards from the CloudNordic Helpdesk & Support Team</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>21:00</var> CET</small><br><strong>Monitoring</strong> - We will begin a planned service window of the Roundcube+Dovecot Pro server at 21:00 CET today, where a planned hardware upgrade will take place.<br /><br />After the reboot has taken place, we will revert with further information.<br /><br />Best Regards from the CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/87777852021-12-07T15:18:18+01:002023-05-23T01:16:00+02:00[Datacenter] Internet Service Provider (ISP) main power issues<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>15:18</var> CET</small><br><strong>Resolved</strong> - Update; 07-12-2021 @14.00 CET<br /><br />City power has been restored and all power distrubution units are all once again fully operational.<br /><br />Incident start: December 7th, 2021 @ 08:10 CET<br />Incident end: December 7th, 2021 @ 14:00 CET<br /><br />Our technical staff remained onsite during the entire incident to observe and immediately engage, should any further issues have arised due to the city power distribution issue.<br /><br />We sincerely apologize for the service interruption and the problem may have been causing to the customers in the time interval of 08:10 to 08:55 CET were affected by the SAN storage entering standby mode during the primary power distribution failure and redundancy from diesel and UPS generators.<br /><br />All affected customers were contacted by phone during the interruption.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services<br /><br />---<br />Datacenter levering af A-feed (bystrøm) er fuldt ud genetableret og operationelt igen.<br /><br />Start: 7. December 2021 @ 08:10 CET<br />Slut: 7. December 2021 @ 14:00 CET<br /><br />Vores teknikere forblev på lokationen under hele seancen, så de kunne skride ind og tage action, skulle yderligere probelmer været opstået imens dieselgenerator og UPS systemer leverede den redundante strøm.<br /><br />Vi beklager eventuelle gener denne strømafbrydelse måtte have forårsaget, hvilke kunder vi har været telefonisk i kontakt med i tidsrummet 08:10 - 08:55 da det ene SAN gik i standby mode og skulle have ekstra strøm feed fra diesel og UPS strøm distributionen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>09:59</var> CET</small><br><strong>Update</strong> - Update; 07-12-2021 @10.00 CET<br /><br />All systems are fully operational, but power distribution is still supplied via the diesel and UPS power distrbution unit, as the entire datacenter area is affected by city power issues.<br /><br />However, the power issue which earlier unfortunately affected the Storage Array Network (SAN) systems secondary power supply has been resolved. <br /><br />The PSU issues with the SAN system going into standby mode was resolved at 08:55 CET.<br /><br />For some reason that failover power supply for SAN power was available but forced the SAN system into standby mode, when the diesel and UPS power supply kicked in.<br /><br />It is now being investigated and mitigated by our technical staff, as we currently have placed the secondary part of the primary power supply directly together with third (failover) in the diesel and UPS power distrubution unit.<br /><br />For the ongoing city power issue, we have received the following operational information from the ISP and datacenter provider;<br /><br />Incident start: December 7th, 2021 @ 08:10 CET<br />Incident end: December 7th, 2021 @ 11:00 CET (expected)<br /><br />Our technical staff is still onsite to observe and immediately engage, should any further issues arise due to the ongoing city power distribution issue.<br /><br />We sincerely apologize for the service interruption and the problem may have been causing.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services<br /><br />---<br /><br />Vores Internet Service Provider (ISP) og datacenteret er desværre stadig ramt af strømafbrydelse, men alle vores systemer kører på UPS samt dieselgenerator strøm med fuld tilgængelighed.<br /><br />Det Storage Array Network (SAN) som midlertidigt blev ramt af strømafbrydelsen og er af en eller anden årsag ikke var kørende på den redundante strøm er igen i luften, ved at vi flyttede den sekundære primære strømforsyning til diesel og USP strøm, så den sidder sammen med den tredje strømforsynings enhed i samme PDU (power distribution unit).<br /><br />Kun enkelte POP3/IMAP løsninger blev ramt af dette issue og vi har stadig en tekniker på stedet som observerer alle system imens strømafbrydelsen er igang.<br /><br />Vi fik løst dette problem klokken 08:55 CET, hvorefter de enkelte påvirkede POP3 og IMAP løsninger igen var i luften.<br /><br />Vores ISP og datacenter leverandør har meldt følgende om strømafbrydelsen;<br /><br />Start: 7. December 2021 @ 08:10 CET<br />Slut: 7. December 2021 @ 11:00 CET (forventet)<br /><br />Vi har været i telefonisk kontakt med kunder på nævnte SAN i tidsrummet hvor det ikke var tilgængeligt og i standby mode.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>08:28</var> CET</small><br><strong>Monitoring</strong> - Our Service Provider are having power issues, which are unfortunately affecting the Storage Array Network (SAN) system. For some reason that SAN is not available on the secondary diesel and UPS power supply, which is being investigated and mitigated by our technical staff.<br /><br />Our Exchange mail, OWA and OpenXchange AppSuite solutions are responding without any problems..<br /><br />Affected systems: POP3/IMAP mail services<br /><br />Incident start: December 7th, 2021 @ 08:10 CET<br />Inciden end: December 7th, 2021 @ 09:00 CET (expected)<br /><br />We sincerely apologize for the service interruption and the problem be causing.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services<br /><br />---<br /><br />Vores Internet Service Provider (ISP) er ramt af strømafbrydelse og vores systemer kører på UPS samt dieselgenerator strøm.<br /><br />Desværre er vores Storage Array Network (SAN) ramt af strømafbrydelsen og er af en eller anden årsag ikke kørende på redudant strøm selvom det er sat op og tidligere testet funktionelt.<br /><br />Kun enkelte POP3/IMAP løsninger er ramt af dette issue og vi har en tekniker på stedet til at udbedre fejlen.<br /><br />Start: 7. December 2021 @ 08:10 CET<br />Slut: 7. December 2021 @ 09:00 CET (forventet)<br /><br />Vi beklager på det denne strøm afbrydelse af enkelte services og de eventuelle gener afbrydelsen måtte have medført.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services</p>tag:hostedcloud.statuspage.io,2005:Incident/86886392021-11-25T15:05:45+01:002023-05-23T01:16:00+02:00[Datacenter] Internet Service Provider (ISP) network issues<p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>15:05</var> CET</small><br><strong>Resolved</strong> - Vores Internet Service Provider (ISP) har løst problemet i deres core netværk i kommunikation med ind og udgående trafik imod TDC netværk, som kortvarigt berører vores services.<br /><br />Det lader til, at det kan vise sig at være kommunikations issues i selve det danske internet, som var mulig årsag, som dermed påvirkede trafik ind og udgående ift. selve datacenteret, idet vi har hørt at også andre udbydere var nede med websites og mail. Dette er ved at blive undersøgt nærmere.<br /><br />Vores teknikere var konstant i kontakt med ISP leverandøren imens fejlen blev udbedret.<br /><br />Start: 25. november 2021 @ 11:11 CET<br />Slut: 25. november 2021 @ 14:50 CET<br /><br />Vi beklager på det denne netværks afbrydelse af enkelte services og de eventuelle gener afbrydelsen måtte have medført.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services<br /><br />---<br /><br />Our Service Provider has fixed their core network issue, which unfortunately affected some of our networks and services.<br /><br />Apparently it was a pierring issue between several ISPs in the Danish Internet, which could have been root cause for the degraded Internet access at our datacenter, as it affected our ISP core network. This is being investigated further at this time.<br /><br />Our Exchange mail, OWA and OpenXchange AppSuite solutions were responding without any problems, whereas other types of e-mail and webserver functions were degraded in performance. <br /><br />Affected systems: Some website, POP3/IMAP and VPS hosting<br /><br />Start: 25. november 2021 @ 11:11 CET<br />End: 25. november 2021 @ 14:50 CET<br /><br />We sincerely apologize for the service interruption and the problems it may have caused.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>14:39</var> CET</small><br><strong>Monitoring</strong> - Vores Internet Service Provider (ISP) har en fejl i deres redundante core netværk i kommunikation med ind og udgående trafik imod TDC netværk, som kortvarigt berører vores services, der burde være oppe meget snart.<br /><br />Det er primært TDC netværk som er berørt inkl. deres underleverandører, såsom ADSL via TV og teleudbydere i TDC koncernen.<br /><br />Vores teknikere er i kontakt med ISP leverandøren og fejlen er er ved at blive udbedret.<br /><br />Start: 25. november 2021 @ 11:11 CET<br />Slut: 25. november 2021 @ 14:45 CET (forventet)<br /><br />Vi beklager på det denne netværks afbrydelse af enkelte services og de eventuelle gener afbrydelsen måtte medføre.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services<br /><br />---<br /><br />Our Service Provider is currently fixing a redundant core network issue, which unfortunately is affecting our networks and services.<br /><br />Our Exchange mail, OWA and OpenXchange AppSuite solutions are responding without any problems, whereas other types of e-mail and webserver functions are currently offline. However, they are still operational, but simply not reachable at this time.<br /><br />Affected systems: Some website, POP3/IMAP and VPS hosting<br /><br />Start: 25. november 2021 @ 11:11 CET<br />End: 25. november 2021 @ 14:40 CET (expected)<br /><br />We sincerely apologize for the service interruption and will keep you informed about progress as we receive further news.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services</p>tag:hostedcloud.statuspage.io,2005:Incident/81369162021-10-02T15:31:39+02:002023-05-23T01:16:00+02:00[Datacenter ISP] Network outage due to Internet Service Provider access problem<p><small>Oct <var data-var='date'> 2</var>, <var data-var='time'>15:31</var> CEST</small><br><strong>Resolved</strong> - Our Service Provider fixed the core network issue, which unfortunately affected one of our networks, where some IMAP/POP3, webhotel, DNS and VPS servers were shortly offline.<br /><br />Our Exchange mail, OWA and OpenXchange AppSuite solutions were responding without any problems during the issue.<br /><br />Affected systems: Some websites, POP3/IMAP and VPS hosting<br /><br />Incident start: October 1st, 2021 @ 14:40 CET<br />Inciden end: October 1st, 2021 @ 15:15 CET<br /><br />We sincerely apologize for the service interruption and the problemes it may have caused.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services<br /><br />---<br /><br />Vores Internet Service Provider (ISP) rettet en forkert oprettet ændring i deres core netværk, som desværre kortvarigt ramte en af vores c-klasser, hvilket desværre gjorde at visse POP3/IMAP e-mail samt webhotel og VPSer blev berørt.<br /><br />Vores teknikere var straks i kontakt med ISP leverandøren og fejlen er nu udbedret.<br /><br />Start: 1. oktober 2021 @ 14:40 CET<br />Slut: 1. oktober 2021 @ 15:15 CET<br /><br />Vi beklager på det denne netværks afbrydelse af enkelte services og de eventuelle gener afbrydelsen måtte have medført.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services</p><p><small>Oct <var data-var='date'> 2</var>, <var data-var='time'>15:00</var> CEST</small><br><strong>Monitoring</strong> - Our Service Provider is trying to fix a core network issue, which unfortunately affected one of our networks, where some IMAP/POP3, webhotel, DNS and VPS servers were shortly offline.<br /><br />Our Exchange mail, OWA and OpenXchange AppSuite solutions were responding without any problems, whereas some mail and webserver functions are currently offline. However, they are still operational, but simply not reachable.<br /><br />Affected systems: Some website, POP3/IMAP and VPS hosting<br /><br />Incident start: October 1st, 2021 @ 14:40 CET<br />Inciden end: October 1st, 2021 @ 15:30 CET (expected)<br /><br />We sincerely apologize for the service interruption and will keep you informed about progress as we receive further news.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services<br /><br />---<br /><br />Vores Internet Service Provider (ISP) foretager i øjeblikket en ændring i deres core netværk, som desværre kortvarigt har ramt en af vores c-klasser, hvilket desværre gjorde at visse POP3/IMAP e-mail samt webhotel og VPSer blev berørt.<br /><br />Vores teknikere var straks i kontakt med ISP leverandøren og fejlen er udbedret.<br /><br />Start: 1. oktober 2021 @ 14:40 CET<br />Slut: 1. oktober 2021 @ 15:30 CET (forventet) <br /><br />Vi beklager på det denne netværks afbrydelse af enkelte services og de eventuelle gener afbrydelsen måtte have medføre.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services</p>tag:hostedcloud.statuspage.io,2005:Incident/81121172021-09-29T16:16:43+02:002023-05-23T01:16:01+02:00[Datacenter Network] Short datacenter Internet Provider Core network timeout<p><small>Sep <var data-var='date'>29</var>, <var data-var='time'>16:16</var> CEST</small><br><strong>Resolved</strong> - Our Service Provider fixed a core network issue, which unfortunately affected one of our networks, where some IMAP/POP3, webhotel, DNS and VPS servers were shortly offline.<br /><br />Our Exchange mail, OWA and OpenXchange AppSuite solutions were responding without any problems, whereas some mail and webserver functions are currently offline. However, they are still operational, but simply not reachable.<br /><br />Affected systems: Some website, POP3/IMAP and VPS hosting<br /><br />Incident start: September 29th, 2021 @ 15:34 CET<br />Inciden end: September 29th, 2021 @ 15:58 CET<br /><br />We sincerely apologize for the service interruption and will keep you informed about progress as we receive further news.<br /><br />Yours faithfully, CloudNordic Support & Helpdesk services<br /><br />---<br /><br />Vores Internet Service Provider (ISP) foretog en ændring i deres core netværk, som kortvarigt har ramt en af vores c-klasser, hvilket desværre gjorde at visse POP3/IMAP e-mail samt webhotel og VPSer blev berørt.<br /><br />Vores teknikere var straks i kontakt med ISP leverandøren og fejlen er udbedret.<br /><br />Start: 29. september 2021 @ 15:34 CET<br />Slut: 29. september 2021 @ 15:58 CET<br /><br />Vi beklager på det denne korte netværks afbrydelse af enkelte services og de eventuelle gener afbrydelsen måtte have medført.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk services</p>tag:hostedcloud.statuspage.io,2005:Incident/80345072021-09-26T16:04:53+02:002023-05-23T01:16:01+02:00[Datacenter in Jutland] Service window September 25th, 2021 re. replication of servers<p><small>Sep <var data-var='date'>26</var>, <var data-var='time'>16:04</var> CEST</small><br><strong>Resolved</strong> - Most Shared Hosting servers including e-mail, webshop, VPS og webhotel<br /><br />Alle øvrige løsninger var ikke berørte af flytningen, herunder Hosted Exchange, OpenXchange (OX) mail, dedikerede servere og primær DNS, idet de blev serviceret fra andre datacentre.<br /><br />Datacenter migration: Jutland >> Copenhagen in Denmark<br /><br />Start: 26-09-2021 12:00 CET<br />Slut: 26-09-2021 16:00 CET<br /><br />We apologize for any inconvenience this service window may caused as we tried to keep the migration of servers to an absolute minimum during the datacenter transfer process of the servers.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />De fleste servere inkl. e-mail, webshop, VPS og webhoteller er nu replikeret færdige og flyttet endeligt over til datacenteret i København.<br /><br />Nogle enkelte webhotel servere stadig er undervejs, men vil være i luften inden aften.<br /><br />Alle øvrige løsninger var ikke berørte af flytningen, herunder Hosted Exchange, OpenXchange (OX) mail, dedikerede servere og primær DNS, idet de blev serviceret fra andre datacentre.<br /><br />Datacenter flytning: Jylland >> København<br /><br />Start: 26-09-2021 12:00 CET<br />Slut: 26-09-2021 16:00 CET<br /><br />Vi beklager eventuelle gener og driftsforstyrrelser, som blev observeret, imens vi migrerede servere over imellem de to datacentre, hvergang vi slukkede for en server i Jylland og tændte den igen i København.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team</p><p><small>Sep <var data-var='date'>26</var>, <var data-var='time'>13:17</var> CEST</small><br><strong>Update</strong> - We are still performing a full replication all servers from our datacenter in Jutland, before the final move to our other datacenter facilities in the Great Copenhagen area can take place.<br /><br />The IP change from the datacenter i Jutland to Copenhagen took place at 12.00, so no servers were affected until then.<br /><br />We are still working on getting servers online, which is an individual restart of each server after final replication has taken place.<br /><br />Datacenter: Jutland<br /><br />Start: 26-09-2021 12:00 CET<br />Slut: 26-09-2021 16:00 CET (expected)<br /><br />Solutions influenced by outage; Shared hosting solutions eg. webhotel, e-mail, webshop and a few dedicated VPS units.<br /><br />All other solutions are not influenced by this service window, as they are already serviced from our other datacenter facilities.<br /><br />We apologize for any inconvenience this service window may cause and we are ensuring that possible downtime is minimized to an absolute minimum.<br /><br />Best Regards from the NordicCloud Support & Helpdesk Team<br /><br />---<br /><br />Vi er stadig igang med at replikere alle servere fra vores datacenter i Jylland til vores andre datacentre i København, inden den endelig flytning kan foretages.<br /><br />IP skiftet fra Jylland til datacentre i København er foretaget, så hver enkel server er således på vej op en ad gangen i øjeblikket.<br /><br />Skiftet af IP startede først klokken 12.00, så det er først fra dette tidspunkt at servere påbegyndte genstart, herunder vores egne hjemmesider.<br /><br />Inden da var alt i luften og kørte normalt, imens data blev replikeret.<br /><br />Datacenter: Jylland<br /><br />Start: 26-09-2021 12:00 CET<br />Slut: 26-09-2021 16:00 CET (forventet)<br /><br />Service vinduet gælder primært vores Shared Hosting ydelser, idet alle øvrige løsninger allerede kører og serviceres fra vores øvrige datacenter faciliteter.<br /><br />Løsninger berørte; Shared hosting løsninger, såsom webhotel, e-mail, webshop og enkelte VPS enheder.<br /><br />Vi beklager eventuelle gener og driftsforstyrrelse som der opleves imens vi vender servere over, og vi vil hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team</p><p><small>Sep <var data-var='date'>25</var>, <var data-var='time'>22:44</var> CEST</small><br><strong>Update</strong> - We are still performing a full replication all servers from our datacenter in Jutland, before the final move to our other datacenter facilities in the Great Copenhagen area can take place.<br /><br />The replication is taking longer than anticipated, as some servers needed extra replication to function properly, which is essential for a successful migration to the other datacenter.<br /><br />Once we start the migration and start the servers in the other datacenter, then there should only be a very short downtime per server, as they need to make a final short couple of minutes.<br /><br />The restart of each server will take place tomorrow morning Sunday and should hopefully be done just before or after lunch for all servers, as it is a individual server restart per server.<br /><br />Datacenter: Jutland<br /><br />Start: 26-09-2021 08:00 CET<br />Slut: 26-09-2021 13:00 CET (expected)<br /><br />Solutions influenced by outage; Shared hosting solutions eg. webhotel, e-mail, webshop and a few dedicated VPS units.<br /><br />All other solutions are not influenced by this service window, as they are already serviced from our other datacenter facilities.<br /><br />We apologize for any inconvenience this service window may have cause and we will ensure that possible downtime is minimized to a minimum.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Vi er stadig igang med at replikere alle servere fra vores datacenter i Jylland til vores andre datacentre i København, inden den endelig flytning kan foretages.<br /><br />Når alle replikeringer er færdige, vil vi foretage en genstart af hver server, hvilket sker en server ad gangen, hvor et netkort skal genopsættes.<br /><br />Opgaven vil blive håndteret via replikering server for server, hvorefter en samlet ændring af alle IP numre vil blive flyttet (annonceret) i de øvrige datacentre. Replikering sikrer, at seneste data er kopieret og funktionelle på to samtidige servere i to samtidige datacentre.<br /><br />Under den sidste replikeringen som sker når serverne genstartes og selve IP ændringen sker, kan der dog godt være lidt længere svartid end normalt, men ikke noget som skulle påvirke oppetider i øvrigt.<br /><br />Det vil være under selve IP skiftet ske en kortere afbrydelse, imens servere stoppes i Jylland og dernæst tændes i København.<br /><br />Dette IP skifte er for en sikkerheds skyld flyttet til søndag formiddag, da vi ønsker at alle servere er fuldt ud replikerede og alle data er kommet med over.<br /><br />Datacenter: Jylland<br /><br />Start: 26-09-2021 08:00 CET<br />Slut: 26-09-2021 13:00 CET (forventet)<br /><br />Service vinduet gælder primært vores Shared Hosting ydelser, idet alle øvrige løsninger allerede kører og serviceres fra vores øvrige datacenter faciliteter.<br /><br />Løsninger berørte; Shared hosting løsninger, såsom webhotel, e-mail, webshop og enkelte VPS enheder.<br /><br />Vi beklager eventuelle gener og driftsforstyrrelse som det er muligt at opleve vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>11:23</var> CEST</small><br><strong>Monitoring</strong> - We hereby announce a service window regarding the full replication and move of all servers from our datacenter in Jutland to our other datacenter facilities in the Great Copenhagen area, placed is the capital of Denmark on the greater island of Zealand.<br /><br />The migration should not include any downtime, except for a restart of each server once it is being shut down in Jutland and started in Copenhagen, which is a matter of minutes and part of this planned service window.<br /><br />All other solutions are not influenced by this service window, as they are already serviced from our other datacenter facilities.<br /><br />Datacenter: Jutland<br /><br />Start: 25-09-2021 22:00 CET<br />Slut: 25-09-2021 00:00 CET (expected)<br /><br />Solutions influenced by outage; Shared hosting solutions eg. Webhotel, e-mail, webshop and a few dedicated VPS units.<br /><br />We apologize for any inconvenience this service window may have cause and we will ensure that possible downtime is minimized to a minimum.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Vi annoncerer hermed, at vi planlægger at replikere og flytte alle servere fra vores datacenter i Jylland til vores andre datacentre i København. <br /><br />Dette er besluttet og sker på baggrund af de strømafbrydelser vi oplevede den 27. august i datacenteret i Jylland, hvilket skabte unødig nedetid for vores Shared Hosting kunder og enkelte dedikeret VPS enheder.<br /><br />Opgaven vil blive håndteret via replikering server for server, hvorefter en samlet ændring af alle IP numre vil blive flyttet (annonceret) i de øvrige datacentre. Replikering sikrer, at seneste data er kopieret og funktionelle på to samtidige servere i to samtidige datacentre.<br /><br />Under selve replikeringen og IP ændringen kan der dog godt være lidt længere svartid end normalt, men ikke noget som skulle påvirke oppetider i øvrigt. <br /><br />Det vil være under selve IP skiftet ske en kortere afbrydelse, imens servere stoppes i Jylland og dernæst tændes i København.<br /><br />Datacenter: Jylland<br /><br />Start: 25-09-2021 22:00 CET<br />Slut: 25-09-2021 00:00 CET (forventet)<br /><br />Service vinduet gælder primært vores Shared Hosting ydelser, idet alle øvrige løsninger allerede kører og serviceres fra vores øvrige datacenter faciliteter.<br /><br />Løsninger berørte; Shared hosting løsninger, såsom webhotel, e-mail, webshop og enkelte VPS enheder.<br /><br />Vi beklager eventuelle gener og driftsforstyrrelse som det er muligt at opleve vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team</p>tag:hostedcloud.statuspage.io,2005:Incident/80310482021-09-19T23:17:53+02:002023-05-23T01:16:01+02:00[Datacenter in Jutland] Network failure on 87.238.248.0/24<p><small>Sep <var data-var='date'>19</var>, <var data-var='time'>23:17</var> CEST</small><br><strong>Resolved</strong> - Vores tekniske support har arbejdet på tidligere nævnt fejl på 87.238.248.0/24 nettet, hvilket påvirkede visse webhoteller og mailservere.<br /><br />Tidsrummet afbrydelsen skete i er som følger;<br /><br />Datacenter; Jylland<br /><br />Start 19-09-2021 @ 22.15 CET<br />Slut 19-09-2021 @ 23:05 CET<br /><br />Påvirkede løsninger: Visse mail, webshop, webhotel og VPS løsninger<br /><br />Vi beklager eventuelle gener denne afbrydelse må have betydet for jer!<br /><br />The CloudNordic Helpdesk & Support Team<br /><br />---<br /><br />Our technical taskforce has reestablished the route to 87.238.248.0/24, as the network was unavailable for access.<br /><br />Datacenter; Jutland<br /><br />Start 19-09-2021 @ 22.15 CET<br />End 19-09-2021 @ 23:05 CET<br /><br />Solutions influenced: Some servers including mail, webshop, VPS and webhotel solutions<br /><br />We apologize for any inconveniences and disruptions may have cause.<br /><br />Sincerely yours from the CloudNordic Helpdesk & Support Team</p><p><small>Sep <var data-var='date'>19</var>, <var data-var='time'>22:55</var> CEST</small><br><strong>Monitoring</strong> - Vores tekniske support arbejder i øjeblikket med en fejl på 87.238.248.0/24 nettet, hvilket påvirker visse webhoteller og mailservere.<br /><br />Vi er på sagen og er i fuld gang med at få dette net til at fungere korrekt igen, idet øvrige alle øvrige C-klasser svaer korrekt.<br /><br />Tidsrummet afbrydelsen skete i er som følger;<br /><br />Datacenter; Jylland<br /><br />Start 19-09-2021 @ 22.15 CET<br />Slut 19-09-2021 @ 23:30 CET (forventet)<br /><br />Påvirkede løsninger: Visse mail, webshop, webhotel og VPS løsninger<br /><br />Vi beklager eventuelle gener denne afbrydelse må have betydet for jer!<br /><br />The CloudNordic Helpdesk & Support Team<br /><br />---<br /><br />Our technical taskforce is currently working on reestablishing the route to 87.238.248.0/24, as the network is currently unavailable for access.<br /><br />We are working very hard to reestablish the network and <br /><br />Datacenter; Jutland<br /><br />Start 19-09-2021 @ 22.15 CET<br />End 19-09-2021 @ 23:30 CET (expected)<br /><br />Solutions influenced: Some servers including mail, webshop, VPS and webhotel solutions<br /><br />We apologize for any inconveniences and disruptions may have cause.<br /><br />Sincerely yours from the CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/79697702021-09-11T13:13:10+02:002023-05-23T01:16:01+02:00[Datacenter in Jutland] Restart of a single server blade<p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>13:13</var> CEST</small><br><strong>Resolved</strong> - Vores tekniske support blev desværre akut nødt til at genstarte et server blade i vores VMware server farm, idet en del maskiner i vores vCenter løsning var låst og ikke kunne replikere, og dermed ikke vil lade sig migrere imellem andre enheder i løsningen.<br /><br />En enkelt dedikeret kundeserver var berørt i lidt længere tid, hvilket påviste fejlen og desværre medførte, at vi måtte foretage denne genstart af nævnte server blade.<br /><br />Tidsrummet afbrydelsen skete i er som følger;<br /><br />Datacenter; Jylland<br /><br />Start 11-09-2021 @ 12.45 CET<br />Slut 11-09-2021 @ 13:05 CET<br /><br />Påvirkede løsninger: Mail, webshop, webhotel og VPS<br /><br />Vi beklager eventuelle gener denne korte afbrydelse må have betydet for jer!<br /><br />De bedste hilsner fra CloudNordic Helpdesk & Support Team<br /><br />---<br /><br />Our vCenter solution did not allowing servers to hot migrate and we therefore needed to reboot one server blade node in our VMware vSphere solution, which will cause a short downtime.<br /><br />A single dedicate customer server was impacted somewhat longer and was the incident that lead to the decision of restarting the blade server restart, as it proved to us we were unable to hot migrate and replicate servers between datacenters.<br /><br />Datacenter; Jutland<br /><br />Start 11-09-2021 @ 12.45 CET<br />Slut 11-09-2021 @ 13:05 CET<br /><br />Solutions influenced: Many servers including mail, webshop, VPS and webhotel<br /><br />We apologize for any inconveniences and disruptions this restart of a single blade may have caused.<br /><br />Sincerely yours from the CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/78627112021-09-01T23:00:03+02:002023-05-23T01:16:01+02:00[Datacenter in Jutland] Power outage on both A and B power feed<p><small>Sep <var data-var='date'> 1</var>, <var data-var='time'>23:00</var> CEST</small><br><strong>Resolved</strong> - Nu er der gået nogle dage med ekstraordinær overvågning af årsag til strøm udfaldet i datacenteret i Jylland den 28-08-2021.<br /><br />Vi de-eskalerer derfor vores ekstra overvågning af årsagen til at strøm fejlede på både primær (A) og sekundær (B) strømkilde, hvilket vi fandt og rettede i nogle power distributions enheder.<br /><br />Løsninger der var berørte af nedetid; VPS, Webhotel, e-mail, webshop og DNS.<br /><br />Datacenter: Jylland<br /><br />Start: 28-08-2021 12:00 CET<br />Slut: 28-08-2021 imellem 14:30 - 15:00 CET kom alting ting online<br /><br />Løsninger ikke berørte; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Some time has gone by since the power outage incident took place on August 28th.<br /><br />We therefore de-escalate the extra surveillance of the primary and root cause for solutions being influenced by outage; VPS, Webhotel, e-mail, webshop and DNS.<br /><br />The suspected surcharge in some power distribution units are still believed be the root cause reason for power outage of both primary (A) and secondary (B) power feed.<br /><br />Solutions affected by the downtime; VPS, Webhotel, e-mail, webshop and DNS.<br /><br />Start: 28-08-2021 12:00 CET<br />End: 28-08-2021 between 14:30 - 15:00 CET things came online again<br /><br />Solutions not influenced by outage; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>16:52</var> CEST</small><br><strong>Update</strong> - Vi mener nu endelig, at vi har fundet årsagen til at der sker en overspænding, som forårsager at strøm fejler på både primær (A) og sekundær (B) strømkilde, hvilket er fundet i nogle power distributions enheder.<br /><br />Løsninger berørte af nedetid; VPS, Webhotel, e-mail, webshop og DNS.<br /><br />Datacenter: Jylland<br /><br />Start: 28-08-2021 12:00 CET<br />Slut: 28-08-2021 imellem 14:30 - 15:00 CET kom alting ting online<br /><br />Løsninger ikke berørte; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Vi beklager virkelig driftsforstyrrelsen og vender hurtigst muligt tilbage skulle der ske en yderligere udvikling i sagen, som vil påvirke driften.<br /><br />Hertil vil vi forsøge at svare så mange henvendelser som muligt, så hurtigt vi kan i vores support system.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />We believe now, that we have identified the primary and root cause for solutions being influenced by outage; VPS, Webhotel, e-mail, webshop and DNS.<br /><br />A suspected surcharge in some power distribution units are thought to be the root cause reason for power outage of both primary (A) and secondary (B) power feed.<br /><br />Solutions affected by downtime; VPS, Webhotel, e-mail, webshop and DNS.<br /><br />We are monitoring all these systems as they have come online now, and will continue our efforts to answer all requests sent in.<br /><br />Solutions not influenced by outage; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Start: 28-08-2021 12:00 CET<br />End: 28-08-2021 between 14:30 - 15:00 CET things came online again<br /><br />We apologize very much for any inconvinience this incident may have caused.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>13:55</var> CEST</small><br><strong>Update</strong> - Vi mener nu endelig, at vi har fundet årsagen til at der sker en overspænding, som forårsager at strøm fejler på både primær (A) og sekundær (B) strømkilde.<br /><br />Vi er i færd med at undersøge dette sammen med site manager i datacenteret.<br /><br />Løsninger ikke berørte; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Datacenter: Jylland<br /><br />Start: 28-08-2021 12:00 CET<br />Slut (forventet): 28-08-2021 14:30 CET<br /><br />Vi beklager virkelig driftsforstyrrelsen og vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />We believe we have finally found the root cause for solutions being influenced by outage; VPS, Webhotel, e-mail, webshop and DNS.<br /><br />The suspected surchage is the reason for power outage of both primary (A) and secondary (B) power feed, which we are currently investigating together with the site manager of the datacenter.<br /><br />Solutions not influenced by outage; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Start: 28-08-2021 12:00 CET<br />End (expected): 28-08-2021 14:30 CET<br /><br />We sincerely apologize for any inconvinience this may cause.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>13:20</var> CEST</small><br><strong>Update</strong> - Alle løsninger berørte; VPS, Webhotel, e-mail, webshop og DNS er på vej op igen. Det er muligvis en overspænding som er årsag til at strøm fejler på både primær (A) og sekundær (B) strømkilde.<br /><br />Vi er i færd med at undersøge dette sammen med site manager i datacenteret.<br /><br />Løsninger ikke berørte; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Datacenter: Jylland<br /><br />Start: 28-08-2021 12:00 CET<br />Slut (forventet): 28-08-2021 13:30 CET<br /><br />Vi beklager driftsforstyrrelsen og vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Our datacenter in Jutland are gradually coming online for all solutions influenced by outage; VPS, Webhotel, e-mail, webshop and DNS.<br /><br />A surchage is the suspected reason for power outage of both primary (A) and secondary (B) power feed, which we are currently investigating together with the site manager of the datacenter.<br /><br />Solutions not influenced by outage; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Start: 28-08-2021 12:00 CET<br />End (expected): 28-08-2021 13:30 CET<br /><br />We apologize for any inconvinience this may cause.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>12:03</var> CEST</small><br><strong>Monitoring</strong> - Vores datacenter i Jylland er i øjeblikket offline og vi er ved at undersøge årsagen herfor.<br /><br />Løsninger berørte; VPS, Webhotel, e-mail, webshop og DNS<br /><br />Løsninger ikke berørte; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Datacenter: Jylland<br /><br />Start: 28-08-2021 12:00 CET<br />Slut (forventet): 28-08-2021 13:00 CET<br /><br />Vi beklager driftsforstyrrelsen og vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Our datacenter in Jutland is currently offline and we are investigating the reason for the outage.<br /><br />Solutions influenced by outage; VPS, Webhotel, e-mail, webshop and DNS<br /><br />Solutions not influenced by outage; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Start: 28-08-2021 12:00 CET<br />End (expected): 28-08-2021 13:00 CET<br /><br />We apologize for any inconvinience this may cause.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p>tag:hostedcloud.statuspage.io,2005:Incident/78571002021-08-27T18:31:10+02:002023-05-23T01:16:01+02:00[Datacenter in Jutland] Power outage on both A and B power feed<p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>18:31</var> CEST</small><br><strong>Resolved</strong> - Vi beklager driftsforstyrrelsen, der skyldtes et total strømafbrydelse og fejl på UPS anlæg i det datacenter vi bruger i Jylland.<br /><br />Det var webhotel, POP3/IMAP e-mail og webshops som var berør at udfaldet indtil vi vi genetableret alle storage og server blades.<br /><br />Alt udstyr fra Jylland vil i næste uge derfor blive migreret til vores andre datacentre på Sjælland. Det vil ikke medføre mere nedetid end få minutter per server, idet der kun er tale om en genstart efter migrering af data er gennemført. Dette vil så blive annonceret i et service vindue her på siden.<br /><br />Visse interne systemer er dog stadig berørte af strømafbrydelsen, hvilket kan forårsage mere unødig nedetid, så det kan være at vi bliver nødt til at foretage en hurtigere flytning end først planlagt.<br /><br />Det vil så blive annonceret her på siden hurtigst muligt fra beslutningen tages.<br /><br /><br />Datacenter: Jylland<br /><br />Start: 27-08-2021 14:30 CET<br />Slut: 27-08-2021 17:00 CET<br /><br />Løsninger berørte; Webhotel, e-mail, webshop og DNS, idet øvrige løsninger blev leveret fra andre datacentre.<br /><br /><br />Vi beklager driftsforstyrrelsen og vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Our datacenter in Jutland is once again fully operational upon a total power outage of primary and secondary power (B), which will incur that we will migrate all servers to our datacenter facilities in the Great Copenhagen area on the island of Zealand sometime next week.<br /><br />The migration should not include more downtime, except for a restart of each server, which is a matter of minutes and will be planned in a service window.<br /><br />However, some internal management systems are still affected by the power outage, which means that we may need to make an emergency move of all technical equipment during this weekend.<br /><br />If so, that will be announced on this website.<br /><br /><br />Start: 27-08-2021 14:30 CET<br />End: 27-08-2021 17:00 CET<br /><br />Solutions influenced by outage; Webhotel, e-mail, webshop and DNS, as other solutions were serviced and provided from other datacenters.<br /><br />We apologize for any inconvinience this may have caused.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p><p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>15:41</var> CEST</small><br><strong>Monitoring</strong> - Vores datacenter i Jylland er stadigvæk offline og vi er igang med at udbedre problemet, der skyldes at både A (primær) og B (sekundær) strøm gik.<br /><br />Vores teknikere arbejder hårdt på at bringe alle løsninger online igen, men der kan godt gå lidt tid endnu.<br /><br />Løsninger berørte; Webhotel, e-mail, webshop og DNS<br /><br />Løsninger ikke berørte; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Datacenter: Jylland<br /><br />Start: 27-08-2021 14:30 CET<br />Slut (forventet): 27-08-2021 18:00 CET<br /><br />Vi beklager driftsforstyrrelsen og vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Our datacenter in Jutland is still offline, due to a power outage of both primary (A) and secondary failover (B) power. <br /><br />Our operational staff are working hard to improve the situation and bring solutions online once again.<br /><br />Solutions influenced by outage; Webhotel, e-mail, webshop and DNS<br /><br />Solutions not influenced by outage; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Start: 27-08-2021 14:30 CET<br />End (expected): 27-08-2021 18:00 CET<br /><br />We apologize for any inconvinience this may cause.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p><p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>14:49</var> CEST</small><br><strong>Identified</strong> - Vores datacenter i Jylland er i øjeblikket offline og vi er ved at undersøge årsagen herfor, hvilket dog tyder på strømudfald på både A og B strøm feed.<br /><br />Løsninger berørte; VPS, Webhotel, e-mail, webshop og DNS<br /><br />Løsninger ikke berørte; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Datacenter: Jylland<br /><br />Start: 27-08-2021 14:30 CET<br />Slut (forventet): 27-08-2021 15:30 CET<br /><br />Vi beklager driftsforstyrrelsen og vender hurtigst muligt tilbage med ny information i sagen.<br /><br />De bedste hilsner fra CloudNordic Support & Helpdesk Team<br /><br />---<br /><br />Our datacenter in Jutland is currently offline and we are investigating the reason for the outage, which seems to be outage on both primary A and secondary B power feed, which caused the incident.<br /><br />Solutions influenced by outage; VPS, Webhotel, e-mail, webshop and DNS<br /><br />Solutions not influenced by outage; Hosted Exchange, OpenXchange og DNS (failover)<br /><br />Start: 27-08-2021 14:30 CET<br />End (expected): 27-08-2021 15:30 CET<br /><br />We apologize for any inconvinience this may cause.<br /><br />Best Regards from the CloudNordic Support & Helpdesk Team</p>tag:hostedcloud.statuspage.io,2005:Incident/77901422021-08-18T16:00:11+02:002023-05-23T01:16:01+02:00[Status] Hosted Exchange downtime issue<p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>16:00</var> CEST</small><br><strong>Resolved</strong> - Hosted Exchange virker igen og vidne serveren (witness) har forstået hvilken server er primær i driftsmiljøet, der spænder over flere samtidige datacentre.<br /><br />Årsagen til fejlen var at netop "witness" serveren forvirrede den primære Exchange dritsnode, så den ikke kunne finde ud af at mounte databaser. <br /><br />Selvom OWA, Outlook og IMAP var tilgængelig under fejlen, kunne disse klienter ikke få adgang til mail databaser af samme årsag og meldte derfor fejl.<br /><br />Løsning: Hosted Exchange OWA og Outlook<br /><br />Start: 18-08-2021 @ 13:30 CET<br />Slut: 18-08-2021 @ 15:40 CET<br /><br />Vi beklager på det kraftigste driftsforstyrrelsen og de gener dette måtte have medført.<br /><br />De allerbedste hilsner,<br /><br />The Cloudnordic Helpdesk & Support Team<br /><br />-----<br /><br />The Hosted Exchange service once again up and running normally.<br /><br />Root cause of the error was due to an error in the understanding on the Exchange witness server, of which Exchange server was the primary mailserver, enforcing the primary Exchange server not to be able to mount mail databases and thus causing outage in service.<br /><br />Even though OWA, IMAP and Outlook services were online during the incident, they were unable to attach to mail storage databases, which caused downtime for client access.<br /><br />Solution: Hosted Exchange OWA and Outlook<br /><br />Start: 18-08-2021 @ 13:30 CET<br />End: 18-08-2021 @ 15:40 CET (expected)<br /><br />We apologize for any inconvenience this incident may have caused.<br /><br />Our very best regards,<br /><br />The Cloudnordic Helpdesk & Support Team</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>15:47</var> CEST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>14:34</var> CEST</small><br><strong>Update</strong> - Hosted Exchange er i øjeblikket nede og vi er igang med at remounte databaser til det primære driftsmiljø, idet det redundante setup er i uoverensstemmelse om hvem der er den primære Exchange løsning.<br /><br />Vi er derfor ved at tvinge de redundante systemer til at forstå, at de ikke er primære, så det primære system igen kan starte databaser op og gå i drift igen.<br /><br />Løsning: Hosted Exchange OWA og Outlook <br /><br />Start: 18-08-2021 @ 13:30 CET<br />Slut: 18-08-2021 @ 15:30 CET (forventet)<br /><br />Vi beklager på det kraftigste driftsforstyrrelsen og de gener dette måtte have medført.<br /><br />De allerbedste hilsner,<br /><br />The Cloudnordic Helpdesk & Support Team<br /><br />-----<br /><br />The Hosted Exchange service is currently non functional as the Exchange redundancy is out of sync and the Exchange environment is in disagreement of which server is currently primary.<br /><br />We are therefore forcing the secondary environments to understand that they are not primary, so that databases can be started on the primary system once again.<br /><br />Solution: Hosted Exchange OWA and Outlook<br /><br />Start: 18-08-2021 @ 13:30 CET<br />End: 18-08-2021 @ 15:30 CET (expected)<br /><br />We apologize for any inconvenience this incident may cause.<br /><br />Our very best regards,<br /><br />The Cloudnordic Helpdesk & Support Team</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>14:33</var> CEST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>13:59</var> CEST</small><br><strong>Update</strong> - Alle Hosted Exchange mail databaser er dismounted og vi er igang med at sørge for at disse bliver remounted - og vender tilbage hurtigst muligt.<br /><br />Løsning: Hosted Exchange OWA og Outlook<br /><br />Start: 18-08-2021 @ 13:30 CET<br />Slut: 18-08-2021 @ 14:30 CET (forventet)<br /><br />Vi beklager på det kraftigste driftsforstyrrelsen og de gener dette måtte have medført.<br /><br />De allerbedste hilsner,<br /><br />CloudNordic Helpdesk & Support Team<br /><br />-----<br /><br />All Hosted Exchange mail databases are dismounted and we are trying to remount the databases - and will return soonest possible with more information.<br /><br />Solution: Hosted Exchange OWA and Outlook<br /><br />Start: 18-08-2021 @ 13:30 CET<br />End: 18-08-2021 @ 14:30 CET (expected)<br /><br />We apologize for any inconvenience this incident may cause.<br /><br />Our very best regards,<br /><br />CloudNordic Helpdesk & Support Team</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>13:38</var> CEST</small><br><strong>Monitoring</strong> - Hosted Exchange er i øjeblikket nede og vi er igang med at undersøge årsagen - og vender tilbage hurtigst muligt.<br /><br />Løsning: Hosted Exchange OWA og Outlook <br /><br />Start: 18-08-2021 @ 13:30 CET<br />Slut: 18-08-2021 @ 14:30 CET (forventet)<br /><br />Vi beklager på det kraftigste driftsforstyrrelsen og de gener dette måtte have medført.<br /><br />De allerbedste hilsner,<br /><br />CloudNordic Helpdesk & Support Team<br /><br />-----<br /><br />We are experiencing that Hosted Exchange is non functional and we are looking into the matter - and will return soonest possible with more information.<br /><br />Solution: Hosted Exchange OWA and Outlook<br /><br />Start: 18-08-2021 @ 13:30 CET<br />End: 18-08-2021 @ 14:30 CET (expected)<br /><br />We apologize for any inconvenience this incident may cause.<br /><br />Our very best regards,<br /><br />CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/77695742021-08-16T00:21:08+02:002023-05-23T01:16:01+02:00[Datacenter in Jutland] Network failover functionality test<p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>00:21</var> CEST</small><br><strong>Resolved</strong> - Our test was successful and the BGP failover functioned perfectly.<br /><br />Datacenter: Skanderborg, Jutland, Denmark<br /><br />Start: 15-08-2021 @ 23:30 CET<br />End: 16-08-2021 @ 00:15 CET<br /><br />Services affected: All services * except * DNS, Office 365 backup, Hosted Exchange og OX AppSuite and mail, which services should not be affected by the test.<br /><br />We apologize for the inconvenience that this test may have caused. However only a few seconds of downtime was noticable, while BPG routed and rerouted during the test.<br /><br />The very best regards from the CloudNordic Helpdesk & Support Team<br /><br />---<br /><br />Vores datacenter failover test af BPG forløb og fungerede godt.<br /><br />Datacenter: Skanderborg, Jylland<br /><br />Start: 15-08-2021 @ 23:30 CET<br />Slut: 16-08-2021 @ 00:15 CET<br /><br />Berørte services: Alle løsninger * dog undtagen* DNS, Office 365 backup, Hosted Exchange og OX AppSuite + mail.<br /><br />Vi beklager samtidig de driftsgener denne test eventuelle måtte have givet. Der var reelt tale om sekunders ping timeout og service lag, imens vores udstyr blev routed or rerouted tilbage, til datacenteret for de berørte services.<br /><br />De bedste hilsner fra CloudNordic Helpdesk & Support Team</p><p><small>Aug <var data-var='date'>15</var>, <var data-var='time'>21:06</var> CEST</small><br><strong>Monitoring</strong> - We once again and hereby announce, that we are testing our datacenter network failover this evening around midnight, which will be tested at our datacenter in Jutland.<br /><br />There will be a partial outage of virtual servers, webhotel, webshop, mail and VPS services while we conduct the test.<br /><br />Datacenter: Skanderborg, Jutland, Denmark<br /><br />Start: 15-08-2021 @ 23:30 CET<br />End: 16-08-2021 @ 00:30 CET (expected)<br /><br />Services affected: All services * except * DNS, Office 365 backup, Hosted Exchange og OX AppSuite and mail, which services should not be affected by the test.<br /><br />We apologize for the inconvenience that this test may cause. <br /><br />The very best regards from the CloudNordic Helpdesk & Support Team<br /><br />---<br /><br />Vi gør igen opmærksom på, at vores datacenter netværk i Jylland vil blive testet for failover funktionalitet, hvilket kan medføre problemer med fremkommelighed på alle virtuelle servere, webshop, webhotel, mail og vPS løsninger omkring midnat i dag i en times tid. <br /><br />Datacenter: Skanderborg, Jylland<br /><br />Start: 15-08-2021 @ 23:30 CET<br />Slut: 16-08-2021 @ 00:30 CET (forventet)<br /><br />Berørte services: Alle løsninger * dog undtagen* DNS, Office 365 backup, Hosted Exchange og OX AppSuite + mail.<br /><br />Vi beklager samtidig de driftsgener denne test eventuelle måtte give.<br /><br />De bedste hilsner fra CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/70819922021-05-25T16:44:14+02:002023-05-23T01:16:01+02:00[Exchange] Timeout error on Hosted Exchange OWA and Outlook client<p><small>May <var data-var='date'>25</var>, <var data-var='time'>16:44</var> CEST</small><br><strong>Resolved</strong> - This afternoon we experienced an outage on Outlook and OWA client mailboxes, which is no longer an issue, as the task has been resolved and all mailboxes are fully functional again.<br /><br />The issue was caused by shutdown of communication between our firewall and OWA servers, which service the Outlook client access, so both types of services ceased to work.<br /><br />The reason for the error was due to malformed http requests sent to our OWA webservers from the Internet, which Outlook clients also communicates through, which was stopped immediately by our antivirus solution.<br /><br />Our antivirus system automatically reopened the access to OWA and thus Outlook clients once the attack ceased.<br /><br />According to our system engineers our POP3/IMAP services were not affected by this timout.<br /><br />Solution: Hosted Exchange OWA and Outlook<br /><br />Start: 25-05-2021 @ 16:01 CET<br />End: 25-05-2021 @ 16:20 CET<br /><br />We apologize for any inconvenience this incident may have caused.<br /><br />Kind regards from the CloudNordic Helpdesk & Support Team</p><p><small>May <var data-var='date'>25</var>, <var data-var='time'>16:13</var> CEST</small><br><strong>Monitoring</strong> - We are currently experiencing a timeout on our Hosted Exchange OWA function, due to a communication error between the firewall service and the OWA servers, which affects login access to OWA and Outlook clients for both Exchange, POP3 and IMAP.<br /><br />We are working hard to resolve the issue and will keep you posted on resolving the matter.<br /><br />Start: 25-05-2021 at 16:01 CET<br /><br />End: 25-05-2021 at 16:30 CET (expected)<br /><br />We apologize for any inconveniences and disruptions this may cause.<br /><br />Kind regards from the CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/67136812021-04-09T15:04:24+02:002023-05-23T01:16:01+02:00[Exchange] Short timeout on exchange.hostedcloud.com<p><small>Apr <var data-var='date'> 9</var>, <var data-var='time'>15:04</var> CEST</small><br><strong>Resolved</strong> - Earlier this afternoon we experienced a short timeout on our Hosted Exchange CAS function, which affected login access to some OWA and Outlook clients for both Exchange, POP3 and IMAP.<br /><br />After identification of the root cause error, we remounted the affected mailbox databases in our CAS array and the system immediately entered operational mode hereafter.<br /><br />The error started 09-04-2021 at 14:39 CET<br /><br />The error ended 09-04-2021 at 14:45 CET<br /><br />We apologize for any inconveniences and disruptions this may have caused in affected OWA or Outlook clients.<br /><br />Kind regards from the CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/66968482021-04-07T18:54:08+02:002023-05-23T01:16:01+02:00[Hosted Exchange] OWA and Outlook client timeout issue<p><small>Apr <var data-var='date'> 7</var>, <var data-var='time'>18:54</var> CEST</small><br><strong>Resolved</strong> - STATUS 07-04-2021 @ 18.45 CET regarding "[Hosted Exchange] OWA and Outlook client timeout issue"<br /><br />Outage on several Outlook, IMAP and OWA client mailboxes databases is no longer an issue, as the task has been resolved and all mailbox databases have been remounted.<br /><br />The task took longer than first anticipated, as we had to make sure that we remounted the correct databases to prevent any dataloss, as databases are spread out over several mailservers in the CAS array.<br /><br />Solution: Hosted Exchange<br /><br />Start: 07-04-2021 @ 17:05 CET<br />End: 07-04-2021 @ 18:35 CET<br /><br />We apologize for any inconvenience this incident may have caused.<br /><br />CloudNordic Helpdesk & Support Team</p><p><small>Apr <var data-var='date'> 7</var>, <var data-var='time'>18:34</var> CEST</small><br><strong>Update</strong> - STATUS 18.30 CET regarding "[Hosted Exchange] OWA and Outlook client timeout issue"<br /><br />Outage on several Outlook, IMAP and OWA client mailboxes are still in effect, as these mailbox databases are having issues connecting.<br /><br />We are currently working on resolving these issues in the Hosted Exchange solution and will resolve the issue should as soon as possible, as we need to disconnect and reconnect each database in the CAS system.<br /><br />The task is taking longer than we first anticipated for which we apologize.<br /><br />Solution: Hosted Exchange<br /><br />Start: 17:05 CET<br />End: Estimated 19:30 CET<br /><br />Futhermore we apologize for any inconvenience this incident may cause as are working very hard to resolve the issue as fast as possible.<br /><br />CloudNordic Helpdesk & Support Team</p><p><small>Apr <var data-var='date'> 7</var>, <var data-var='time'>18:03</var> CEST</small><br><strong>Update</strong> - STATUS 18.00 CET regarding "[Hosted Exchange] OWA and Outlook client timeout issue"<br /><br />Outage on several Outlook, IMAP and OWA client mailboxes are still in effect, as these mailbox databases are having issues connecting.<br /><br />We are currently working on resolving these issues in the Hosted Exchange solution and will resolve the issue should as soon as possible, as we need to disconnect and reconnect each database in the CAS system.<br /><br />Solution: Hosted Exchange<br /><br />Start: 17:05 CET<br />End: Estimated 18:30 CET<br /><br />We apologize for any inconvenience this incident may cause and are working hard to resolve the issue as fast as possible.<br /><br />CloudNordic Helpdesk & Support Team</p><p><small>Apr <var data-var='date'> 7</var>, <var data-var='time'>17:24</var> CEST</small><br><strong>Monitoring</strong> - Outlook, IMAP and OWA clients are having issues connecting and we are currently working on resolving in the Hosted Exchange solution.<br /><br />We have found the root cause that has been causing a few periodic timeouts, which is due to timeout on certain databases.<br /><br />The issue should be resolved within the hour, as we need to disconnect and reconnect the databases.<br /><br />Solution: Hosted Exchange<br /><br />Start: 17:05 CET<br />End: Estimated 18:00 CET<br /><br />We apologize for any inconvenience this incident may have cause and are working hard to resolve the issue as fast as possible.<br /><br />CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/65336282021-04-05T23:30:10+02:002023-05-23T01:16:01+02:00[Planned Service Window] Datacenter failover test for Hosted Exchange CAS solution<p><small>Apr <var data-var='date'> 5</var>, <var data-var='time'>23:30</var> CEST</small><br><strong>Resolved</strong> - The failover test this evening went well and was completed without any downtime.<br /><br />Datacenter: Copenhagen, Denmark<br /><br />Start: April 5th, 2021 at 21.00 CET<br /><br />End: April 5th, 2021 at 23:00 CET</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>23:14</var> CEST</small><br><strong>Update</strong> - The failover test this evening was completed without any downtime.<br /><br />However, we wish to repeat the failover test once again on Monday, April 5th, due to further analysis of the BGP redundancy updates we have implemented in our network nodes.<br /><br />So far we have not observed any problems, but we wish to double check functionality.<br /><br />Datacenter: Copenhagen, Denmark<br /><br />Start: April 5th, 2021 at 21.00 CET<br /><br />End: April 5th, 2021 at 23:00 CET<br /><br />Effected systems: Hosted Exchange (informational only*)<br /><br />* As we do not expect any effect to operational status of any kind, this correspondence is primarily informational.<br /><br /><br />Please do not hesitate us, should you have any questions thus regarding.<br /><br />Best regards from CloudNordic Helpdesk & Support</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>22:17</var> CET</small><br><strong>Update</strong> - The failover test this evening was completed without much noticeable downtime.<br /><br />There may have been a slight disruptance at 21.40 and 21:50 when the failover was tested for full functionality.<br /><br />For the sake of good order we do wish to repeat the failover test again on Monday, March 29th, as we found a possible issue in the failover function of the network setup, which we must pursue for further analysis.<br /><br />The network functionality ensures that the functionality of the Exchange CAS system is fully operational, which we wish to ensure that all failover mailbox servers are able to carry the load of the entire CAS array data.<br /><br />So far we have not observed major problems, but wish to double check functionality, as we wish it to be 100% flawless and fully redundant.<br /><br />Datacenter: Copenhagen, Denmark<br /><br />Start: March 29th, 2021 at 20.00 CET<br /><br />End: March 29th, 2021 at 23:00 CET<br /><br />Effected systems: Hosted Exchange (informational only*)<br /><br />* As we do not expect any effect to operational status of any kind, this correspondence is primarily informational.<br /><br /><br />Please do not hesitate us, should you have any questions thus regarding.<br /><br />Best regards from CloudNordic Helpdesk & Support</p><p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>23:25</var> CET</small><br><strong>Update</strong> - The failover test this evening was completed without any downtime.<br /><br />However, we wish to repeat the failover test again on Monday, March 22nd, due to further analysis of the functionality of the CAS system, which we wish to ensure that all failover mailbox servers are able to carry the load of the entire CAS array data.<br /><br />So far we have not observed problems, but wish to double check functionality.<br /><br />Datacenter: Copenhagen, Denmark<br /><br />Start: March 22nd, 2021 at 21.00 CET<br /><br />End: March 22nd, 2021 at 23:00 CET<br /><br />Effected systems: Hosted Exchange (informational only*)<br /><br />* As we do not expect any effect to operational status of any kind, this correspondence is primarily informational.<br /><br /><br />Please do not hesitate us, should you have any questions thus regarding.<br /><br />Best regards from CloudNordic Helpdesk & Support</p><p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>20:00</var> CET</small><br><strong>Monitoring</strong> - We hereby announce and inform you that we will once again test our datacenter failover setup for the Hosted Exchange CAS system, which should not affect operations significantly more than a few seconds, while the failover takes place.<br /><br />It is our intention to conduct this in order to ensure that the CAS function will automatically fail over to our separate datacenter location without any or very limited disturbance, where to we will test fallback to the primary datacenter afterwards, due to that we have recently implemented extra mailbox failover servers.<br /><br />Once the failover has been completed, we will run operations from the secondary datacenter to test performance, where after we will switch back to the primary datacenter.<br /><br /><br />Datacenter: Copenhagen, Denmark<br /><br />Start: March 19th, 2021 at 20.00 CET<br /><br />End: March 19th, 2021 at 00:01 CET<br /><br />Effected systems: Hosted Exchange (informational only*)<br /><br />* As we do not expect any effect to operational status of any kind, this correspondence is primarily informational.<br /><br /><br />Please do not hesitate us, should you have any questions thus regarding.<br /><br />Best regards from CloudNordic Helpdesk & Support</p>tag:hostedcloud.statuspage.io,2005:Incident/64530942021-03-09T22:08:31+01:002023-05-23T01:16:01+02:00[Planned] Emergency Microsoft Exchange patch vs. HAFNIUM zero day threat<p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>22:08</var> CET</small><br><strong>Resolved</strong> - Patching completed between 21.00 and 22.00 hours CET for both days mentioned without downtime, due to CAS array redundancy.<br /><br /><br />Please do not hesitate us, should you have any questions thus regarding. <br /><br />Best regards from CloudNordic Helpdesk & Support</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>20:00</var> CET</small><br><strong>Identified</strong> - We have received notice from Microsoft about a possible zero day threat to their Exchange Server platform, which we have investigated and therefore will apply to our Hosted Exchange solutions.<br /><br />https://www.microsoft.com/security/blog/2021/03/02/hafnium-targeting-exchange-servers/<br /><br />As the systems are redundant, we expect to patch without any downtime on client side, whereto some Outlook clients needs to renegotiate connection, should they be connect to the CAS array being patched, during the patch window.<br /><br />Outlook clients should automatically reconnect upon connection error and be sent to the secondary CAS array during the emergency patch window being performed.<br /><br />We will immediately restore the patched servers, should they leave the Exchange solution become unresponsive upon being patched.<br /><br /><br />Datacenter: Copenhagen 1, Denmark <br /><br />1st patch window<br />-------------------<br /><br />Start: Monday, March 8th, 2021 at 21.00 CET <br /><br />End: Monday, March 8th, 2021 at 22.00 CET <br /><br /><br />Datacenter: Copenhagen 2, Denmark <br /><br />2nd patch window<br />-------------------<br /><br />Start: Tuesday, March 9th, 2021 at 21.00 CET <br /><br />End: Tuesday, March 9th, 2021 at 22.00 CET <br /><br /><br />Related services: Hosted Exchange, Outlook client and OWA webmail<br /><br />We apologize on beforehand for any downtime or disturbance, should this emergency Microsoft patch window cause or inflict such a situation, during the zero day security issue patching.<br /><br />Please do not hesitate us, should you have any questions thus regarding. <br /><br />Best regards from CloudNordic Helpdesk & Support</p>tag:hostedcloud.statuspage.io,2005:Incident/64284622021-03-05T22:02:13+01:002023-05-23T01:16:01+02:00[Planned Service Window] Datacenter failover test for Hosted Exchange CAS solution<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>22:02</var> CET</small><br><strong>Resolved</strong> - The planned technical service window has now been completed.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>18:10</var> CET</small><br><strong>Monitoring</strong> - We hereby announce and inform you that we will test our datacenter failover setup for the Hosted Exchange CAS system, which should not affect operations significantly more than a few seconds, while the failover takes place.<br /><br />It is our intention to conduct this in order to ensure that the CAS function will automatically fail over to our separate datacenter location without any or very limited disturbance, where to we will test fallback to the primary datacenter afterwards.<br /><br />Once the failover has been completed, we will run operations from the secondary datacenter to test performance, where after we will switch back to the primary datacenter.<br /><br /><br />Datacenter: Copenhagen, Denmark<br /><br />Start: March 5th, 2021 at 20.00 CET<br /><br />End: March 6th, 2021 at 00:01 CET<br /><br />Effected systems: Hosted Exchange (informational only*)<br /><br />* As we do not expect any effect to operational status of any kind, this correspondence is primarily informational.<br /><br /><br />Please do not hesitate us, should you have any questions thus regarding.<br /><br />Best regards from CloudNordic Helpdesk & Support</p>tag:hostedcloud.statuspage.io,2005:Incident/55962942020-11-24T23:19:49+01:002023-05-23T01:16:01+02:00[Planned service 24-11-2020] Additional update of ISP core network<p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>23:19</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>19:46</var> CET</small><br><strong>Monitoring</strong> - Vores tekniske support vil igen sent tirsdag aften gennemføre visse ekstra opdateringer og ændringer i vores ISP core netværk for vores Hosted Exchange løsninger, der desværre kan betyde kortvarige udfald på vores netværk, hvilket kan forstyrre opdateringer af mail og webmail i op til 1-3 minutter for hver opdatering.<br /><br />Outlook klienten vil automatisk genoptage funktionalitet efter genstarten, imens man lige selv skal genstarte sin Internet browser for at få OWA webmail til at virke igen.<br /><br />Tidsrummet enkelte kortvarige afbrydelsen kan ske i er;<br /><br />Start 24-11-2020 @ 21:00 CET<br />Slut 24-11-2020 @ 23:00 CET (Planned)<br /><br />Påvirkede løsninger: Hosted Exchange Outlook og OWA<br /><br />Vi beklager eventuelle gener denne korte afbrydelse må betyde for jer.<br /><br />CloudNordic Helpdesk & Support Team<br /><br />---<br /><br />Tuesday evening our system engineers will once again add additional updates and changes to our ISP core network, where you unfotunately may experience short timeouts of 1-3 minutes on OWA and Outlook clients for both Exchange, POP3 and IMAP, as the updates are implemented.<br /><br />Outlook clients will reconnect automatically after a disconnect, which should happen within a minute or two per client upon our network changes.<br /><br />Start 24-11-2020 @ 21:00 CET<br />End 24-11-2020 @ 23:00 CET (Planned)<br /><br />Solutions influenced: Hosted Exchange Outlook og OWA<br /><br />We apologize for any inconveniences and disruptions this may cause.<br /><br />CloudNordic Helpdesk & Support Team</p>tag:hostedcloud.statuspage.io,2005:Incident/56004642020-11-19T09:12:00+01:002023-05-23T01:16:01+02:00Power failure in Glostrup datacenter<p><small>Nov <var data-var='date'>19</var>, <var data-var='time'>09:12</var> CET</small><br><strong>Resolved</strong> - One of the redundant power feeds in Glostrup datacenter have an unexpected failure, all services running on redundant power</p>