UCloud Status

Ongoing

Issues with UCloud resource system
We are experiencing intermittent issues with the resource system in UCloud. This results in resources (jobs, files, etc) being unavailable. We are investigating the issue. Oct 3, 19:14 - now

Updates
Various mitigations have been put in place to drastically minimise the impact of this issue. We are still investigating the root cause. Oct 28, 11:01

Upcoming

Maintenance in the UCloud data center
In the morning on 9 Dec 2024 we have to perform maintenance in the UCloud data center. During the maintenance operation we will most likely have to shut down the u1-madlab, u2-madlab and u2-gpu machines for a couple of hours. Running jobs will be terminated. Dec 9, 08:00

Updates

December, 2024

Maintenance at AAU providers
Scheduled maintenance at AAU, which will affect both the OpenStack and Kubernetes providers. Running jobs will be terminated during the maintenance window. Dec 3, 07:00 - Dec 3, 16:02

Updates
The upgrade of the Kubernetes cluster has been completed. Dec 3, 10:43

November, 2024

Reduced availability on UCloud platform
UCloud was partially unavailable for around 30 minutes due to an internal database that stopped responding. The problem has been solved and the system should be back to normal. Nov 21, 12:36 - Nov 21, 13:10

Updates

October, 2024

Bug-fix for minor UI bugs
We have pushed an update to the UCloud user-interface which fixes a number of small UI bugs. Including a bug which caused the interface to incorrectly display a message stating that some systems had degraded performance. Oct 21, 08:09 - Oct 21, 08:09

Updates
Bug-fix for some applications returning
A bug has been fixed which caused applications without a default flavor to return "Not found". In particular, this bug caused issues with the following applications: nf-core, SAMtools and Kallisto. Oct 18, 10:46 - Oct 18, 10:46

Updates
Bug-fix for folder uploads
An update has been deployed to fix a newly introduced bug in folder uploads. Folder uploads are now expected to work as normal again. The bug was introduced in an update around 9:50 this morning. Oct 17, 15:25 - Oct 17, 15:25

Updates
Minor UCloud outage this morning
Due to a maintenance operation UCloud was partially unavailable this morning, but things are back to normal. Oct 17, 07:45 - Oct 17, 08:33

Updates
Technical issues with virtual machines
Due to technical difficulties, users may currently experience periodic issues when attempting to start or stop virtual machines on the UCloud platform. We are investigating the issues and will update the status as soon as possible. If a server start-up period takes more than 5 minutes, we request users to cancel the job. Oct 14, 08:02 - Oct 16, 14:53

Updates
The maintenance has complete and the system should be fully operational again. Oct 16, 14:53 In order to mitigate the issue we have decided on having an extraordinary service window, starting from 2024-10-16 08:00 until 2024-10-17 16:00. In this period, we will be making repairs on the platform, and we kindly ask our users to refrain from starting and stopping VMs during this time. The repairs are not expected to have any impact on already running instances, but in case we need to reboot the servers and any running processes on the instances will be stopped during the reboot. If you have unsaved work on the instance, please save this before tomorrow morning. Oct 15, 13:56

September, 2024

Hardware issues with u2-gpu machines
UCloud is experiencing hardware issues with the u2-gpu machines, resulting is reduced availability. Sep 23, 10:39 - Nov 19, 10:38

Updates
The failed GPU has finally been replaced and full availability has been restored. Currently running jobs had to be terminated this morning to perform the hardware replacement. Nov 19, 10:38 The u2-gpu machines are again unavailable. We are still waiting for hardware repairs. Oct 8, 14:42 The u2-gpu machines are now available on UCloud again. However, jobs running on the machine will be killed when we need to do work on the machine to fix the hardware problem. Sep 24, 15:50 We have performed maintenance for the u2-gpu machine, but unfortunately hardware replacements are needed. Sep 24, 14:18 The u2-gpu machines have been flagged for maintenance. It will not be possible to start new jobs until the maintenance has completed. Sep 23, 16:47 The u2-gpu machines are available again, but one of the cards are not working, which means that u2-gpu-8 machine cannot be used. Sep 23, 10:39

Issues with UCloud resource system

Updates

Maintenance in the UCloud data center

Updates

Maintenance at AAU providers

Updates

Reduced availability on UCloud platform

Updates

Bug-fix for minor UI bugs

Updates

Bug-fix for some applications returning

Updates

Bug-fix for folder uploads

Updates

Minor UCloud outage this morning

Updates

Technical issues with virtual machines

Updates

Hardware issues with u2-gpu machines

Updates