This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
en:novinky:start [10.04.2019 15:11] xantos@cesnet.cz [Jihlava storage facility unexpected outage - 10. 4. 2019] |
en:novinky:start [04.07.2025 13:54] (current) RNDr. David Antos Ph.D. [CL4 Object Storage Outage - 15. 8. 2025] |
||
---|---|---|---|
Line 3: | Line 3: | ||
src="https://du.cesnet.cz/lib/images/rss.png" alt="News RSS feed" width="25" height="25"></a></html> | src="https://du.cesnet.cz/lib/images/rss.png" alt="News RSS feed" width="25" height="25"></a></html> | ||
- | ===== Jihlava storage facility unexpected outage - 10. 4. 2019 ===== | ||
- | **Update 2:30pm**: Jihlava storage facility (du2.cesnet.cz, jihlava2-archive in MetaCentrum) is back in operation. | ||
- | Due to power generator failure in Jihlava, Jihlava storage facility (du2.cesnet.cz, jihlava2-archive in MetaCentrum) had to be shut down. Currently, we have no detailed information on recovery time estimates. We'll keep you informed. | + | ===== New Terms and Conditions - 4. 7. 2025 ===== |
+ | |||
+ | Updated [[en:provozni_pravidla:start|Terms and Conditions of CESNET's Data Storage Services]] have been published. | ||
+ | |||
+ | |||
+ | ===== CL4 Object Storage Outage - 15. 8. 2025 ===== | ||
+ | |||
+ | Due to maintenance of power supply equipment, object storage facility CL4 will be out of order on Friday 15 August 2025. More detailed information will follow. | ||
+ | |||
+ | =====ownCloud outage - 31. 5. 2025===== | ||
+ | |||
+ | ownCloud and Filesender services are temporarily unavailable due to unexpected power loss in the server room. The repairs are in progress. We apologise for the inconvenience. | ||
+ | |||
+ | **Update 31.5.:** both systems are fully operational again. | ||
+ | |||
+ | ===== CL1 planned outage 1. 4. 2025===== | ||
+ | |||
+ | |||
+ | Storage facility CL1 will be out of order starting in the morning of April 15 till the afternoon of April 17. Necessary electric supply maintenance will be performed in the server room during this period. We apologise for the inconvenience, this kind of maintenance is not possible to be safely done during operation of the system. | ||
+ | |||
+ | Further plans for CL1 include full modernisation of the hardware and increasing its capacity. This will be performed in two phases when new hardware will be connected to the cluster, data rebalanced, and old hardware will be removed. The operation will be done in operation, slight decrease of overall performance should be the only effect observed by the users. | ||
+ | |||
+ | **Edit 17.4.:** CL1 is fully operational again. | ||
+ | |||
+ | =====ownCloud outage - 4. 3. 2025===== | ||
+ | |||
+ | ownCloud and Filesender services are temporarily unavailable due to unexpected power loss in the server room. The repairs are in progress. We apologise for the inconvenience. | ||
+ | |||
+ | EDIT: both services are operational again. | ||
+ | |||
+ | =====Jihlava node outage, CL1 inaccessible - 4. 2. 2025===== | ||
+ | |||
+ | EDIT: Both network paths of our suppliers to Jihlava node have been interrupted. Storage facilitie CL1 is therefore not accessible. Repairs should be performed this afternoon. We will post further news. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | UPDATE 11:00: storage facility is accessible again. | ||
+ | |||
+ | =====Jihlava node outage, DU5 and CL1 inaccessible - 17. 9. 2024===== | ||
+ | |||
+ | EDIT: Both network paths of our suppliers to Jihlava node have been interrupted. Storage facilities DU5 and CL1 are therefore not accessible. Repairs should be performed this afternoon. We will post further news. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | UPDATE 18:25: storage facilities are accessible again (with one of the connections). | ||
+ | |||
+ | UPDATE 18.9. morning: both network connections are in full operation. | ||
+ | =====Termination of access to the DU4 repository in Ostrava - 23.5.2024===== | ||
+ | |||
+ | In view of persistent problems with the mechanical components of the tape library on the hierarchical storage in Ostrava (du4.cesnet.cz, connected in MetaCentre as /storage/ostrava2-archive or /storage/cesnet-du), we were forced to limit user access to this system. This will allow us to extract user data from the tape library that still needs to be moved to newer devices. | ||
+ | |||
+ | From May 23, 2024, the storage will not be available to users using standard user protocols (NFSv4, rsync, scp, ...). | ||
+ | |||
+ | If you need to work with the data from this storage, please contact the data storage user support, we will transfer the data to another suitable storage as agreed. Similarly, if you especially need space for new data, contact us and we will prepare object storage. | ||
+ | |||
+ | If you are not actively working with the data, please wait for further instructions regarding its migration. | ||
+ | |||
+ | We are sorry for problems. | ||
+ | Send feedback | ||
+ | Translation results available | ||
+ | |||
+ | |||
+ | =====Limited operation of DU4 in Ostrava - 27. 3. 2024===== | ||
+ | |||
+ | Storage facility du4.cesnet.cz in Ostrava is currently undergoing a mechanical outage of tape robot system. Access to data stored on tapes is temporarily limited. It affects VO Storage services and virtual organisations with data kept at the facility. We will inform about the progress, now we waiting for specialised replacement component delivery is needed. This may take several days to solve. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | =====Limited operation of DU4 in Ostrava - 2. 1. 2024===== | ||
+ | |||
+ | Storage facility du4.cesnet.cz in Ostrava is currently undergoing a mechanical outage of tape robot system. Access to data stored on tapes is temporarily limited. It affects VO Storage services and virtual organisations with data kept at the facility. We will inform about the progress, it can be nevertheless expected that specialised replacement component delivery is needed. This may take several days to solve. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | **Update:** data on tapes is fully accessible again. | ||
+ | =====Limited operation in Datacentrum Ostrava - 10 December 2023===== | ||
+ | |||
+ | **Update, Monday, December 11, 3 PM**: Ostrava data storage is back in operation. | ||
+ | |||
+ | The Ostrava data storage du4.cesnet.cz is currently struggling with an unplanned outage of the tape drive. An outage may cause limited access to data for VO Storage services and Custom Virtual Organizations having data there. We are working hard to fix the bug. | ||
+ | |||
+ | We are sorry for problems. | ||
+ | |||
+ | |||
+ | ===== Decommissioning the Globus service - 19 July 2023 ===== | ||
+ | |||
+ | As the Globus service for data transfers has not been used by the community for quite a long time, it will be decommissioned in September 2023. Should it cause any inconvenience for the users, kindly contact our user support. | ||
+ | |||
+ | ===== New object storage in Brno - 9 June 2023 ===== | ||
+ | |||
+ | In Brno we put into operation one new data storage with a gross capacity of 26 PB. The new object data storage denoted as CL4 was built and installed on the premises of Mendel University in Brno. | ||
+ | |||
+ | ===== Change in SSH access - du4 and du5 - 14. 4. 2023 ===== | ||
+ | |||
+ | With regards to the increasing amount of complex security attacks, we were obliged to perform two major changes in access to the data storages du4 and du5. The changes are related to SSH access (i.e. SCP and rsync). In case you do not use any of the protocols mentioned above you can finish reading here :-). | ||
+ | |||
+ | What are the changes: | ||
+ | |||
+ | **1. Login over SSH protocol** | ||
+ | |||
+ | Login over SSH using username and password will be disabled. Login via SSH will be further allowed only via SSH key or Kerberos ticket. | ||
+ | |||
+ | **2. Restricting network connections from CESNET Data Storage to Internet** | ||
+ | |||
+ | The second change is the prohibition of network connection from our data storage in the outward direction (Internet). This change is related to the protection of the internal network of our data storage. It will be impossible to use scp or rsync (running on the data storage) in the outward direction to copy your data. You will need to run the tools from the client side if you wish to download your data. | ||
+ | |||
+ | In case you were using for logging in username and password (in clients like Filezilla or WinSCP) it will be necessary to setup usage of SSH key pair (see the guides below), you can continue with the following steps: | ||
+ | * please check the way of authentication you use and perform the necessary changes in authentication for SSH key (or Kerberos ticket), **FTP and samba protocols are not constrained with the changes** - no action is required | ||
+ | * SSH keys should be added to the data storage exclusively via Perun system, see [[:en:navody:perun:pridani_ssh_klice:start|the guide]] | ||
+ | * detail documentation for SSH connection and Kerberos can be found [[:en:navody:sshauth:start| here]] | ||
+ | * to setup **SCP in Windows** including SSH key you can visit [[https://du.cesnet.cz/en/navody/winscp/start#winscp_scp_using_ssh_key_pair|this guide]] | ||
+ | |||
+ | Restriction related to the network connection in the outward direction affects only users, which used the commands on the frontend servers. | ||
+ | |||
+ | Above mentioned changes will come into effect on 19th April 2023. | ||
+ | |||
+ | |||
+ | =====Short ownCloud and Filesender maintenance - 7. 9. 2022 ===== | ||
+ | |||
+ | **Update 13:30 PM**: ownCloud and Filesender are back in operation. | ||
+ | |||
+ | Maintenance will be performed on the ownCloud and Filesender service in the morning of 7 September 2022. The service is expected to be unavailable for several hours due to security update - assumption 9am - 1pm . We apologise for the inconvenience. | ||
+ | |||
+ | |||
+ | |||
+ | =====New Object Storage in Ostrava - 30. 6. 2022===== | ||
+ | We've deployed one of the biggest Data Storage within Czech Republic. The total capacity of the new Data Storage is 33 PB. The new Data Storage designated as CL3 is located in the IT4INNOVATIONS supercomputing center in Ostrava. IT4INNOVATIONS is also the partner of CESNET under e-INFRA CZ umbrella. Further information can be found in the official [[https://www.cesnet.cz/sdruzeni/zpravy/tiskove-zpravy/cesnet-vyznamne-rozsiril-kapacity-svych-datovych-ulozist/|press release]]. | ||
+ | |||
+ | =====Short ownCloud maintenance - 9. 9. 2021 ===== | ||
+ | |||
+ | Maintenance will be performed on the ownCloud service in the evening of 9 September 2021. The service is expected to be unavailable for several minutes due to database upgrade. We apologise for the inconvenience. | ||
+ | |||
+ | |||
+ | ===== Ostrava storage facility, unexpected outage of the Data Center - 22. 6. 2021 ===== | ||
+ | |||
+ | **Update 11:25 AM**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | The Ostrava data storage facility du4.cesnet.cz is currently facing an unplanned outage. Services of the facility including ownCloud and FileSender are out of order. | ||
+ | |||
+ | We apologize for the inconvenience. | ||
+ | |||
+ | |||
+ | ===== Scheduled downtime for ownCloud and Filesender - June 10 - June 11, 2021 ===== | ||
+ | |||
+ | **Update, Friday, June 11, 3 PM**: ownCloud and Filesender services are back in operation. | ||
+ | |||
+ | From June 10, 5 PM until June 11 afternoon will occur scheduled downtime of the ownCloud and Filesender service. The purpose of scheduled downtime is a large upgrade of both services. We advise you to synchronize necessary files to your computers in advance. Neither the web interface <nowiki>https://owncloud.cesnet.cz</nowiki> nor client synchronization will be accessible in this period. | ||
+ | |||
+ | What to expect: | ||
+ | |||
+ | * enhanced file sharing and user group management | ||
+ | * improved web interface | ||
+ | * many important bug fixes from previous versions | ||
+ | |||
+ | We are sorry for the inconvenience. Thank you for understanding. | ||
+ | |||
+ | |||
+ | |||
+ | /* | ||
+ | ===== Ostrava tape library outage - 19. 9. 2019 ===== | ||
+ | |||
+ | **Update 3:05pm**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | Tape library of the Ostrava storage facility (du4.cesnet.cz, ostrava2-archive, /storage/du-cesnet in MetaCentrum) is out of order on 19 September 2019 between 9AM and about 3PM. Data stored only on tapes are not accessible and forced migration to tapes is not possible as well. Files stored on disk arrays are normally available. Data can be uploaded to the facility normally as well. FileSender and ownCloud services are not impacted by the outage. System supplier is performing necessary repair and maintenance work. We apologise for the inconvenience. | ||
+ | */ | ||
+ | |||
+ | ===== Ostrava storage facility, unexpected outage of the Data Center - 9. 4. 2021 ===== | ||
+ | |||
+ | **Update 02:30am**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | The Ostrava data storage facility du4.cesnet.cz is currently facing a power failure. Services of the facility including ownCloud and FileSender are out of order. | ||
+ | |||
+ | We apologise for inconvenience. | ||
+ | |||
+ | |||
+ | |||
+ | ===== Unexpected outage of the Data Centers - 26. 1. 2021 ===== | ||
+ | |||
+ | **Update 8:00pm**: DU5, CL1 and CL2 facilities are back in operation. | ||
+ | |||
+ | Due to unexpected system failure are object data centers CL1 and CL2 unaccessbile. Data Center DU5 is unaccessible as well. We will keep you informed about current state. | ||
+ | |||
+ | We apologise for inconvinience. | ||
+ | |||
+ | ===== Info - DU4 vs. files * .restored - 13 January 2021 ===== | ||
+ | Due to an error of a tape drive in hierarchical storage facility DU4 in Ostrava, one of data replicas on two tape cartridges was damaged. The data is being restored from backups on other tapes. Restored data is returned into original locations, we add .restored extension to the files. Users can rename restored files to their original names and/or delete them in cases where original files have been overwritten with a new content and is readable (the users are advised to check readability of the files beforehand). Should you have any questions, kindly contact user support at support@cesnet.cz. | ||
+ | |||
+ | |||
+ | ===== Ostrava storage facility, unexpected outage of the Data Center - 7. 12. 2020 ===== | ||
+ | |||
+ | **Update 10:30am**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | Due to unexpected system failure had to be Ostrava storage facility (du4.cesnet.cz, ostrava2-archive in MetaCentrum) shut down. We will keep you informed about current state. | ||
+ | |||
+ | |||
+ | ===== Planned outage of tape library in Ostrava (du4) - 25. 10. 2020 ===== | ||
+ | |||
+ | **Update 9:00pm**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | Outage of tape library in Ostrava (du4, also known as ostrava2-archive in MetaCentrum) is planned on 25 October 2020 from 9AM to approximately 5PM. Necessary update and hardware maintenance will be performed. The storage facility will be available, just the data migrated on to tapes will not recall during the outage. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | ===== Planned outage of tape library in Ostrava (du4) - 31. 8. 2020 ===== | ||
+ | |||
+ | **Update 1:00pm**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | Outage of tape library in Ostrava (du4, also known as ostrava2-archive in MetaCentrum) is planned on 31 August 2020 from 8AM to approximately 1PM. Necessary update and hardware maintenance will be performed. The storage facility will be available, just the data migrated on to tapes will not recall during the outage. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | ===== Planned outage of tape library in Ostrava (du4) - 6. 4. 2020 ===== | ||
+ | |||
+ | **Update 4:00pm**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | Outage of tape library in Ostrava (du4, also known as ostrava2-archive in MetaCentrum) is planned on 6 April 2020 from 7AM to approximately 5PM. Necessary update and hardware maintenance will be performed. The storage facility will be available, just the data migrated on to tapes will not recall during the outage. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | ===== Final data migration of Metacentrum users from the Brno Data Storage to Ostrava Data Storage - 1. 1. 2020 ===== | ||
+ | /* | ||
+ | **Update 17:00**: data migration was finished | ||
+ | */ | ||
+ | |||
+ | We've started on 1.1.2020 final data migration of Metacentrum users from Brno data storage (du3) to the Ostrava data storage (du4). In this moment there is no need of user action. Complete data migration will be done by administrators. In case you will find out your data inaccessible in Brno Data Storage, then the migration is done. Your files from Brno Data Storage could be then found on the Ostrava Data Storage in your home directory in the folder named "migrated_du3". | ||
+ | |||
+ | Thank you for cooperation. | ||
+ | |||
+ | ===== Planned outage of tape library in Ostravě (du4) - 18. 12. 2019 ===== | ||
+ | |||
+ | **Update 5:00pm**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | Outage of tape library in Ostrava (du4, also known as ostrava2-archive in MetaCentrum) is planned on 18 December 2019 from 9AM to approximately 5PM. Necessary update and hardware maintenance will be performed. The storage facility will be available, just the data migrated on to tapes will not recall during the outage. | ||
+ | |||
+ | We apologise for the inconvenience. | ||
+ | |||
+ | |||
+ | ===== Ostrava storage facility, unexpected outage of the Data Center - 10. 12. 2019 ===== | ||
+ | |||
+ | **Update 5:00pm**: Ostrava storage facility is back in operation. | ||
+ | |||
+ | Due to unexpected system failure had to be Ostrava storage facility (du4.cesnet.cz, ostrava2-archive in MetaCentrum) shut down. We will keep you informed about current state. | ||
+ | |||
+ | ===== Scheduled outage of the Data Center CL1 and du5 in Jihlava - 3. 12. 2019 ===== | ||
+ | |||
+ | **Update 2:00pm**: Jihlava storage facility is back in operation. | ||
+ | |||
+ | There is scheduled outage ofthe Data Center CL1 and du5 in Jihlava. The suplier is extending UPS system in the server room. Expected finalization is until 6 PM. | ||
We apologise of the inconvenience. | We apologise of the inconvenience. | ||
+ | |||
+ | |||
+ | |||
+ | ===== Ostrava storage facility, unexpected outage of the Data Center - 21. 6. 2019 ===== | ||
+ | |||
+ | **Update 3:55pm**: Ostrava storage facility (incl. FileSender and ownCloud) is back in operation. | ||
+ | |||
+ | Due to operational reasons had to be Ostrava storage facility (du4.cesnet.cz, ostrava2-archive in MetaCentrum) shut down. The outage include ownCloud and FileSender services as well. We will keep you informed about current state. | ||
+ | |||
+ | |||
+ | ===== Ostrava storage facility, unexpected outage of the tape library - 20. 6. 2019 ===== | ||
+ | |||
+ | **Update 5:00pm**: Ostrava storage facility (du4.cesnet.cz, ostrava2-archive in MetaCentrum) is back in operation. | ||
+ | |||
+ | |||
+ | Due to tape library failure in Ostrava storage facility (du4.cesnet.cz, ostrava2-archive in MetaCentrum) had the tape library to be shut down. The data center is still accessible. However in case that your data are migrated to the tape library, there won't occure migration back to the disk tier. That can cause I/O errors. | ||
+ | |||
+ | We apologise of the inconvenience. | ||
+ | |||
===== ownCloud & FileSender services are back in operation - 1. 4. 2019 ===== | ===== ownCloud & FileSender services are back in operation - 1. 4. 2019 ===== |