- rocky-mirror-announce

July Tier 0 Infrastructure Update
by Taylor Goodwill 25 Jul '22

25 Jul '22

Hi All, First and foremost, we would like to thank everyone so much for your patience during our recent release. Our new compose process exhibited a couple bugs which led to the hardlinking process not working as efficiently as it could, ultimately increasing the amount of data required to transfer for all mirrors. (Fixed) After preemptively growing our rsync pool and the addition of a second PoP in the EU, we underestimated the load that would be placed on the tier 0 mirror services during this release and did not give enough time for the sync process to begin before announcement. This issue was further exacerbated by the above hardlinking issue and the inclusion of two more architectures worth of artifacts with ppc64le & s390x. Additionally, it appears some file permissions may have prevented mirrors from syncing when the artifacts were moved to our production share due to an error in our script. (Fixed) That being said, the release went really well overall! All artifacts are served by our global CDN via Fastly, and while not ideal, these services were entirely available throughout release. This has been our stance, since the CDN is served directly from Tier 0. In the near term, we will be looking to implement an improved tiering schema for mirrors, ensuring we're able to work with Tier 1 mirrors distributed around the globe to pre-propagate our content before the bit-flip operation which occurs on release. If you are interested in helping, please reach out! Additionally, we will be making the following changes coinciding with a new mirroring policy (in progress): * implement access changes on the Tier 0 rsync endpoint to allow only Tier 1 mirrors by IP address. Tier 2+ mirror operators will want to choose another mirror site to pull from. We believe this will ultimately lead to a better experience for all of our mirror operators, as they will be able to choose a mirror to pull from which is likely geographically closer to them--with less latency and higher throughput. * launch additional rsync pops in the coming months which will coincide with other significant changes to our mirroring architecture. We truly appreciate all the support and assistance we've received from so many people throughout this process. Your suggestions and advice on best practices have been tremendously helpful, be it privately via email or on IRC/etc. We look forward to making these infrastructure improvements in the coming months to prepare for a successful release of Rocky Linux 8.7 and 9.1 in ~Q4. Best Regards, Rocky Infrastructure Team

1 0

Rocky Linux 9.0 Syncing to Tier 0 Mirrors
by Neil Hanlon 13 Jul '22

13 Jul '22

Hi everyone, We are syncing the 9.0 GA content to the production mirrors at this time and it should be available to synchronize shortly. There will be a small update for a few packages coming shortly, but we wanted to get the content available immediately. Looking at logs and metrics from the 8.6 release propagation, our tier 0 mirrors didn't seem to encounter any issues serving content as they did in prior releases, and I did not hear from anyone about synchronization troubles. If you did and/or do have any issues, please reach out. As a reminder, we have a European mirror located at fra.msync.rockylinux.org and I'll be adding a couple of nodes in other areas shortly after the release of 9.0. Like prior releases, the 9.0 GA directory will have its permissions set so that mirrors can sync the content, but not expose it to end users over HTTP or Rsync. Please ensure the permissions are set correctly on your content and services so the bitflip can occur as planned. We will release the 9.0 GA content at 14:00 UTC on Wednesday, July 14th 2022. Thank you very much for your continued support of Rocky Linux. We couldn't do this without your help! Best, Neil

1 0

[Rocky Linux] MirrorManager Maintenance over the next few days
by Neil Hanlon 13 Jul '22

13 Jul '22

Hi all, I'll be performing some maintenance on the MirrorManager servers over the next few days to prepare for the release of 9.0. Changes which are made in the UI may be rolled back due to some point restores that necessarily have to be done to integrate some of the changes for 9. I will do my best to keep them to a minimum, but please send me a message if you encounter anything extremely out of the ordinary (503 errors, etc). Best, Neil Hanlon

1 0

Rocky Linux 8.6 Available to Sync
by Neil Hanlon 16 May '22

16 May '22

Hello folks, The Rocky Linux 8.6 sources have been staged in production and are available for synchronization at this time. The final hardlink of the repositories should be finishing up here very shortly. We will perform a bitflip later on today to make everything available to the public. Thank you for your continued support of Rocky Linux! As a reminder we have a secondary synchronization point in Europe at fra.msync.rockylinux.org which can be used to pull from if it's more convenient. In combination with the release of 9 (expected next week), the infra team will also be finally getting around to deploying some much needed mirrors in different parts of the world. Lastly, I am working on some policies around mirroring that we're going to be looking to implement to ensure great user experience for people using Rocky. I am personally hoping to have these policies drafted and starting to be implemented in mid June, but we'll see what the future holds. Best, -- Neil Hanlon, Infrastructure Team Lead The Rocky Enterprise Software Foundation

1 0

Public Mirror missing from list
by VelociHOST Support 04 May '22

04 May '22

Hello, Why isn't our active RockyLinux mirror on the Public active mirrors list? Is there anything missing from our end? https://mirror.mia.velocihost.net/rockylinux/ Please advise. Thank you, Support Team English | Español [Go to VelociHOST Website]<https://www.velocihost.net/?utm_source=email_signature&utm_medium=logo-image> ________ Enterprise Cloud Hosting Solutions Miami Data Centers Phone: (833) 835-6244 Email: support(a)velocihost.net<mailto:support@velocihost.net> | Web: www.velocihost.net<https://www.velocihost.net/?utm_source=email_signature&utm_medium=logo-image> [Like us on Facebook]<https://www.facebook.com/velocihostnet> [Follow us on Twitter] <https://twitter.com/VelociHOSTnet> [Call us on WhatsApp] <https://wa.me/18338356244>

1 0

Pre-8.5 Content Moved to Vault
by Neil Hanlon 29 Jan '22

29 Jan '22

Hi all, All Rocky Linux releases prior to 8.5 (8.3, 8.4-RC1, and 8.4), have been moved to the Vault[1]. It is available via HTTP(s) and rsync via the `rocky-vault` module on msync.rockylinux.org. Thank you for your patience as we worked on migrating these releases to a vault and rearranged them a bit. This change will help for quicker syncs, crawls, and less disk utilized. If you are able to mirror both the active and vault content, that would be greatly appreciated, but is not a requirement generally for mirrors. Lastly, over the next month or so, the RL infrastructure team will be working on our mirror infrastructure to make it more geographically diverse as well as improve performance. Along with these improvements likely will bring a more official mirroring policy and some tiering in order to reduce load on the Tier 0 mirrors. We hope that additional geodiverse rsync servers will enable us to propagate changes faster and more reliably than before. If you any have ideas or would like to help out, please reply to this email or reach out via IRC or mattermost! We are incredibly thankful for your support of Rocky Linux and contribution to making Rocky available around the globe. More information about future changes will be communicated via this mailing list as well as via socials and our website. [1] https://dl.rockylinux.org/vault/rocky/ Best Regards, Neil Hanlon Infrastructure Team Lead, Rocky Linux

1 0

2026

2025

2024

2023

2022

rocky-mirror-announce