mirror status update for 5.3 release

by Karanbir Singh Email

The release is going to get pushed out by another 24 hrs or so, ETA is now Tuesday morning UTC.

Getting the internal centos mirror network has taken a bit longer than I'd originally planned for - a couple of donated machines that were previously used to 'bridge' slow network links have gone away, and thats meant most of the last 2 days were spent juggling rsync's to make sure things move in the right direction, at reasonable speeds. My estimate on data moved within *.centos.org in the last 2 days = 1.2 TiB. Its not a very large number, but consider this : no two machines within the centos network are actually hosted in the same facility.

There is a *lot* of scope for changes to make the process more efficient, but I think we'd best do that sort of re-engineering when there isnt a release waiting to go out.

- KB

10 comments

Comment from: Greg Bailey [Visitor]
Any reason the torrents couldn't be made available? Sounds like the delay is logistical in that it's related to getting the bits pushed around to the mirrors. The images themselves have been finalized, right?
29/Mar/2009 @ 20:39
Comment from: Karanbir Singh [Member] Email · http://www.karan.org/
hi Greg,

The .torrents are ready - and yea, the last 5 - 7 days has only been internal release stuff going around.

The reason why having torrents out there isnt something we quite fancy is that if people install 5.3 from the torrents, the distro repo's and tree's they hit with yum will still be pointing at 5.2 rpms. both on internatl centos mirror's and external repo's. Even trying this within a small closed group in the early CentOS-4 days, we realised that wasent going to work, too much potential to get into odd situations.
29/Mar/2009 @ 20:51
Comment from: Pumpino [Visitor]
Karanbir, you mentioned that no two CentOS servers are hosted in the same data centre. How many servers are there and what led to the decision to locate them separately? This would certainly make transferring large amounts of data much slower.
29/Mar/2009 @ 22:14
Comment from: Josh [Visitor]
could you do something similar to how games patches are distributed? Seed 90% of the torrent until the mirrors are synced and then provide the last 10%. That way you can have a base of people with most of the torrent already downloaded so that it will be shared to the community quickly. I don't know how difficult it would be logistically, but it is an idea.
30/Mar/2009 @ 15:05
Comment from: Karanbir Singh [Member] Email · http://www.karan.org/
Pumpino,

the whole centos network is spread over the world, idea being that a large number of people get local access - fast and normally at low cost. Also, having it distributed wide has the benefit of redundancy for free.

Ofcourse this wasent by design. Its just that most of the donors will sponsor machines either inside their own networks or close to their networks.
30/Mar/2009 @ 15:27
Comment from: Karanbir Singh [Member] Email · http://www.karan.org/
Josh,

That sounds interesting. Maybe something we could look into - where should we start ? is this something you might want to get involved in and help setup ?

30/Mar/2009 @ 15:28
Comment from: Peter [Visitor] · http://www.le-copi.nl
If I can assist with torrents then I might be able to donate some bandwith. At this moment I have 150gb per month I'm not using. It's not mutch, it's in a datacenter thought, so 100mbit upstream available. Would only need to be able to throttle it
30/Mar/2009 @ 17:49
Comment from: Office Man [Visitor] Email
Interested in providing torrent feeds on DVDs. I've got rtorrent running on a machine with the torrent files loaded.

Do I just leave it sitting there? Will it automatically start downloading and allowing others to download from it once the files are available?

We have a decent amount of outbound bandwidth available this week.

31/Mar/2009 @ 10:20
Comment from: Orion [Visitor]
Peter,

At this point if you really want to help use up some of your bandwidth, start seeding the torrents.
I jumped on them and already have about 2Tb transfered over the 4 Centos5.3 torrents.

Orion
31/Mar/2009 @ 10:47
Comment from: Mirrors [Visitor] · http://kentwoodmfg.com
Very cool. Let me know if you need more bandwidth. I will soon have 3tb
28/Jul/2009 @ 14:36

This post has 1 feedback awaiting moderation...

Leave a comment


Your email address will not be revealed on this site.

Your URL will be displayed.
(Line breaks become <br />)
(Name, email & website)
(Allow users to contact you through a message form (your email will not be revealed.)