Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


GlusterFS Over WAN
New on LowEndTalk? Please Register and read our Community Rules.

GlusterFS Over WAN

So let me bounce this off the knowledge here.

Is glusterFS really slow over WANS?
Is there anything that can be done to improve the speeds?
Should I just built more concentrated network spots, instead of diversifying heavily? i,e ( just NY and SF) instead of (NY, LA, SF, Dallas)?
Any other suggestions?

I personally don't think I would need more then 4MB/s but, it is a tad slow for what I am used to.

Comments

  • SpeedyKVMSpeedyKVM Banned, Member
    edited September 2014

    For higher latency links use the geo replication settings; http://www.jamescoyle.net/how-to/1037-synchronise-a-glusterfs-volume-to-a-remote-site-using-geo-replication

    Between Dallas and Seattle I get ~150mbit (18MB/sec) single thread speeds, so I've been thinking of testing it for one of my non latency sensitive hobby projects.

    Thanked by 1Neoon

    https://wable.com - Resource Bundle based SSD VPS cloud (move resources on the fly). Deploy 1 or many VPS. DAL, NYC, SEA. Snapshots, plus Cloning (even between cities). https://SpeedyKVM.com

  • From what I read on geo-replication it is like a time rsync and thus file concurrency is dropped.

    I was thinking of running it in an environment where files would need to be changed and somewhat frequently. Though it wouldn't matter most of the time, I am afraid of certain situations where the files may have two new versions and issues would arise.

  • SpeedyKVMSpeedyKVM Banned, Member

    This is another one I've been wanting to try; http://www.xtreemfs.org/all_features.php

    XtreemFS supports globally distributed installations. You can quickly build your own storage cloud with XtreemFS, or you can use XtreemFS from the cloud to access external storage resources.

    https://wable.com - Resource Bundle based SSD VPS cloud (move resources on the fly). Deploy 1 or many VPS. DAL, NYC, SEA. Snapshots, plus Cloning (even between cities). https://SpeedyKVM.com

  • perennateperennate Member, Provider

    this one's designed partly for wan case -- http://xtreemfs.com/

    still experimental though

  • The only issue I see is a need for a Meta data server, which I was trying to avoid. I wanted everything to be in a master master setup thus allowing a quick pull of any node.

  • perennateperennate Member, Provider

    Mun said: The only issue I see is a need for a Meta data server, which I was trying to avoid. I wanted everything to be in a master master setup thus allowing a quick pull of any node.

    Well, you could run metadata server on every node -- it allows replication of the metadata server. Not sure how that impacts performance though. I also got into some issues with some attributes freezing while doing writes, not sure if that was only because of options like preferring local copies when writing from a storage node.

Sign In or Register to comment.