Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Ceph on Virtualizor
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Ceph on Virtualizor

edited May 2018 in General

Reading their docs, they describe how to install it but not really how it's used from a customer perspective.

Can anyone give me an idea of a typical use case on Virtualizor? I don't currently use Virtualizor.

Does it give me cloud storage accessible from multiple VPS's so they can do snapshots etc.? If so, can that be done from the WHMCS control panel. I'm not that familiar with Ceph either.

Also, what are people using for KVM image format in general. For VPS and Ceph. Raw or Qcow2? I have used raw but haven't used qcow on anything before. My guess is that SSD's make the performance hit of qcow less of an issue

I have been kind of waiting to see what is happening with virtualization technologies before upgrading from OpenVZ. I don't like the fact OVZ7 uses a custom OS and LXC has it's own drawbacks. So I think I am going to move everything to KVM.

«1

Comments

  • FHRFHR Member, Host Rep

    As a customer, you will not have access to the underlying Ceph infrastructure. Ask your provider what features they offer and how to use them. Some providers do snapshots, some don't.

  • if you cantact virtualizor team via ticket or on skype they provide support and install virtualizor for you and also configure.
    here is guide to install virtualizor kvm.
    http://www.virtualizor.com/wiki/Install_KVM

  • edited May 2018

    LosPollosHermanos said: Quote

    @FHR said:
    As a customer, you will not have access to the underlying Ceph infrastructure. Ask your provider what features they offer and how to use them. Some providers do snapshots, some don't.

    I am the provider.

  • edited May 2018

    @mhosting_in said:
    if you cantact virtualizor team via ticket or on skype they provide support and install virtualizor for you and also configure.
    here is guide to install virtualizor kvm.
    http://www.virtualizor.com/wiki/Install_KVM

    I don't need install advice. They documented that. I just want to know what it is used for from a point and click customer perpective.

  • ಠ_ಠ

    Thanked by 1Francisco
  • FHRFHR Member, Host Rep

    If you are not familiar with Ceph, you should not use it. It can break in thousands ways.
    Play with it in a dev environment

    Thanked by 1Shazan
  • FranciscoFrancisco Top Host, Host Rep, Veteran

    @FHR said:
    If you are not familiar with Ceph, you should not use it. It can break in thousands ways.
    Play with it in a dev environment

    Even if you are familiar with it, it'll break a million ways.

    It's called job security for the "experts".

    Francisco

    Thanked by 1FHR
  • BharatBBharatB Member, Patron Provider

    Ceph is nothing but an advanced level of block & file storage system consider it something like having your own S3 at a very scalable and cheaper cost ( since you'll decide when to scale ) anything from block storage, object storage, distributed storage ( main purpose ) can be achieved.

    Thanked by 1hanoi
  • edited May 2018

    I'm still hoping that someone can answer the question of how it's used in Virtualizor, from a customer perspective.

  • AnthonySmithAnthonySmith Member, Patron Provider

    LosPollosHermanos said: I'm still hoping that someone can answer the question of how it's used in Virtualizor, from a customer perspective.

    Sure, from a customer perspective it is transparent.

  • edited May 2018

    @AnthonySmith said:

    LosPollosHermanos said: I'm still hoping that someone can answer the question of how it's used in Virtualizor, from a customer perspective.

    Sure, from a customer perspective it is transparent.

    Transparent how? What does it actually do for them? Does it give them the ability to do snapshots? Like what you get with Digital Ocean?

  • @LosPollosHermanos

    Everything needs to be implemented. Virtualizor seems to have the snapshot/backup feature built in though.

  • wavecomaswavecomas Member, Host Rep

    why ceph if you are not familier with it ? in my knowledge it can be really difficult to handle.. I could use ceph with kvm and cloudstack... there is high avaylabilty. But with just virtualizor...

  • Maybe virtualizor has some other way they are doing the snapshot feature. Saw their instructions for setting up Ceph and I just assumed that is what they are using with the snapshot feature.

  • dfroedfroe Member, Host Rep

    Well, of course it is only a singular case, but ZXHost's past has told us LET folks, that even if you mostly know what you are doing, CEPH is capable to ruin your whole business...

  • FranciscoFrancisco Top Host, Host Rep, Veteran
    edited May 2018

    @dfroe said:
    Well, of course it is only a singular case, but ZXHost's past has told us LET folks, that even if you mostly know what you are doing, CEPH is capable to ruin your whole business...

    There's plenty of cases of CEPH going mental.

    DO had a issue in France the other month which caused it to be offline for 2 days. OVH had months+ of performance issues, outages, etc, and even to this day it supposedly has a lot of problems. ZXHost claims they had an issue where they couldn't boot things and it ended up them folding up shop, or close to it.

    There's lots of cases on google of other groups have issues, it's not a easy beast to tame.

    That's why I won't touch it.

    Francisco

  • ShazanShazan Member, Host Rep

    @LosPollosHermanos said:
    Transparent how? What does it actually do for them? Does it give them the ability to do snapshots? Like what you get with Digital Ocean?

    CEPH just stores the vps data on it and can do snapshots. But you don't need CEPH to let your customer make snapshots, you can use LVM too. The difference is that CEPH is distributed.

    In other words, nothing changes for the customer if you use CEPH or other storage for the vps.

    So, just go with LVM if you thought of CEPH just to make snapshots, unless you need a distributed and complicated storage.

    Thanked by 1zhujiwiki
  • drserverdrserver Member, Host Rep

    LosPollosHermanos said: I'm still hoping that someone can answer the question of how it's used in Virtualizor, from a customer perspective.

    There is no difference, your customer does not see your storage backend

    Thanked by 2BharatB Aidan
  • @drserver said:

    LosPollosHermanos said: I'm still hoping that someone can answer the question of how it's used in Virtualizor, from a customer perspective.

    There is no difference, your customer does not see your storage backend

    I want offsite storage. Doesn't have to be distributed. I don't want snapshots on the same hardware as the VPS itself. Preferably a different datacenter as well, or both.

  • drserverdrserver Member, Host Rep

    LosPollosHermanos said: I want offsite storage. Doesn't have to be distributed. I don't want snapshots on the same hardware as the VPS itself. Preferably a different datacenter as well, or both.

    >

    So where is the problem

  • BharatBBharatB Member, Patron Provider

    Doesn't justify use for CEPH really, you could write a small script to push your snapshots to S3

  • @drserver said:

    LosPollosHermanos said: I want offsite storage. Doesn't have to be distributed. I don't want snapshots on the same hardware as the VPS itself. Preferably a different datacenter as well, or both.

    >

    So where is the problem

    No problem. Just curious how people are doing it. I thought maybe Ceph but I guess not. There is also GlusterFS which looks interesting if that can be incorporated into Virtualizor GUI somehow.

  • drserverdrserver Member, Host Rep

    For offsite snapshots you don't need Gluster or Ceph, you could just use remote FTP server

  • FHRFHR Member, Host Rep

    @LosPollosHermanos said:

    No problem. Just curious how people are doing it. I thought maybe Ceph but I guess not. There is also GlusterFS which looks interesting if that can be incorporated into Virtualizor GUI somehow.

    Performance of Gluster can vary quite a bit. It can work fine if all server are in one rack/datacenter, but never use it over internet.

  • hostfavhostfav Member, Host Rep
    edited May 2018

    @LosPollosHermanos We don't have experience CEPH with Virtualizor. But we have been using CEPH in one of our Datacenters for our Productions servers since 2015.

    We are not using separate CEPH cluster. We are using 3 nodes Proxmox Cluster with CEPH.

    Both KVM and LXC VPS are running fine.

    We have moved most of servers from VMware and SAN VNX5300 to Proxmox Cluster

    Our CEPH configuration:

    • 3 Nodes Proxmox v4x Cluster

    • Each nodes has 4 x 1 Gbps NIC for VMs and Dual 10Gbps for CEPH. 10G NIC are configured as Bond and Mode Broadcast. Because we are not using any 10G switch. We tried cheap switches and did not get good performance.

    • Each node has 3 different types of drives. SSD, SAS and SATA

    • We have 3 different CEPH Crush Maps configured for Performance (SAS), Capacity (72k SATA) and SSD Storage.

    • Each node has 2 Journal Disks, one for Performance Storage and one for Capacity Capacity. SSD are not using Journal Disk.

    • Our Pools are configured with 2 replica for redundancy.

    Last month one of our nodes Capacity Storage's Journal disk failed and we were able to recover.

    Planning to move our NY customers' Proxmox 5 nodes cluster to CEPH this month.

    We are using RAW storage for all KVMs.

    CEPH helps us to Live VM Migration and Storage Migration, nodes maintenance etc.

    Thanked by 1hanoi
  • edited May 2018

    @drserver said:
    For offsite snapshots you don't need Gluster or Ceph, you could just use remote FTP server

    Only if it's incorporated into the GUI with a "snapshot" button the customer can use on their own for creating and restoring snapshots. That is the goal. See what Digital Ocean does for an example of how it should be done.

  • edited May 2018

    @FHR said:

    @LosPollosHermanos said:

    No problem. Just curious how people are doing it. I thought maybe Ceph but I guess not. There is also GlusterFS which looks interesting if that can be incorporated into Virtualizor GUI somehow.

    Performance of Gluster can vary quite a bit. It can work fine if all server are in one rack/datacenter, but never use it over internet.

    Performance over WAN/internet connections is what I am most curious about. That is how I probably want to use it. They have an asyncronous mode designed specifically for that.

  • emptyPDemptyPD Member

    since ZXHost issue, i panic when i read the word "ceph".

  • FranciscoFrancisco Top Host, Host Rep, Veteran

    @emptyPD said:
    since ZXHost issue, i panic when i read the word "ceph".

    Not a rare opinion it seems :P

    Francisco

    Thanked by 2Harambe Shazan
  • virtualizorvirtualizor Member
    edited June 2018

    Hi,

    Virtualizor will support ceph from 2.9.6 onwards. It will be a storage option to cretae Vms.
    We have added this option as some of our partners wanted this storage supported.
    Change log for 2.9.6 launched yesterday :
    http://www.virtualizor.com/blog/?p=1798

Sign In or Register to comment.