Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Advertise on LowEndTalk.com
OpenVZ inside KVM
New on LowEndTalk? Please Register and read our Community Rules.

OpenVZ inside KVM

jmginerjmginer Member, Provider
edited February 2013 in General

Hi all, I want review my infra after 5 months in BETA and now 1 month in production.

We have deployed all our OVZ infra, installing the OVZ kernel on a KVM VPS.

We use Proxmox as a CloudDataCenter software.

A picture: http://t.co/pZDW6Qlp

Before starting the project, on Q3-2012, I try to find some review, everybody says that I will receive very poor performance... but wait! I'm using SSD disks, so I say that I will try.

Now, 6 months later and around 250 containers running on 6 KVM nodes ( 3 dedicated servers with 2 KVM VPS each one), the performance is Ok and not any problem related stability, (CentOS 6 has full support for VirtIO drivers).

Virtualization inside virtualization = More scalability and more backup options.
Hardware problem? -> I will migrate the KVM VPS, and I'm migrating several containers, yeah!

Maybe you are interested to hear this.

Best regards!

★ OFFER! ☛ VPS in Spain ★ We accept Bitcoins! ★ DMCA ignore ★

Comments

  • shovenoseshovenose Member, Provider

    I asked about this at some point and everybody said I should end up with poor performance and stability. Even though I felt that nobody had actually tried it.
    Thanks for the informative post.

  • jarjar Provider
    edited February 2013

    Glad it's working for you. Having spent some time testing the same theory it was ultimately my conclusion (and contrary to previous statements) that it was one more potential point of failure and both the benefits and dangers were based on "what if."

    However, it's absolutely viable. Look forward to hearing more about your experience with it but I can't think of any questions to ask.

  • EvixoEvixo Member
    edited February 2013

    @jmginer Thanks for the information :-) Could you tell me what disk speeds you get on your host, KVM VPS and your OpenVZ VPS? (Just wondering what performance loss you have due to the virtualization layers).

  • jmginerjmginer Member, Provider
    edited February 2013

    I use Intel 520 SSD Series

    This is the poor performance:

    [[email protected] ~]#
    [[email protected] ~]# vzctl enter 1552
    entered into CT 1552
    [email protected]:/#
    [email protected]:/# dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 5.91186 s, 182 MB/s
    [email protected]:/#
    [email protected]:/# rm -rf test
    [email protected]:/#
    [email protected]:/# exit
    logout
    exited from CT 1552
    [[email protected] ~]#

    ★ OFFER! ☛ VPS in Spain ★ We accept Bitcoins! ★ DMCA ignore ★
  • InfinityInfinity Member, Provider

    Mmm, it's definately been tried and am pretty sure it is used by some providers. It works but the performance isn't as good. IO doesn't mean everything, and the node once it gets filled up and once you use multiple ovz installations on one physical servers the performance will go down dramatically.

    Cablestreet - London based ISP - Managed Solutions, Carrier Services, Colocation, Dedicated Servers, VMs, and more..

  • jmginerjmginer Member, Provider

    Yes, we lost performance, around 50%, but still good as you can see. 180 MB/s is good acceptable.

    If I run directly on the Proxmox node Intel 520 series return +300 MB/s

    [email protected]:~# dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 3.2975 s, 326 MB/s
    [email protected]:~#
    [email protected]:~# qm list
    VMID NAME STATUS MEM(MB) BOOTDISK(GB) PID
    151 ovz1 running 14336 420.00 2316
    154 ovz4 running 14336 420.00 2390
    [email protected]:~#

    Regards!

    ★ OFFER! ☛ VPS in Spain ★ We accept Bitcoins! ★ DMCA ignore ★
  • jarjar Provider

    What would interest me is seeing ioping results inside an OVZ container and then from the host node. That would be where it would really make or break.

  • jmginerjmginer Member, Provider
    edited February 2013

    @jarland Check the IOping stats on the node.

    During backups -> less 100ms in waiting on /vz partition
    Not backup running -> less 30 ms in waiting

    http://bestpic.es/image/1360766866.png

    To verify inside the container, please, order one :)
    http://www.lowendtalk.com/discussion/7975/spain-leb-1vcpu1ghz-256-mb-mem-2-gb-ssd-100-gb-traffic-35year#Item_17

    Regards!

    ★ OFFER! ☛ VPS in Spain ★ We accept Bitcoins! ★ DMCA ignore ★
  • jarjar Provider

    I mean like this

    ioping -c 10

    Around here it's become standard like the dd test to measure disk performance. Ideally it should be the same on both sides, just curious.

  • Munin's disk latency graphs != ioping results.

    Also, is this software raid?

  • jmginerjmginer Member, Provider

    @jarland

    [[email protected] ~]#
    [[email protected] ~]# ioping -c 1 /vz
    4096 bytes from /vz (ext4 /dev/mapper/vz-vz): request=1 time=0.5 ms

    --- /vz (ext4 /dev/mapper/vz-vz) ioping statistics ---
    1 requests completed in 0.6 ms, 2028 iops, 7.9 mb/s
    min/avg/max/mdev = 0.5/0.5/0.5/0.0 ms
    [[email protected] ~]#
    [[email protected] ~]# vzctl enter 1552
    entered into CT 1552
    [email protected]:/#
    [email protected]:/# ioping -c 1 /
    4096 bytes from / (simfs /vz/private/1552): request=1 time=0.5 ms

    --- / (simfs /vz/private/1552) ioping statistics ---
    1 requests completed in 0.6 ms, 1876 iops, 7.3 mb/s
    min/avg/max/mdev = 0.5/0.5/0.5/0.0 ms
    [email protected]:/# exit
    logout
    exited from CT 1552
    [[email protected] ~]#

    ★ OFFER! ☛ VPS in Spain ★ We accept Bitcoins! ★ DMCA ignore ★
  • jarjar Provider

    Doesn't seem bad.

  • @jmginer said: Hardware problem? -> I will migrate the KVM VPS

    How do you migrate a KVM VPS if using local storage?

    -

  • interesting

  • Tried it and never had an issue with it, performance was absolutely fine for any real world application.

    Getting IPv6 working with proxmox and NAT IPv4 was tricky but possible.

    I am no longer active here, find me at https://talk.lowendspirit.com

  • I never said it will be horrible, in fact ovz is not real virtualization.
    I run frequently xen within KVMs both vanilla and XCP and while there are problems, they can be solved.
    With OVZ it should be even better performance.
    I think 50% performance loss is a bit much, could be tweaked further, imo.

    Extremist conservative user, I wish to preserve human and civil rights, free speech, freedom of the press and worship, rule of law, democracy, peace and prosperity, social mobility, etc. Now you can draw your guns.

  • raindog308raindog308 Administrator, Moderator

    Why stop there...go KVM -> Xen -> OvZ for the trifecta.

    Thanked by 1neps

    For LET support, please visit the support desk.

  • Well KVM well configured can be as little as 3% loss on native HW so why would OpenVZ inside KVM be anywhere close to 50%

    I am no longer active here, find me at https://talk.lowendspirit.com

  • @Jack said: I run Proxmox on a KVM with iperweb.

    Well, I and erawan run linux in windows with vmware and virtualbox on the windows server 2008RC2 LEB offer with only 512 ram. I had no lag except at install.
    That is linux HN/KVM windows/vmware linux

    Extremist conservative user, I wish to preserve human and civil rights, free speech, freedom of the press and worship, rule of law, democracy, peace and prosperity, social mobility, etc. Now you can draw your guns.

  • I've personally never had great experiences with Intel SSDs.

    Discord: robert#8239

  • It's funny I can install Proxmox in a Vmware VM but I can't install Vmware in a proxmox KVM..

    Althought the KVM option in proxmox did not work in a Vmware VM, OVZ worked great.

  • @Maounique said: Well, I and erawan run linux in windows with vmware and virtualbox on the windows server 2008RC2 LEB offer with only 512 ram. I had no lag except at install.

    Hehe... At first, after reading the thread tittle, I just remembered about running an Ubuntu Desktop inside a Windows 2008 KVM :D

  • doyou have debian os?

  • may set up is debian how ccan i set up my open vZ to debian thanks.. ineed your help.

  • Strictly speaking, OpenVZ isn't virtualization, it's container. So there's nothing that would prevent you from using OpenVZ from inside a true VM.

    Since namespaces development in Linux has advanced significantly since 2001, perhaps using LXC would be still faster.

    Monitor your network assets with IPHost (contact me to obtain a discount code)
  • yomeroyomero Member
    edited April 2018

    Necromancers

    But ok

    @david0923

    You should learn about proxmox (version 3), is a Debian based platform to install OpenVZ.

    Currently they are at the version 5, which doesn't support it, but works with LXC containers.

    Thanked by 1Shazan
Sign In or Register to comment.